medium10 pts · first answer countsragevaluationgrounding

The bot says "I don't know" too often

You tightened the prompt to "answer only if the context fully supports it". Wrong answers dropped from 8% to 2%, but "I don't know" rose from 5% to 30%. What is the right reading?

A.It is a trade-off; check whether those abstentions had answers in the contextB.It is a pure win, since fewer wrong answers is all that mattersC.It is a pure loss, so the old prompt should be restored at onceD.The retriever must be broken because abstentions rose

Discussion 0

Join free to post in the discussion.

The bot says "I don't know" too often

Discussion 0

Related questions