hard20 pts · first answer countsprompt-engineeringprompt-iteration

An LLM that favours option A

You use an LLM to answer multiple-choice questions and notice it picks the first option more often than chance. What is a robust mitigation?

A.Always put the correct answer in position AB.Ask several times with shuffled options and take the majorityC.Remove the option letters and ask for free text onlyD.Use a higher temperature for every question

Discussion 0

Join free to post in the discussion.

An LLM that favours option A

Discussion 0

Related questions