hard20 pts · first answer countsllm-evaluationstatistics

Bootstrap for a score difference

You compare prompts A and B on the same 300 cases with a continuous judge score. How does a paired bootstrap estimate a confidence interval for the difference?

A.Resample A's and B's scores separately and compare the means onceB.Run each prompt once more and subtract the two totalsC.Resample cases with replacement, compute B − A each time, use percentilesD.Average the scores and multiply by 1.96

Discussion 0

Join free to post in the discussion.

Bootstrap for a score difference

Discussion 0

Related questions