medium10 pts · first answer countsragreranking

Right chunk at rank 15

The chunk that answers the question is usually retrieved, but at rank 12 to 20, while you only send the top 5 to the model. What helps most?

A.Send only the top 1 chunkB.Make chunks smaller without other changesC.Lower the temperature of the answer modelD.Retrieve more candidates, then use a reranker model to reorder them and keep the best few

← Search misses product codes Answers beyond the documents →