hard20 pts · first answer countsllm-evaluationmetricsextraction

Scoring extracted line items

An extractor returns invoice line items as a list, in a different order from the labels and sometimes with an item missing. How should the eval score it?

A.Compare list position 1 with label 1, 2 with 2, and so onB.Mark the whole invoice wrong if the order differsC.Match predicted items to labels first, then score fields per pairD.Count only the number of items returned

Discussion 0

Join free to post in the discussion.

Scoring extracted line items

Discussion 0

Related questions