medium10 pts · first answer countsbatch-processingcost-optimization

Labelling a million reviews

You need to classify a million old product reviews by next week. Many providers offer a batch API. When is it the right choice?

A.For jobs that do not need instant answers, since batch requests are usually much cheaper and finish within hoursB.Only for real-time chat, because it is fasterC.Never, because batch output quality is lowerD.Only when each request has exactly one token

Discussion 0

Join free to post in the discussion.

Labelling a million reviews

Discussion 0

Related questions