medium10 pts · first answer countscachingembeddings

Semantic cache gives wrong answers

You add a semantic cache that returns a stored answer when a new question embedding has cosine similarity above 0.85 with a cached one. Users now get wrong answers. "Cancel my order" got the cached reply for "Do not cancel my order". What is the best fix?

A.Raise the threshold, scope keys by user and intent, and measure false hitsB.Lower the threshold to 0.6 so more similar questions share answersC.Key the cache on response length instead of question embeddingsD.Remove the expiry time so cached entries stay valid for longer

Discussion 0

Join free to post in the discussion.

Semantic cache gives wrong answers

Discussion 0

Related questions