hard20 pts · first answer countsragcontext-windowrag-operations
Whole corpus in context versus RAG
Your 400,000-token corpus fits in a 1M-token context window. Input costs ₹250 per million tokens, and you get 10,000 queries a day. Without caching, what is the daily input cost of sending the full corpus each time?
Discussion 0
Join free to post in the discussion.
Related questions
- What RAG doesAI Engineer (LLM & Generative AI)
- What a vector database doesAI Engineer (LLM & Generative AI)
- Does the reply use context spaceAI Engineer (LLM & Generative AI)
- Checking prompt size in advanceAI Engineer (LLM & Generative AI)
- What semantic search adds over keywordsAI Engineer (LLM & Generative AI)
- What an embedding dimension isAI Engineer (LLM & Generative AI)
- What top-k means in retrievalAI Engineer (LLM & Generative AI)
- Why vector search is approximateAI Engineer (LLM & Generative AI)