medium10 pts · first answer countsragrag-operations
Cost of one RAG answer
Each query sends 6 chunks of 400 tokens plus 500 tokens of instructions and question. The answer is 300 tokens. Input costs ₹250 and output ₹1,000 per million tokens. What is the cost per query?
Discussion 0
Join free to post in the discussion.
Related questions
- What RAG doesAI Engineer (LLM & Generative AI)
- What a vector database doesAI Engineer (LLM & Generative AI)
- What semantic search adds over keywordsAI Engineer (LLM & Generative AI)
- What an embedding dimension isAI Engineer (LLM & Generative AI)
- What top-k means in retrievalAI Engineer (LLM & Generative AI)
- Why vector search is approximateAI Engineer (LLM & Generative AI)
- When a flat index is fineAI Engineer (LLM & Generative AI)
- Why store metadata with each chunkAI Engineer (LLM & Generative AI)