medium10 pts · first answer countsragvector-databases
Making nightly re-indexing cheaper
Your nightly job re-embeds all 5 lakh documents, though fewer than 1% change each day. How do you cut the cost?
Discussion 0
Join free to post in the discussion.
Related questions
- What RAG doesAI Engineer (LLM & Generative AI)
- What a vector database doesAI Engineer (LLM & Generative AI)
- What semantic search adds over keywordsAI Engineer (LLM & Generative AI)
- What an embedding dimension isAI Engineer (LLM & Generative AI)
- What top-k means in retrievalAI Engineer (LLM & Generative AI)
- Why vector search is approximateAI Engineer (LLM & Generative AI)
- When a flat index is fineAI Engineer (LLM & Generative AI)
- Why store metadata with each chunkAI Engineer (LLM & Generative AI)