hard20 pts · first answer countsragvector-databases
A billion vectors on a budget
You need search over 1 billion 768-dimension vectors (about 3 TB as float32), and RAM is limited to 256 GB per server. What approach fits?
Discussion 0
Join free to post in the discussion.
Related questions
- What RAG doesAI Engineer (LLM & Generative AI)
- What a vector database doesAI Engineer (LLM & Generative AI)
- What semantic search adds over keywordsAI Engineer (LLM & Generative AI)
- What an embedding dimension isAI Engineer (LLM & Generative AI)
- What top-k means in retrievalAI Engineer (LLM & Generative AI)
- Why vector search is approximateAI Engineer (LLM & Generative AI)
- When a flat index is fineAI Engineer (LLM & Generative AI)
- Why store metadata with each chunkAI Engineer (LLM & Generative AI)