medium10 pts · first answer countsraghybrid-search
Working out an IDF weight
Using IDF = log₁₀(N / df), a corpus has N = 1,000,000 documents. The term "VAT" appears in 100,000 of them and "TRN" in 100. What are their IDF values?
Discussion 0
Join free to post in the discussion.
Related questions
- What RAG doesAI Engineer (LLM & Generative AI)
- What a vector database doesAI Engineer (LLM & Generative AI)
- What semantic search adds over keywordsAI Engineer (LLM & Generative AI)
- What an embedding dimension isAI Engineer (LLM & Generative AI)
- What top-k means in retrievalAI Engineer (LLM & Generative AI)
- Why vector search is approximateAI Engineer (LLM & Generative AI)
- When a flat index is fineAI Engineer (LLM & Generative AI)
- Why store metadata with each chunkAI Engineer (LLM & Generative AI)