Medium AI Engineer (LLM & Generative AI) questions
34 questions · 10 points each for a correct first answer.
- 1.Choosing a chunking strategyrag, chunkingmedium
- 2.Getting reliable JSON outputstructured-output, reliabilitymedium
- 3.Knowledge that changes every dayrag, fine-tuningmedium
- 4.Embeddings miss exact product codesvector-search, ragmedium
- 5.Adding a rerankerrag, rerankingmedium
- 6.Who runs the tooltool-calling, agentsmedium
- 7.Making prompt caching workcost-optimisation, latencymedium
- 8.Pairwise LLM judge biasevaluation, llm-as-judgemedium
- 9.Cosine similarity by handembeddings, linear-algebramedium
- 10.Temperature changes probabilitiessampling, softmaxmedium
- 11.How many tokens top-p keepssamplingmedium
- 12.From logprobs to probabilitylogprobs, probabilitymedium
- 13.Computing recall at 5retrieval-metrics, evaluationmedium
- 14.Computing MRRretrieval-metrics, evaluationmedium
- 15.Estimating monthly token costtoken-costmedium
- 16.Savings from a cached prefixprompt-caching, token-costmedium
- 17.Why add jitter to backoffrate-limits, reliabilitymedium
- 18.Tracing a retry helperpython, reliabilitymedium
- 19.What schema-constrained output guaranteesstructured-outputmedium
- 20.Two tool calls in one turntool-callingmedium
- 21.Counting chunks with overlapchunking, ragmedium
- 22.Keeping tenants apart in RAGrag, securitymedium
- 23.Tuning HNSW search breadthvector-search, hnswmedium
- 24.Reciprocal rank fusion scoreshybrid-search, retrieval-metricsmedium
- 25.Judge prefers longer answersllm-as-judge, evaluationmedium
- 26.Dot product on unit vectorsembeddings, vector-searchmedium
- 27.Cosine of a scaled vectorpython, embeddingsmedium
- 28.Streaming tool-call argumentsstreaming, tool-callingmedium
- 29.Semantic cache gives wrong answerscaching, embeddingsmedium
- 30.Debugging a bad agent answerobservability, agentsmedium
- 31.Which rate limit binds firstrate-limits, token-costmedium
- 32.Memory for 4-bit weightsquantization, deploymentmedium
- 33.Running SQL that an LLM wroteguardrails, securitymedium
- 34.Users start asking new thingsmonitoring, driftmedium