hard20 pts · first answer countsllm-fundamentalsllm-basics
Calculating perplexity
On a test text, a model assigns probability 0.25 to every correct next token. What is its perplexity on that text?
Discussion 0
Join free to post in the discussion.
Related questions
- What is a tokenAI Engineer (LLM & Generative AI)
- Effect of temperatureAI Engineer (LLM & Generative AI)
- What the context window limitsAI Engineer (LLM & Generative AI)
- What a hallucination isAI Engineer (LLM & Generative AI)
- Temperature close to zeroAI Engineer (LLM & Generative AI)
- What LLM pretraining learnsAI Engineer (LLM & Generative AI)
- Tokens in a 3,000-word reportAI Engineer (LLM & Generative AI)
- How a reply is generatedAI Engineer (LLM & Generative AI)