easy5 pts · first answer countstransformerstransformer-architecture
What 7B in a model name means
What does "7B" mean in a name like "Mistral 7B"?
Discussion 0
Join free to post in the discussion.
Related questions
- What LLM pretraining learnsAI Engineer (LLM & Generative AI)
- How BPE builds its vocabularyAI Engineer (LLM & Generative AI)
- Tokens per English wordAI Engineer (LLM & Generative AI)
- Why Hindi text uses more tokensAI Engineer (LLM & Generative AI)
- What the end-of-sequence token doesAI Engineer (LLM & Generative AI)
- What the embedding layer doesAI Engineer (LLM & Generative AI)
- Query, key and value in attentionAI Engineer (LLM & Generative AI)
- Why transformers need position informationAI Engineer (LLM & Generative AI)