Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Tokenization
/
Vocab Size
Vocab Size
Subtopic
5 questions
Questions tagged with Vocab Size — part of Tokenization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
A tokenizer has a 'vocabulary'. What is it, and why does its size matter for the model?
Flashcard
Easy
·
Qual 4.0
Your team debates 32K vs 128K vs 256K vocab. What is the core tradeoff they should frame?
Flashcard
Easy
·
Qual 4.0
Token 1234 means 'the' in one model and garbage in another. Why?
Flashcard
Easy
·
Qual 4.0
You are building a 7B model for 25 languages including Hindi, Arabic, and Swahili. Design a fair tokenizer and name what it costs.
Short Answer
Hard
·
Qual 4.0
$50K compute budget, 50B tokens of US legal text, 1.5B parameter model. Defend your tokenizer design.
Short Answer
Hard
·
Qual 4.0