Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Tokenization
/
Litetoken
Litetoken
Subtopic
2 questions
Questions tagged with Litetoken — part of Tokenization.
Format
Difficulty
Role
Experience
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Approximately what fraction of BPE vocabulary tokens does LiteToken identify as 'merge residues'?
Multiple Choice
Medium
·
Qual 4.0
What are BPE merge residues (LiteToken) and what do they imply for vocabulary efficiency?
Flashcard
Hard
·
Qual 4.0