Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Tokenization
/
Leading Space
Leading Space
Subtopic
3 questions
Questions tagged with Leading Space — part of Tokenization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
A hand-built chat prompt performs worse than apply_chat_template. Spot the tokenization issues.
Spot the Error
Medium
·
Qual 4.0
Spot the tokenization boundary bug in this manual prompt-building code.
Spot the Error
Hard
·
Qual 4.0
Predict whether tokenizer.encode('world') and tokenizer.encode(' world') produce the same token IDs in tiktoken.
Predict Output
Medium
·
Qual 4.0