Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Tokenization
/
Padding
Padding
Subtopic
3 questions
Questions tagged with Padding — part of Tokenization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
DataCollator pads to max_length and sets attention_mask = ones: find what breaks
Spot the Error
Medium
·
Qual 4.0
You pad a batch to equal length. How does the model know to ignore the filler tokens?
Flashcard
Easy
·
Qual 4.0
You are fine-tuning Llama 3 8B on variable-length instruction data. Which padding strategy and side do you pick?
Multiple Choice
Medium
·
Qual 4.0