Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Tokenization
/
Padding
Padding
Subtopic
3 questions
Questions tagged with Padding — part of Tokenization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
DataCollator pads to max_length and sets attention_mask = ones: find what breaks
Spot the Error
Medium
You pad a batch to equal length. How does the model know to ignore the filler tokens?
Flashcard
Easy
You are fine-tuning Llama 3 8B on variable length instruction data. Which padding strategy and side do you pick?
Multiple Choice
Medium
Datarobot
OpenAI
Rephrase Ai
Synthesia
Midjourney
Sambanova