Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Attention Mask
Attention Mask
Subtopic
6 questions
Questions tagged with Attention Mask — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Premium
Spot the bug: packed…
Spot the Error
Hard
DataCollator pads to max_length and sets attention_mask = ones: find what breaks
Spot the Error
Medium
Find the error in this claim about softmax over a fully masked attention row.
Spot the Error
Medium
You pad a batch to equal length. How does the model know to ignore the filler tokens?
Flashcard
Easy
Spot the bug in this sequence packing setup
Spot the Error
Hard
What does sequence packing do, and what can go wrong with the attention mask?
Short Answer
Hard
Cursor
Decagon
Datarobot
OpenAI
Airbnb
Databricks
N8n
NVIDIA
Rephrase Ai
Synthesia
Flowise
NVIDIA