Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
FlashAttention
FlashAttention
Subtopic
6 questions
Questions tagged with FlashAttention — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Spot the bug: packed-sequence SFT where the model learns to copy across unrelated examples
Spot the Error
Hard
·
Qual 4.0
Spot the masking bug in this packed-sequence training setup
Spot the Error
Medium
·
Qual 4.0
How does torch.nn.functional.scaled_dot_product_attention relate to FlashAttention?
Multiple Choice
Medium
·
Qual 4.0
Why is causal attention cheaper than full bidirectional at the same length?
Multiple Choice
Medium
·
Qual 4.0
Sequence packing: what it does, and the attention-mask gotcha
Short Answer
Hard
·
Qual 4.0
Why does prefill's O(seq^2) attention cost saturate compute rather than bandwidth?
Short Answer
Hard
·
Qual 4.0
NVIDIA