Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Online Softmax

Online Softmax

Subtopic4 questions

Questions tagged with Online Softmax — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Does FlashAttention change the attention output relative to standard attention?
Multiple ChoiceEasy
Flash-Decoding parallelizes an axis FlashAttention v2 left alone. Pick which one.
Multiple ChoiceMedium
Why does FlashAttention speed up serving even though it doesn't change the math?
Short AnswerHard
Walk through what FlashAttention does differently from standard attention, and what changes between v1, v2, and v3.
Short AnswerHard

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Cohere Shield Ai

Fireworks Ai NVIDIA

Infosys Krutrim