Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Scaled Dot Product Attention

Scaled Dot Product Attention

Subtopic7 questions

Questions tagged with Scaled Dot Product Attention — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Name the scalar that QK^T is divided by inside scaled dot product attention.
FlashcardEasy
If attention temperature divides QK^T and sampling temperature divides the output logits, where is each one applied?
Multiple ChoiceMedium
What is in a single attention head, and what is its output?
FlashcardEasy
Compare ALiBi's linear distance bias with RoPE's vector rotation. Which one modifies scores additively, and which modifies Q and K directly?
Multiple ChoiceMedium
Why is the dot product scaled by √d_k in attention? Derive the variance argument.
Short AnswerHard
PremiumWhat specifically goes wrong…
Multiple ChoiceMedium
Complete the canonical attention formula: Attention(Q, K, V) = ___(QKᵀ / ___) · V
Fill in BlankEasy

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Droom Inflection Ai

Elevenlabs Lakera

Datarobot Elevenlabs

Figure Ai Snowflake

Forethought Microsoft

Salesforce Weaviate