Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Attention Weight

Attention Weight

Subtopic4 questions

Questions tagged with Attention Weight — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Pick what happens to attention weights when pre-softmax scores are divided by a temperature T > 1
Multiple ChoiceEasy
Along which axis of the QK^T score matrix is softmax applied inside attention?
Multiple ChoiceEasy
Name the two properties softmax guarantees for every row of the attention weight matrix
Fill in BlankEasy
How does softmax turn an attention score into an attention weight?
FlashcardEasy

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Lepton Ai Sierra

Browserbase Citadel