Topics PracticeChallenges Pricing

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Daily practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Head Dim

Head Dim

Subtopic3 questions

Questions tagged with Head Dim — part of Attention Mechanism.

Sort

Questions

Name the scalar that QK^T is divided by inside scaled dot-product attention.
FlashcardEasy·Qual 4.0
Pick the formula that defines head_dim from hidden_size and num_heads.
Multiple ChoiceEasy·Qual 4.0
Modern 7B-class LLMs, fill in typical head counts and the resulting per-head dimension
Fill in BlankEasy·Qual 4.0

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.