Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Head Dim

Head Dim

Subtopic3 questions

Questions tagged with Head Dim — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Name the scalar that QK^T is divided by inside scaled dot product attention.
FlashcardEasy
Pick the formula that defines head_dim from hidden_size and num_heads.
Multiple ChoiceEasy
Modern 7B class LLMs, fill in typical head counts and the resulting per head dimension
Fill in BlankEasy

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Deloitte Forethought

Accenture Ai4bharat