Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Head Dim

Head Dim

Subtopic3 questions

Questions tagged with Head Dim — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Name the scalar that QK^T is divided by inside scaled dot product attention.
FlashcardEasy
Which formula defines head_dim from hidden_size and num_heads?
Multiple ChoiceEasy
What are the typical head counts and head dimensions for modern 7B models?
Fill in BlankEasy

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Forethought Krutrim

Ai4bharat Flowise