Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Head Dimension

Head Dimension

Subtopic2 questions

Questions tagged with Head Dimension — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Define a single attention head, what does one head actually own and produce?
FlashcardEasy
If d_model = 768 and num_heads = 12, what is d_head?
Fill in BlankEasy

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Droom Inflection Ai

Hebbia Moveworks