Topics PracticeChallenges Pricing

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Daily practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Induction Heads

Induction Heads

Subtopic2 questions

Questions tagged with Induction Heads — part of Attention Mechanism.

Sort

Questions

Why does multi-head attention outperform a single large attention head?
Short AnswerHard·Qual 4.0
What has interpretability research shown about individual attention heads in trained transformers?
Multiple ChoiceHard·Qual 4.0

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.