Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Layernorm

Layernorm

Subtopic4 questions

Questions tagged with Layernorm — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Why does the transformer block use LayerNorm or RMSNorm instead of BatchNorm?
Multiple ChoiceEasy
RMSNorm versus LayerNorm, what is kept and what is dropped?
Multiple ChoiceMedium
Name what wraps the attention sub-layer in every transformer block.
FlashcardEasy
When is gradient accumulation NOT equivalent to a real larger batch?
Multiple ChoiceMedium

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Cursor Observe Ai

Goldman Sachs NVIDIA

Cognizant Deepseek