Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Regularization

Regularization

Subtopic5 questions

Questions tagged with Regularization — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

What makes AdamW more reliable than naive L2 coupling at scale?
FlashcardMedium
In LoRA, where in the forward pass does `lora_dropout` apply its mask?
Multiple ChoiceEasy
PremiumTrain loss drops while…
Short AnswerMedium
Where inside the attention sub-layer is dropout typically applied during training, and what does dropping there teach the model?
Short AnswerMedium
Injecting noise into pre-softmax attention scores, goal and risk?
Multiple ChoiceMedium

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Coinbase NVIDIA

Doordash Elastic

Databricks Induced Ai

Roblox Robust Intelligence