Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Mixture of Experts
/
Auxiliary Loss
Auxiliary Loss
Subtopic
4 questions
Questions tagged with Auxiliary Loss — part of Mixture of Experts.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Spot the overclaim about auxiliary load balancing in this MoE training note.
Spot the Error
Medium
·
Qual 4.0
Google
In L_aux = α·N·Σ f_i·p_i, which term receives gradients from the balancing loss?
Multiple Choice
Medium
·
Qual 4.0
Google
Complete the Switch Transformer auxiliary load-balancing loss formula.
Fill in Blank
Hard
·
Qual 4.0
Google
What breaks when the auxiliary loss coefficient α is set too high versus too low?
Short Answer
Hard
·
Qual 4.0
Google
Mistral AI