Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Mixture of Experts
/
Auxiliary Loss
Auxiliary Loss
Subtopic
4 questions
Questions tagged with Auxiliary Loss — part of Mixture of Experts.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Premium
Spot the overclaim about…
Spot the Error
Medium
In L_aux = α·N·Σ f_i·p_i, which term receives gradients from the balancing loss?
Multiple Choice
Medium
Complete the Switch Transformer auxiliary load balancing loss formula.
Fill in Blank
Hard
What breaks when the auxiliary loss coefficient α is set too high versus too low?
Short Answer
Hard
Qdrant
Sap
Contextual Ai
Cred
N8n
Observe Ai
Descript
Kpmg