Topics PracticeChallenges Pricing

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Daily practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/RLHF & Alignment

RLHF & Alignment

8 questions

Teaching models to follow human preferences. Reward modeling, PPO, DPO, KTO, constitutional AI, preference data, the alignment tax.

Sort

Questions

RLOO's name hides its baseline trick: what does 'Leave-One-Out' literally compute?
Multiple ChoiceMedium·Qual 4.0
Why has GRPO eaten PPO's lunch in 2025-2026 reasoning post-training?
Short AnswerMedium·Qual 4.0
Reward model in RLHF: what does it score, and on what data does it train?
Multiple ChoiceEasy·Qual 4.0
Where do SFT and DPO sit in the classical RLHF pipeline?
Short AnswerMedium·Qual 4.0
DPO: what's the closed-form trick that lets it skip the reward model?
Short AnswerHard·Qual 4.0
DPO vs RLHF: pick the most accurate operational difference
Multiple ChoiceMedium·Qual 4.0
PPO vs DPO, what's the practical difference?
FlashcardMedium·Qual 4.6AnthropicOpenAI
What is RLHF, and why is it used after pretraining?
Multiple ChoiceEasy·Qual 4.7AnthropicOpenAI

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.