Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Distribution Shift
Distribution Shift
Subtopic
5 questions
Questions tagged with Distribution Shift — part of LLM Evaluation.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Offline eval scores 0.9 but users report frequent wrong answers: why the gap, and what do you do?
Short Answer
Hard
Premium
Compare offline and online…
Short Answer
Medium
Premium
Spot the flaw in…
Spot the Error
Hard
What is the primary pitfall of building your eval set exclusively from production traffic logs?
Multiple Choice
Medium
Which proxy signals are valid indicators of potential quality drift in a production LLM system?
Multi-select
Medium
Baidu
Doordash
OpenAI
Zepto
Deepseek
Induced Ai
Descript
Harvey
Cerebras
Cursor