Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Stratified Sampling
Stratified Sampling
Subtopic
4 questions
Questions tagged with Stratified Sampling — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Running LLM-as-judge on your full eval set costs $200 per run. The team runs evals 10 times a day during development. How do you cut cost without losing signal?
Multiple Choice
Medium
·
Qual 4.0
Design a slice-level eval strategy for an LLM system where mean score is insufficient
Short Answer
Hard
·
Qual 4.0
Spot the flaw in this eval set construction approach
Spot the Error
Hard
·
Qual 4.0
What is the primary pitfall of building your eval set exclusively from production traffic logs?
Multiple Choice
Medium
·
Qual 4.0