Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Ab Testing
Ab Testing
Subtopic
3 questions
Questions tagged with Ab Testing — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
The PM asks how to tell if the chatbot got better after the last deploy. Walk through setting up an A/B test.
Short Answer
Medium
·
Qual 4.0
What is the key property that distinguishes shadow deployment from a standard A/B test for LLMs?
Multiple Choice
Medium
·
Qual 4.0
What is shadow deployment for LLMs and how does it enable safe evaluation?
Flashcard
Easy
·
Qual 4.0