Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Regression Ci
Regression Ci
Subtopic
8 questions
Questions tagged with Regression Ci — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Design a regression-CI gate for prompt-template changes that prevents bad prompts from reaching production.
Short Answer
Hard
·
Qual 4.0
How do you determine if a 2% eval score drop between model versions is statistically significant?
Short Answer
Hard
·
Qual 4.0
Which test is most appropriate for determining if a binary-metric LLM eval drop is statistically significant?
Multiple Choice
Medium
·
Qual 4.0
How do you integrate LLM eval into a CI/CD pipeline so regressions block merges?
Short Answer
Hard
·
Qual 4.0
Order the steps of an LLM CI/CD eval gate from trigger to decision
Order Steps
Medium
·
Qual 4.0
Order the stages of a production LLM quality assurance pipeline from development to release
Order Steps
Medium
·
Qual 4.0
Compare Promptfoo, DeepEval, and LangSmith as LLM eval frameworks: when to use each?
Short Answer
Hard
·
Qual 4.0
Match each LLM eval framework to its primary differentiating capability
Match Pairs
Medium
·
Qual 4.0