Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Regression Ci
Regression Ci
Subtopic
8 questions
Questions tagged with Regression Ci — part of LLM Evaluation.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Design a regression CI gate for prompt template changes that prevents bad prompts from reaching production.
Short Answer
Hard
How do you determine if a 2% eval score drop between model versions is statistically significant?
Short Answer
Hard
Which test is most appropriate for determining if a binary metric LLM eval drop is statistically significant?
Multiple Choice
Medium
How do you integrate LLM eval into a CI/CD pipeline so regressions block merges?
Short Answer
Hard
Order the steps of an LLM CI/CD eval gate from trigger to decision
Order Steps
Medium
Order the stages of a production LLM quality assurance pipeline from development to release
Order Steps
Medium
Compare Promptfoo, DeepEval, and LangSmith as LLM eval frameworks: when to use each?
Short Answer
Hard
Match each LLM eval framework to its primary differentiating capability
Match Pairs
Medium
Hcl
Meta
Graphcore
OpenAI
Bain
Cursor
OpenAI
Pwc
Intuit
OpenAI
Fireworks Ai
Jump Trading
C3 Ai
Character Ai
Browserbase
Ltimindtree