Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
AI Agents
/
Agent Evaluation
Agent Evaluation
Subtopic
6 questions
Questions tagged with Agent Evaluation — part of AI Agents.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
How should you score a multi-step agent where final answer accuracy is 15% but most steps are correct?
Multiple Choice
Medium
·
Qual 4.0
Databricks
What structural property of SWE-bench makes it a harder eval than HumanEval for code agents?
Multiple Choice
Medium
·
Qual 4.0
What does SWE-bench measure that AgentBench does not, and why are both needed?
Short Answer
Hard
·
Qual 4.0
Cursor
Match each agent benchmark to what it primarily measures
Match Pairs
Medium
·
Qual 4.0
Cursor
Why is scoring only the final answer a weak way to evaluate agents?
Short Answer
Hard
·
Qual 4.0
Databricks
What does trajectory evaluation measure that final answer accuracy alone cannot capture?
Multiple Choice
Medium
·
Qual 4.0
Databricks