Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Agent Eval
Agent Eval
Subtopic
5 questions
Questions tagged with Agent Eval — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Design a diagnostic eval for an agentic workflow with 62% task success across 5 tools and 10+ steps that reveals WHY tasks fail, not just whether they pass.
Short Answer
Hard
·
Qual 4.0
Flashcard: what is an agent 'trajectory' and why does it matter for evaluation?
Flashcard
Easy
·
Qual 4.0
What structural property of SWE-bench makes it a harder eval than HumanEval for code agents?
Multiple Choice
Medium
·
Qual 4.0
Why is final-task success rate insufficient for evaluating LLM agents, and what does trajectory eval add?
Short Answer
Hard
·
Qual 4.0
What does trajectory evaluation add beyond task success rate for LLM agent evaluation?
Multiple Choice
Medium
·
Qual 4.0