Agent frameworks & orchestration
How to Evaluate AI Agents From Tool Calls to Task Completion
A valid tool call is not a completed task: agent evaluation must check both the steps in a trace and the environment’s final state.
Why it matters: A model can reach the right outcome despite redundant calls, or make accurate calls while failing the task. Separate outcome and process scores show what users experience and where to debug, tune, or reduce wasted steps and cost.