Agent frameworks & orchestration
Agents are users, so your software needs evals
Vercel lays out a repeatable process for testing whether agents complete user tasks correctly, not merely whether their tools run.
Why it matters: Builders can use repeated trials and trace inspection to distinguish an agent’s capability from its reliability, and identify whether failures stem from the agent, product interface, or evaluation itself. Vercel’s examples also show why the right metric depends on the cost of failure: retry-friendly tasks differ from actions where a user may pay for a wrong result.