Research & academia
Noise Floor Audit for Agent Benchmarks
Agent benchmark scores have a measurement noise floor.
Why it matters: Small leaderboard differences can be swamped by measurement variability.
Agent Eng News
· Past edition · 4 stories
Retrospective edition reconstructed from later captures. Paper versions may include later updates; coverage labels describe the evidence used.
Browse published editions
Filter by topic · Research & academia
Lead stories
Research & academia
Research & academia
ToolRobustBench: Stage-Wise Perturbation Evaluation and Failure Diagnosis for Tool-Calling Agents
A benchmark tests where tool-use robustness breaks down.
Keep notes on the stories you read
Open each story in the reader. Summaries are shown when available; some sources provide an abstract only. With an account you can keep your own notes.
- Personal notes on the sources you read, tied to your account
- A Library to come back to, with export to Markdown, Notion or Obsidian
- AI questions and rewrites on accounts with AI tools enabled