Agent Eng News

Wednesday, September 30, 2026 · Past edition · 6 stories

Retrospective edition reconstructed from later captures. Paper versions may include later updates; coverage labels describe the evidence used.

Browse published editions

Filter by topic · Agent frameworks & orchestration

Agent frameworks & orchestration
Agent frameworks & orchestration
OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software
OSWorld-Science tests whether visual language model agents can complete scientific workflows in software—and whether their results can be checked through application states and generated artifacts.
Why it matters: The benchmark evaluates more than interface actions: it connects expert-defined scientific tasks to verifiable software outcomes, making both agent capability and harness design available for systematic comparison.
Original · arxiv (new tab)Read
Agent frameworks & orchestration
Claude’s new auto eval tool

Keep notes on the stories you read

Open each story in the reader. Summaries are shown when available; some sources provide an abstract only. With an account you can keep your own notes.

Personal notes on the sources you read, tied to your account
A Library to come back to, with export to Markdown, Notion or Obsidian
AI questions and rewrites on accounts with AI tools enabled

How Reading + AI works

Agent Eng News

Agent frameworks & orchestration

OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software

Claude’s new auto eval tool

Keep notes on the stories you read