Agent frameworks & orchestration
SWE-CoWork: Benchmarking Coding Agents as Digital Employees in Organizations
SWE-CoWork evaluates whether coding agents can gather organizational requirements and deliver tested changes, not merely implement partial fixes.
Why it matters: For agent builders and evaluators, the results suggest that measuring code changes alone can miss failures in requirement tracking, verification and handoff. The authors identify sustained tracking across that whole delivery process as a challenge for reliable autonomous software engineering.