Agent frameworks & orchestration
Doc2Harness: Benchmarking LLMs on Long-Horizon Harness Engineering of Coding Agents
Doc2Harness shifts evaluation from solving tasks under a fixed harness to engineering the harness itself, then tests the result with deterministic, observable checks.
Why it matters: The benchmark makes harness engineering measurable rather than treating the harness as fixed. Its results show both substantial room for improvement and a recurring failure area: how cross-cutting functionality is divided across modules.