Agent frameworks & orchestration
Harness or Model? Isolating the Harness Effect in Agentic Coding with a Contamination-Controlled Private Suite
The vendor-native harness is not a guaranteed winner: paired tests found no resolved average advantage, while Opus subgroup results went in opposite directions.
Why it matters: Do not assume a vendor-native pairing will solve more tasks on average; task strata may reverse the observed direction, and missing usage records prevent a firm billed-cost ranking.