Infrastructure & deployment
Introducing the Agents API
OpenAI introduces a public beta API for building and running cloud agents with its managed harness.
Why it matters: The release provides a managed interface for long-running agent workflows.
Loading the edition…
· Past edition · 8 stories
Retrospective edition reconstructed from later captures. Paper versions may include later updates; coverage labels describe the evidence used.
Infrastructure & deployment
OpenAI introduces a public beta API for building and running cloud agents with its managed harness.
Why it matters: The release provides a managed interface for long-running agent workflows.
Infrastructure & deployment
Open each story in the reader. Summaries are shown when available; some sources provide an abstract only. With an account you can keep your own notes.
For Nemotron 3 Ultra on 4xB200, NVIDIA reports that its NIM 2.0.12 serving stack delivered 2.5x the baseline throughput at 50 TPS per user.
Why it matters: The result is a workload-specific starting point, not a guarantee for every application. Replay representative traffic, then choose a throughput point on the Pareto curve that meets the latency metric or SLO that matters to your users.
Infrastructure & deployment
The follow-up’s main contribution is a method for finding the next bottleneck as it moves—from local kernels and repeated work to data movement, dispatch, and system queues.
Why it matters: The practical lesson is to measure the shape and workload that actually run, verify that a fast path is eligible and executed, and re-profile after each improvement. Once kernels flatten, queues, cache capacity, or system limits may be the next constraint.