Infrastructure & deployment
From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systems
A serving study characterizes the resources used by agent workloads.
Why it matters: Serving an agent requires planning for tools and state as well as model inference.