Infrastructure & deployment
Cross-request KV cache exposure in the GLM-5.3 Workers AI model, and our remediation with SGLang
A SGLang rejection-path bug let some oversized GLM-5.3 requests return data retained in other customers’ KV cache pages.
Why it matters: For agent-serving systems, the incident shows that disaggregated inference needs explicit KV-pool/context checks and safe rejection handling: successful HTTP responses alone did not establish coherent output. Cloudflare recommends upgrading SGLang and enabling applicable corruption detection, while noting that checksum and canary support does not yet cover every model architecture.