Live › technique › TECH-202610-sglang-prefill-decode-disaggregation-can-leak-other-users-pr
Go to dashboardIn SGLang's disaggregated prefill/decode mode, a request too long for the prefill KV cache pool is marked rejected and swapped for a one-token placeholder, but it is not aborted. Prefill still sends KV for the placeholder, and decode treats the transfer as complete. Decode then generates over stale KV pages that still hold earlier requests' data, so the response can contain other users' content. Cloudflare disclosed it with SGLang on 2026-10-26: from 2026-08-27 to 2026-09-09, 155 Workers AI GLM-5.3 responses carried other customers' data. Those deployments served a 1,048,576-token context with a 681,280-token prefill pool. The bug was reported by Gadi Evron (Knostic). Anyone self-hosting multi-tenant SGLang with PD disaggregation is at risk if the advertised context length is larger than the prefill KV pool, or if the scheduler can reject requests some other way. Cloudflare saw no deliberate exploitation. No CVE known yet. Cloudflare has already fixed Workers AI.
Summary written from the sources below. Check the originals before acting.
First seen by InfraStack 2026-10-26 22:47 UTC. All times on this page are UTC.
| Product | Ecosystem | Affected | Fixed in |
|---|---|---|---|
| sglang | pypi | unknown (builds without PRs #36988/#38935, prefill/decode disaggregation mode) | – |
Each row is the first time that source carried this signal. The analyst’s rows are its own findings.
This page as .md · .json · in your agent: get_signal("TECH-202610-sglang-prefill-decode-disaggregation-can-leak-other-users-pr")