Details
and the encode-docs pass reads those stored keys instead of re-deriving them from ctx.request_id:
- query_keys = [f"{ctx.request_id}-query-{i}" for i in range(n_queries)]
+ query_keys = ctx.late_interaction_query_keys
+ if query_keys is None:
+ raise RuntimeError("Late-interaction query keys were not initialized.")
This requires adding the late_interaction_query_keys: list[str] | None = None field to PoolingServeContext (vllm/entrypoints/pooling/typing.py). Because the namespace is a server-generated UUID, colliding X-Request-Id values no longer produce a shared cache key; a regression test asserting exactly that (colliding request ids yield distinct query-cache keys) accompanies the change.
Credit
Reported by: Patch the Planet (Trail of Bits + OpenAI collaboration)
This vulnerability was discovered using GPT-5.5-Cyber as part of the Patch the Planet security initiative.
---
Proposed fix: a fix for this issue is proposed in a public pull request: https://github.com/vllm-project/vllm/pull/51445