CVE-2026-54234: CWE-20: Improper Input Validation in vllm-project vllm
vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. Prior to 0.24.0, a frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a recovered token equal to the model vocabulary size boundary value, which is then converted to negative one when the engine selects the next live token for a request and is written back into the drafter's input ids; that out-of-vocabulary value is later consumed by the model's embedding and attention path and crashes the engine worker with a GPU device-side assertion. The same triggering request sequence is reachable through the public gRPC Generate and Abort endpoints, so a remote client that can send generation requests can crash the shared engine worker, aborting concurrent requests and causing a service-wide denial of service for other clients of the deployment until the worker is restarted. This issue is fixed in version 0.24.0.
AI Analysis
Technical Summary
CVE-2026-54234 describes an improper input validation vulnerability in vLLM before version 0.24.0. A crafted multi-request speculative decoding workload can cause the rejection sampler to produce a token equal to the vocabulary size boundary, which is then converted to -1 and written back into the drafter's input IDs. This out-of-vocabulary token is consumed by the model's embedding and attention mechanisms, triggering a GPU device-side assertion failure that crashes the engine worker. Because the triggering request sequence is accessible through public gRPC endpoints, a remote attacker can cause a denial of service by crashing the shared engine worker, aborting concurrent requests until the worker is restarted. The vulnerability is resolved in vLLM 0.24.0.
Potential Impact
The vulnerability allows a remote unauthenticated attacker to cause a denial of service by crashing the engine worker process. This results in service interruption for all clients using the affected vLLM deployment until the worker is manually or automatically restarted. There is no impact on confidentiality or integrity reported.
Mitigation Recommendations
Upgrade vLLM to version 0.24.0 or later, where this vulnerability is fixed. No other mitigation or workaround is documented. Until upgrading, restrict access to the gRPC Generate and Abort endpoints to trusted clients only to reduce exposure.
CVE-2026-54234: CWE-20: Improper Input Validation in vllm-project vllm
Description
vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. Prior to 0.24.0, a frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a recovered token equal to the model vocabulary size boundary value, which is then converted to negative one when the engine selects the next live token for a request and is written back into the drafter's input ids; that out-of-vocabulary value is later consumed by the model's embedding and attention path and crashes the engine worker with a GPU device-side assertion. The same triggering request sequence is reachable through the public gRPC Generate and Abort endpoints, so a remote client that can send generation requests can crash the shared engine worker, aborting concurrent requests and causing a service-wide denial of service for other clients of the deployment until the worker is restarted. This issue is fixed in version 0.24.0.
CVSS v3.1
Score 7.5high
Affected software
Run on your own infrastructure? Check whether these packages are installed with threat-finder — our free open-source scanner.
AI-Powered Analysis
Machine-generated threat intelligence
Technical Analysis
CVE-2026-54234 describes an improper input validation vulnerability in vLLM before version 0.24.0. A crafted multi-request speculative decoding workload can cause the rejection sampler to produce a token equal to the vocabulary size boundary, which is then converted to -1 and written back into the drafter's input IDs. This out-of-vocabulary token is consumed by the model's embedding and attention mechanisms, triggering a GPU device-side assertion failure that crashes the engine worker. Because the triggering request sequence is accessible through public gRPC endpoints, a remote attacker can cause a denial of service by crashing the shared engine worker, aborting concurrent requests until the worker is restarted. The vulnerability is resolved in vLLM 0.24.0.
Potential Impact
The vulnerability allows a remote unauthenticated attacker to cause a denial of service by crashing the engine worker process. This results in service interruption for all clients using the affected vLLM deployment until the worker is manually or automatically restarted. There is no impact on confidentiality or integrity reported.
Mitigation Recommendations
Upgrade vLLM to version 0.24.0 or later, where this vulnerability is fixed. No other mitigation or workaround is documented. Until upgrading, restrict access to the gRPC Generate and Abort endpoints to trusted clients only to reduce exposure.
Technical Details
- Data Version
- 5.2
- Assigner Short Name
- GitHub_M
- Date Reserved
- 2026-06-12T16:25:43.084Z
- Cvss Version
- 3.1
- State
- PUBLISHED
- Remediation Level
- null
Threat ID: 6a4c11fc27e9c797192ee536
Added to database: 07/06/2026, 20:37:16 UTC
Last enriched: 07/06/2026, 20:52:17 UTC
Last updated: 07/06/2026, 23:05:21 UTC
Views: 4
Community Reviews
0 reviewsCrowdsource mitigation strategies, share intel context, and vote on the most helpful responses. Sign in to add your voice and help keep defenders ahead.
Want to contribute mitigation steps or threat intel context? Sign in or create an account to join the community discussion.
Actions
Updates to AI analysis require Pro Console access. Upgrade inside Console → Billing.
Need more coverage?
Upgrade to Pro Console for AI refresh and higher limits.
For incident response and remediation, OffSeq services can help resolve threats faster.
Latest Threats
Check if your credentials are on the dark web
Instant breach scanning across billions of leaked records. Free tier available.