CVE-2026-54234: CWE-20: Improper Input Validation in vllm-project vllm
vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. Prior to 0.24.0, a frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a recovered token equal to the model vocabulary size boundary value, which is then converted to negative one when the engine selects the next live token for a request and is written back into the drafter's input ids; that out-of-vocabulary value is later consumed by the model's embedding and attention path and crashes the engine worker with a GPU device-side assertion. The same triggering request sequence is reachable through the public gRPC Generate and Abort endpoints, so a remote client that can send generation requests can crash the shared engine worker, aborting concurrent requests and causing a service-wide denial of service for other clients of the deployment until the worker is restarted. This issue is fixed in version 0.24.0.
AI Analysis
Technical Summary
CVE-2026-54234 describes an improper input validation vulnerability in vLLM before version 0.24.0. A frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a token equal to the vocabulary size boundary, which is converted to -1 and written back into the drafter's input IDs. This out-of-vocabulary token is then processed by the model's embedding and attention mechanisms, causing a GPU device-side assertion failure that crashes the engine worker. Because the triggering request sequence is accessible via the public gRPC Generate and Abort endpoints, a remote unauthenticated attacker can cause a denial of service by crashing the shared engine worker, disrupting all concurrent requests until the worker is restarted. The vulnerability is resolved in vLLM version 0.24.0.
Potential Impact
Exploitation of this vulnerability results in a denial of service condition affecting the vLLM inference engine. A remote attacker can crash the engine worker by sending crafted generation requests, causing service-wide disruption until the worker is manually restarted. There is no impact on confidentiality or integrity, but availability is severely affected.
Mitigation Recommendations
Upgrade vLLM to version 0.24.0 or later, where this vulnerability is fixed. There is no official patch or temporary fix other than upgrading. Until upgraded, restrict access to the public gRPC Generate and Abort endpoints to trusted clients to reduce exposure.
CVE-2026-54234: CWE-20: Improper Input Validation in vllm-project vllm
Description
vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. Prior to 0.24.0, a frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a recovered token equal to the model vocabulary size boundary value, which is then converted to negative one when the engine selects the next live token for a request and is written back into the drafter's input ids; that out-of-vocabulary value is later consumed by the model's embedding and attention path and crashes the engine worker with a GPU device-side assertion. The same triggering request sequence is reachable through the public gRPC Generate and Abort endpoints, so a remote client that can send generation requests can crash the shared engine worker, aborting concurrent requests and causing a service-wide denial of service for other clients of the deployment until the worker is restarted. This issue is fixed in version 0.24.0.
CVSS v3.1
Score 7.5high
Affected software
Run on your own infrastructure? Check whether these packages are installed with threat-finder — our free open-source scanner.
AI-Powered Analysis
Machine-generated threat intelligence
Technical Analysis
CVE-2026-54234 describes an improper input validation vulnerability in vLLM before version 0.24.0. A frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a token equal to the vocabulary size boundary, which is converted to -1 and written back into the drafter's input IDs. This out-of-vocabulary token is then processed by the model's embedding and attention mechanisms, causing a GPU device-side assertion failure that crashes the engine worker. Because the triggering request sequence is accessible via the public gRPC Generate and Abort endpoints, a remote unauthenticated attacker can cause a denial of service by crashing the shared engine worker, disrupting all concurrent requests until the worker is restarted. The vulnerability is resolved in vLLM version 0.24.0.
Potential Impact
Exploitation of this vulnerability results in a denial of service condition affecting the vLLM inference engine. A remote attacker can crash the engine worker by sending crafted generation requests, causing service-wide disruption until the worker is manually restarted. There is no impact on confidentiality or integrity, but availability is severely affected.
Mitigation Recommendations
Upgrade vLLM to version 0.24.0 or later, where this vulnerability is fixed. There is no official patch or temporary fix other than upgrading. Until upgraded, restrict access to the public gRPC Generate and Abort endpoints to trusted clients to reduce exposure.
Technical Details
- Data Version
- 5.2
- Assigner Short Name
- GitHub_M
- Date Reserved
- 2026-06-12T16:25:43.084Z
- Cvss Version
- 3.1
- State
- PUBLISHED
- Remediation Level
- null
Threat ID: 6a4c11fc27e9c797192ee536
Added to database: 07/06/2026, 20:37:16 UTC
Last enriched: 07/14/2026, 09:00:34 UTC
Last updated: 08/20/2026, 03:35:32 UTC
Views: 76
Community Reviews
0 reviewsCrowdsource mitigation strategies, share intel context, and vote on the most helpful responses. Sign in to add your voice and help keep defenders ahead.
Want to contribute mitigation steps or threat intel context? Sign in or create an account to join the community discussion.
Actions
Updates to AI analysis require Pro Console access. Upgrade inside Console → Billing.
Need more coverage?
Upgrade to Pro Console for AI refresh and higher limits.
For incident response and remediation, OffSeq services can help resolve threats faster.
Latest Threats
Check if your credentials are on the dark web
Instant breach scanning across billions of leaked records. Free tier available.