vllm
vllm is Prerequisite PRs A few PRs that can go in on their own merits were split out: [Bugfix] DiffusionGemma: hand out stashed logprobs only on the committing step #57414: hand out stashed logprobs only .... It is ranked #100 on the AI Radar, in AI infra & evals, first seen 54 days ago and shared in 15 posts (1.2M views).
[Core] structured generation mode for DiffusionGemma model (Jev-like) by mmastrac · Pull Request #57250 · vllm-project/vllm · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation [Core] structured generation mode for DiffusionGemma model (Jev-like) - # 57250 # 57250 Merged LucasWilkinson merged 26 commits into vllm-project:main…
What people said about vllm on X
vLLM v0.33.0 is out! 🚀 927 commits · 389 contributors · 122 first-timers 🤖 New models: Reflection Beam-1.0, Step-5 Preview, Nemotron Parse 3.5, MiniCPM-OCR 1.0 🔥 PyTorch 2.14 — CUDA 13.0-only wheels, libtorch ABI-stable 🎲 Spec decoding: XPress refiner, FLy lossy verify (1.04–1.31x), DSpark 1373→3390 tok/s on…
— @vllm_project, 2 days ago · 286 likes · see the post
inclusionAI's Ling 3.2 Flash is out 🚀 It's live on inclusionAI's API platform: 560B total and 25B active parameters, a 1M-token context window, and native image, text and video input. The weights aren't on Hugging Face yet.
— @aitrackerbot, 21 h ago · 44 likes · see the post
vLLM v0.33 just dropped and it's a big one 🚀 927 commits, 122 first-time contributors. New spec decoding tricks, MiniCPM-OCR, and PyTorch 2.14. The wheels are CUDA 13 only now, so check your driver before you upgrade the 3090 box... I need to update one of mine.
— @loktar00, 2 days ago · 30 likes · see the post
Alternatives to vllm
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
vllm in numbers
- Rank on the AI Radar: #100 of 10392
- Shared in 15 posts by 12 accounts: @vllm_project, @aitrackerbot, @loktar00, @leo114119
- 1.2M views on those posts
- First seen 54 days ago, last shared 19 h ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is vllm?
Prerequisite PRs A few PRs that can go in on their own merits were split out: [Bugfix] DiffusionGemma: hand out stashed logprobs only on the committing step #57414: hand out stashed logprobs only ... It was first shared on X 54 days ago and is ranked #100 on the AI Radar.
Is vllm free?
It is open source.
Who shared vllm?
12 accounts on X, including @vllm_project, @aitrackerbot, @loktar00, in 15 posts totalling 1.2M views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.7k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 13:40 UTC. Full method.