vllm.ai
vllm.ai is Novita AI has open-sourced Chord, a high-performance W4A16 MoE CUDA kernel for Kimi K2.x serving shapes, with a Humming-compatible indexed path and grouped SM90. It is ranked #506 on the AI Radar, in AI infra & evals, first seen 23 days ago and shared in 22 posts (349k views).
vLLM x Novita AI: Chord, Faster INT4 MoE for Kimi K2.x. Up to 1.3x on H200, 2.15x on Untuned B300 | vLLM Blog Menu Theme vLLM x Novita AI: Chord, Faster INT4 MoE for Kimi K2.x. Up to 1.3x on H200, 2.15x on Untuned B300 September 15, 2026 14 min read Novita AI and the vLLM Team # performance # quantization # moe # hardware Table of Contents TL;DR Novita AI has open-sourced Chord , a high-performance W4A16 MoE CUDA operator for BF16 activations, INT4 weights and group-32 scales. Built for Kimi K2.x serving shapes, its indexed path exposes the Humming-compatible humming import root, selected with --quantization humming on compatible vLLM…
What people said about vllm.ai on X
😱逆天！开源直接打平官方！vLLM 用 DEP32 把 DeepSeek 自研引擎 DeepInfer 按在地上摩擦！DeepSeek-V4.1-Flash-1017 解码配置彻底炸裂！ 在官方同款解码配置下，131K 上下文，vLLM 吞吐与 DeepInfer 几乎打平（batch 8-256 差距 ≤6%），而且是用更轻的 DEP32 硬刚对方的 EP64DP64。 GB300 NVL72 整机 + P/D + Wide-EP 实测直接拉到 954K tokens/s per GPU（P90 196 tok/s/user），比之前单节点暴涨 7.9×；单用户专用解码路径更是冲到 826 tok/s。 核心亮点 🔹CED…
— @NFT_Chen, 12 days ago · 124 likes · see the post
梁文峰神的存在！DeepSeek开源推理架构曾让市场误判“GPU需求要崩”，结果Gavin Baker直接打脸： 开源模型DeepSeek正以38美元/GPU小时变现，市场租金普遍只有2-8刀，利用率高到离谱。 这直接解释了Blackwell价格连涨17天的真相。 黄仁勋当场点头：“需求是唯一无法被解决的问题，有需求一切都能解决。” 开源不是杀死算力，而是让每张GPU更值钱、更刚需。 Neocloud融资焦虑？需求来了，钱自然跟上。 #DeepSeek #NVIDIA #GPU #Blackwell #AI算力 #黄仁勋 #Jevons悖论 #算力革命 #梁文峰 #梁圣…
— @NFT_Chen, 11 days ago · 76 likes · see the post
Alternatives to vllm.ai
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
vllm.ai in numbers
- Rank on the AI Radar: #506 of 10410
- Shared in 22 posts by 12 accounts: @vllm_project, @NFT_Chen, @KakaluoteW45042
- 349k views on those posts
- First seen 23 days ago, last shared 11 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is vllm.ai?
Novita AI has open-sourced Chord, a high-performance W4A16 MoE CUDA kernel for Kimi K2.x serving shapes, with a Humming-compatible indexed path and grouped SM90 It was first shared on X 23 days ago and is ranked #506 on the AI Radar.
Is vllm.ai free?
It is open source.
Who shared vllm.ai?
12 accounts on X, including @vllm_project, @NFT_Chen, @KakaluoteW45042, in 22 posts totalling 349k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.6k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:05 UTC. Full method.