底子好大于一切!DeepSeek V4.1 Flash 一个月推理速度被提升了1.4 倍速度!
This is a AI post classified by AGK Intelligence as AI infra & evals (a model release), kept by the AI Radar because it carries real work, not commentary.
底子好大于一切!DeepSeek V4.1 Flash 一个月推理速度被提升了1.4 倍速度! 不是模型变强了,是推理栈被抠到极致。 单代理从 596 → 848 tok/s。 全靠 vLLM 新内核、投机解码、CUDA Graph 这些“看不见的优化”。 很多人盯着模型参数,真正拉开差距的,往往是谁把推理工程做到极致。 软件才是最大的算力放大器。 #DeepSeek #AI推理 #推理优化 #vLLM #大胖鱼 #梁文峰 #梁圣
Posted by SuSu_酥酥👅 (27.1k followers) 16 h ago · 43 likes · 7.3k views · view the original post on X. Kept by the AI Radar as AI infra & evals.
More AI work like this
- The enterprise AI bottleneck has moved from models and GPUs to the data path. — @Dell
- AMD Localmaxxers are getting serious about inferencing. 🤯 — @TeksEdge
- We evaluated Nexus on 7 benchmarks and 1,222 tasks. It defines the Pareto frontier. — @FireworksAI_HQ
- There is a 560B model running with its full 1M context on 2x DGX Sparks by @andersjw_. — @plotarmordev
- 免费GPT的API,手快有手慢无 — @mylifcc
- TensorFold 1.2.4 is out. 🚀 — @ashxhart
- AWS is making it easier to run several smaller models on the same GPU. — @markfenner
- The @nvidia Jetson Orin Nano is back in the lab. — @jmurillocode
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.2k posts from 5k X accounts over the last 14 days, 10.6k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-07 16:45 UTC. Full method.