susun's blog
susun's blog is I also found @SuJinYan123's walkthrough really useful while trying to piece it together. It is ranked #6536 on the AI Radar, in AI infra & evals, first seen 11 days ago and shared in 1 post (2 views).
What susun's blog says about itself
DeepInfer 推理架构笔记：EPD 分离、池化存储、KV Cache 换入、EPLB、DPLB 与 DSpark。
deepinfer talk | susun's blog deepinfer talk Oct 24, 2026 整体架构：EPD 分离 首先呢是 epd 分离，也就是 encoder,prefill,decode，其中 prefill 和 decode都有一个池化的存储，系统里还有单独的专用存储节点。 prefill采用尽可能小的并行组（EP only)：因为 prefill 是 compute bound，只要能充分利用好硬件自身的计算资源，EP4 -> EP8 不改善总体吞吐。 decode 追求wideep：因为大概率 decode 是 memory bound，EP 可以通过通信换带宽改善整体效率，包括留下更多 GPU 空间撑起更大的 batch size，冗余更多专家等。他自己也给了一个图。 Encoder: 单卡，便宜 GPU 即可 暂时不使用 TP 与 CP, 不用 TP 的点在于说，TP通过交换一些峰值吞吐改善延迟。在延迟不是一个巨大的问题的时候，尽可能不开 TP。 但这里它没有聊Prefill PP，因为理论上 Prefill PP 也不改变峰值吞吐（有一点轻微的流水线问题），不过 v4.1 跨层共用 kv cache 的结构其实对 pp 不太友好。 当然我有一个想法是，prefill 到底是 pp 还是 ep，当然现在模型训成 每一个 Layer 都不一样的，那天生也就对 pp 不友好，那也没招。但是 ep 要完整做完 ds 这一套，需要不少流量和…
What people said about susun's blog on X
I haven't gone very deep into inference sys yet. Most of what I've been working around has been llm models, agents, and a bit on the application side of ai. But something about @deepseek_ai 's deepinfer caught my attention, so I started digging into how they actually approach inference at scale. And the more I…
— @pranavenv, 11 days ago · 0 likes · see the post
Alternatives to susun's blog
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
susun's blog in numbers
- Rank on the AI Radar: #6536 of 10410
- Shared in 1 post by 1 account: @pranavenv
- 2 views on those posts
- First seen 11 days ago, last shared 11 days ago
- Pricing seen by AGK Intelligence: free
- Market: AI infra & evals
FAQ
What is susun's blog?
I also found @SuJinYan123's walkthrough really useful while trying to piece it together It was first shared on X 11 days ago and is ranked #6536 on the AI Radar.
Is susun's blog free?
Yes, it is free to use.
Who shared susun's blog?
1 account on X, including @pranavenv, in 1 post totalling 2 views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.6k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:05 UTC. Full method.