llm-d.ai
llm-d.ai is Day-0 distributed serving recipes for Moonshot AI's 2.8T-parameter Kimi K3.1 Pro at 1M context using llm-d across Ironwood TPU v7x (SGLang) and NVIDIA GB300 GPUs (vLLM), on Google Cloud.. It is ranked #215 on the AI Radar, in AI infra & evals, first seen 18 h ago and shared in 2 posts (5k views).
Serving Moonshot AI's Kimi K3.1 Pro with llm-d across TPUs and GPUs | llm-d Skip to main content 🎉 llm-d 1.0 is here! State-of-the-art inference, ready for production operations: multi-tenant quality of service, zero-downtime upgrades, and agent-aware serving on a stable v1 API. Read more → Serving Moonshot AI's Kimi K3.1 Pro with llm-d across TPUs and GPUs November 4, 2026 · 9 min read Keelin McDonell Product Manager, Google Ashok Chandrasekar Staff Software Engineer, Google Anish Shah Software Engineer, Google Joey Wang Software Engineer, Google Syeda Anjum Cloud Solution Architect, Google Gopala Suryanarayana Product Manager, Google…
What people said about llm-d.ai on X
Kimi K3.1 Pro on TPUs, with day-0 support ⚡ Run it on TPU v7x with vllm-torchtpu. Great to see the continued collaboration between the @Google and @inferact teams! 🤝 Read more 👇 https://llm-d.ai/blog/deploy-kimi-k3-1-pro-with-llm-d
— @vllm_project, 18 h ago · 72 likes · see the post
Great collaborating with @Google to bring day-0 Kimi K3.1 Pro support to @vllm_project on TPU v7x! ⚡🤝 Read more 👇 https://llm-d.ai/blog/deploy-kimi-k3-1-pro-with-llm-d
— @inferact, 18 h ago · 27 likes · see the post
Alternatives to llm-d.ai
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
llm-d.ai in numbers
- Rank on the AI Radar: #215 of 10412
- Shared in 2 posts by 2 accounts: @vllm_project, @inferact
- 5k views on those posts
- First seen 18 h ago, last shared 18 h ago
- Pricing seen by AGK Intelligence: not stated
- Market: AI infra & evals
FAQ
What is llm-d.ai?
Day-0 distributed serving recipes for Moonshot AI's 2.8T-parameter Kimi K3.1 Pro at 1M context using llm-d across Ironwood TPU v7x (SGLang) and NVIDIA GB300 GPUs (vLLM), on Google Cloud. It was first shared on X 18 h ago and is ranked #215 on the AI Radar.
Is llm-d.ai free?
Pricing is not stated on the page we read.
Who shared llm-d.ai?
2 accounts on X, including @vllm_project, @inferact, in 2 posts totalling 5k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.