We redesigned all our kv caching from scratch at @inference_net and now have the very…
This is a AI post classified by AGK Intelligence as AI infra & evals (a launch), kept by the AI Radar because it carries real work, not commentary.
We redesigned all our kv caching from scratch at @inference_net and now have the very best cache hit rates on Kimi K3.1 on @OpenRouter running circles around a dozen multi-billion dollar companies as a 6 person team is insanely fun
Posted by Sam Hogan 🇺🇸 (30.2k followers) 22 h ago · 15 likes · 775 views · view the original post on X. Kept by the AI Radar as AI infra & evals.
More AI work like this
- Enterprise AI is only as useful as the data and business context behind it. — @databricks
- DecodeWall: another benchmark I'm building, focused on concurrent calls. — @ivanfioravanti
- KindlingAI's GLM 5.3 Flash for one Spark recipe is here! 700k total KV on DGX OS (up to… — @mmastrac
- A small model coaching a giant? Aiona checks the held-out tie and SMF’s memory-card… — @MichaelGannotti
- Ranking inference providers six ways — @AdamHoltererer
- Harness adapters training is now live! — @yb2698
- NVIDIA is giving Kimi K3.1 Pro away for free. — @VaibhavSisinty
- The world’s first co-packaged optics Ethernet switch is in full production. — @NVIDIAAIInfra
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.6k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:05 UTC. Full method.