We got @DeepSeek-V4.1-Flash running in EXL3 on 4× Sparks!
This is a AI post classified by Jev as AI infra & evals (a tool drop), kept by the AI Radar because it carries real work, not commentary.
We got @DeepSeek-V4.1-Flash running in EXL3 on 4× Sparks! I was happy to colab with Cruz (@ViC305) and get his vllm-exl3 and his DeepSeek-V4.1 recipe working on TP=4! Single-stream decode: 30.2 tok/s prose, 33.4 tok/s on code, with a best warm 33.37 tok/s Aggregate: 27.8 / 43.9 / 57.7 / 61.5 tok/s at c=1/2/4/8. As you can see, there is opportunity for growth here, but it is going to take a week or so of addressing some drafter issues that might not get me much, so I am switching gears to another project for now, but might come back to this later. KV budget: 3.97m tokens Context: full 1m
Posted by Chris Fontes (201 followers) 1 h ago · 4 likes · 10.1k views · view the original post on X. Kept by the AI Radar as AI infra & evals. Tools mentioned: deepseek-v4.1-flash-exl3-dgx-spark-recipe.
More AI work like this
- We want to sponsor Rust maintainers and open-source projects across web development,… — @encoredotdev
- Spent a bit of time tuning NCCL for TP=4 GLM 5.3 Flash on 4x DGX Sparks. Bumped to… — @mmastrac
- GLM 5.3 Flash EXL3 on 2x DGX Spark: a new cache update is merged! — @plotarmordev
- It has been a really interesting experience to build an eval suite for System One Models… — @morganlinton
- Qualcomm announces it most powerful Snapdragon 8 Elite Extreme Gen 6 chip built for… — @CNET
- The https://MLX.fast community has finally doubled the speed of Qwen 3.8 Flash Next to… — @TheDavidTai
- Have you ever had a local coding agent flying at the start of a session and crawling an… — @jvr0x
- 🚀 MCDMA is working between my Mac Studio & DGX Sparks, and now it's time to bring it to… — @ashxhart
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 44.4k posts from 5k X accounts over the last 14 days, 1.8k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-23 14:57 UTC. Full method.