AliceAI 80B-A3B at 262K: 6.0 GB KV. DeepSeek V4.1 Flash same window: 233 GB. 39x apart.
This is a AI post classified by Jev as Open & local models (a model release), kept by the AI Radar because it carries real work, not commentary.
AliceAI 80B-A3B at 262K: 6.0 GB KV. DeepSeek V4.1 Flash same window: 233 GB. 39x apart. Yandex dropped it today, Apache 2.0. 48 layers but 36 are KDA linear attention, no growing KV there. Only 12 layers do standard GQA, 2 KV heads at 256 dim. That is 1024 floats per token per layer, 12 layers, BF16: 24,576 B per token. At 262,144: 6.0 GB. Q4 weights about 45 GB. On a 128 GB Spark: 45 plus 6 is 51 GB at full context, 77 GB free. Active 3B at Q4 reads 1.69 GB per token. At 273 GB/s that is 162 tok/s roofline. My 27B at 18 is 9x slower on the same bandwidth. Haven't run it yet. MTP 1 layer i
Posted by 코지베어 🐻 CozyBear (1.2k followers) 18 h ago · 0 likes · 14 views · view the original post on X. Kept by the AI Radar as Open & local models.
More AI work like this
- dear rtx 3060 owners, and every 12gb card behind it. bonsai 2 27b dense went from 26 to… — @sudoingX
- Nimble is able to process images! — @madiator
- Woah...it claims to be open Jev. And it's 100% opensource. — @Saboo_Shubham_
- your rtx 3060 was running bonsai 2 at 26 tok/s this morning and now does 40 tok/s, i… — @sudoingX
- Meet DeepSeek-V4.1-Flash: a blazing fast image-text-to-text model. It takes both images… — @HuggingModels
- Meet Edge0-35B-A3B-preview: a 35B parameter MoE model built for edge inference. It runs… — @HuggingModels
- Putting Jeff-1 out into the world, this is an attempt at a Jev like model, built on qwen… — @DJLougen
- Train a 9M parameter language model from scratch in five minutes. — @tom_doerr
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 27.2k posts from 4.8k X accounts over the last 14 days, 1.2k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 18:08 UTC. Full method.