Speed on Bonsai 2 27b is interesting, especially in relation to the the MoE…
This is a AI post classified by Jev as Open & local models (a model release), kept by the AI Radar because it carries real work, not commentary.
Speed on Bonsai 2 27b is interesting, especially in relation to the the MoE Qwen3.6-35b-a3b and its anticipated 3.8 version There is a size/speed tradeoff If you have 64 gb of memory for models, then it will probably be better to use the future Qwen 3.8 a3b because it will be faster, around 2x if it uses the same architecture But if you prioritize quality over speed TODAY, then Bonsai 2 27b is a better alternative because it is reportedly a high fidelity compression that would outperform a3b But if you have 32 to 16gb of memory, then rejoice! Your local model just got a huge bump in intell
Posted by Onur Solmaz (10k followers) 1 days ago · 81 likes · 12.7k views · view the original post on X. Kept by the AI Radar as Open & local models. Tools mentioned: Gist, ternary-bonsai-2-webgpu-kernels.
More AI work like this
- dear rtx 3060 owners, and every 12gb card behind it. bonsai 2 27b dense went from 26 to… — @sudoingX
- Nimble is able to process images! — @madiator
- Woah...it claims to be open Jev. And it's 100% opensource. — @Saboo_Shubham_
- your rtx 3060 was running bonsai 2 at 26 tok/s this morning and now does 40 tok/s, i… — @sudoingX
- Meet DeepSeek-V4.1-Flash: a blazing fast image-text-to-text model. It takes both images… — @HuggingModels
- Meet Edge0-35B-A3B-preview: a 35B parameter MoE model built for edge inference. It runs… — @HuggingModels
- Putting Jeff-1 out into the world, this is an attempt at a Jev like model, built on qwen… — @DJLougen
- Train a 9M parameter language model from scratch in five minutes. — @tom_doerr
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 27.2k posts from 4.8k X accounts over the last 14 days, 1.2k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 18:08 UTC. Full method.