I'm done with Bonsai 2 27B. This model has taken enough of my time and patience.
This is a AI post classified by Jev as Open & local models (a free resource), kept by the AI Radar because it carries real work, not commentary.
I'm done with Bonsai 2 27B. This model has taken enough of my time and patience. After the whole argument, I ran 12 OMP sessions on my 4x RTX 3090 rig using PrismML's launcher settings and the reasoning budget nisten asked for. 1 session per GPU, 128K context, no follow-up prompts. Same ternary model, 2 weight packings, 3 KV caches, 2 prompts. Here are the results, the exact prompts, the memory guide and the settings. Do whatever you want with them. Big thread 🧵 First, the extended prompt. 3 of the 6 runs produced usable scenes. PQ2_0 with Q8 KV made the garden I liked most: 42.0 minutes,
Posted by Alexey Fateev (5.9k followers) 1 h ago · 18 likes · 958 views · view the original post on X. Kept by the AI Radar as Open & local models.
More AI work like this
- You can run locally Uncensored Ternary Bonsai 2-27B Same 5.9GB file. — @0x0SojalSec
- Most local models still sound like customer support. — @0x0SojalSec
- dear rtx 3060 owners, and every 12gb card behind it. bonsai 2 27b dense went from 26 to… — @sudoingX
- Nimble is able to process images! — @madiator
- Woah...it claims to be open Jev. And it's 100% opensource. — @Saboo_Shubham_
- your rtx 3060 was running bonsai 2 at 26 tok/s this morning and now does 40 tok/s, i… — @sudoingX
- Meet DeepSeek-V4.1-Flash: a blazing fast image-text-to-text model. It takes both images… — @HuggingModels
- Meet Edge0-35B-A3B-preview: a 35B parameter MoE model built for edge inference. It runs… — @HuggingModels
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 4.7k X accounts over the last 14 days, 1.3k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 20:02 UTC. Full method.