AI Radar
Support
LiveUpdated 2026-11-06 13:30 UTC

Part 2 / correction on TwIL-8B from @thewebAI.

Part 2 / correction on TwIL-8B from @thewebAI. Yesterday’s run looked slow and incomplete. That was on me. TwIL’s KV…

This is a AI post classified by AGK Intelligence as Open & local models (a model release), kept by the AI Radar because it carries real work, not commentary.

Part 2 / correction on TwIL-8B from @thewebAI. Yesterday’s run looked slow and incomplete. That was on me. TwIL’s KV cache needs are higher than most models in this size class. Same 51.2K window, but more KV bytes per token than peers like Ornith/NeoHorse, so my usual load spilled the cache into system RAM instead of keeping it on the 10GB card. S1 sat around 16 tok/s with thinking off and about 6.6 with it on. PA with thinking on never finished cleanly. I fixed the load so KV stays on the GPU (51.2K context, 41/41 layers, Flash Attention, q4_0 K/V). Re-ran the suite today. Corrected speed

Posted by GooGZ AI (1.6k followers) 2 h ago · 9 likes · 661 views · view the original post on X. Kept by the AI Radar as Open & local models.

More AI work like this

Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.7k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 13:30 UTC. Full method.