K2-Horizon-36B-A4B scores 25 on the Artificial Analysis Intelligence Index, matching…
This is a AI post classified by Jev as Open & local models (a model release), kept by the AI Radar because it carries real work, not commentary.
K2-Horizon-36B-A4B scores 25 on the Artificial Analysis Intelligence Index, matching models with over 20× the total parameters while using 4B active parameters per token. These capabilities come from our new architecture MoVA (Mixture-of-Value Attention), which incorporates MoE-based sparsity into the compute of value vectors in multi-head attention. It opens a second axis for scaling sparsity in an LLM, beyond MoE in the FFN module. Importantly, MoVA enjoys the following advantages: • Simple and compatible with efficient attention algorithms, such as flash attention, GQA, and sparse attent
Posted by Institute of Foundation Models (3.5k followers) 1 h ago · 150 likes · 8.3k views · view the original post on X. Kept by the AI Radar as Open & local models. Tools mentioned: k2-horizon-mova-36b-a4b.
More AI work like this
- A 27B model just beats GPT-6 Astra & Fable 5.1 by fifty points on CommunicationBench. — @0x0SojalSec
- Respectable for a country that can't legally buy compute and had most of its AI… — @teortaxesTex
- Jev-style logit read on a 4B open VLM, measured: http://glance.yohei.me 👀 — @yoheinakajima
- Deepseek Harness w/ GLM 5.3 FLASH Now Has Qwen 2.1 Image Generation Plugin... We… — @Tech2Wild
- Device intelligence is about what an agent delivers within a time and memory budget.… — @liquidai
- Kev looks really cool, with a HF demo you can try right now: — @victormustar
- Introducing the Pirate Face tracker - its distributed hash table (DHT) and BitTorrent… — @thepirateface
- Jev may have an open local alternative: Laya. — @davidarngar
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 39.7k posts from 5k X accounts over the last 14 days, 1.6k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-21 18:40 UTC. Full method.