Very exciting to finally show this off: lossless compression of BF16 models to 12bits…
This is a AI post classified by AGK Intelligence as AI infra & evals (a tool drop), kept by the AI Radar because it carries real work, not commentary.
Very exciting to finally show this off: lossless compression of BF16 models to 12bits (based on NyoomFloat12 from @togethercompute). A lot of work went into this to make it as efficient to run as possible, since no hardware has native support for this dtype. https://github.com/dphnAI/nf12
Posted by Alpin (7.7k followers) 12 h ago · 357 likes · 17.4k views · view the original post on X. Kept by the AI Radar as AI infra & evals. Tools mentioned: nf12.
More AI work like this
- The enterprise AI bottleneck has moved from models and GPUs to the data path. — @Dell
- AMD Localmaxxers are getting serious about inferencing. 🤯 — @TeksEdge
- We evaluated Nexus on 7 benchmarks and 1,222 tasks. It defines the Pareto frontier. — @FireworksAI_HQ
- There is a 560B model running with its full 1M context on 2x DGX Sparks by @andersjw_. — @plotarmordev
- 免费GPT的API，手快有手慢无 — @mylifcc
- TensorFold 1.2.4 is out. 🚀 — @ashxhart
- AWS is making it easier to run several smaller models on the same GPU. — @markfenner
- The @nvidia Jetson Orin Nano is back in the lab. — @jmurillocode
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.2k posts from 5k X accounts over the last 14 days, 10.5k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-07 16:40 UTC. Full method.