I've taken matters into my own hands with @Apple's Metal. 🔥
This is a AI post classified by AGK Intelligence as AI infra & evals (a launch), kept by the AI Radar because it carries real work, not commentary.
I've taken matters into my own hands with @Apple's Metal. 🔥 I'm building my own custom Metal kernel for TensorFold, starting with 4-bit inference on M5. It'll set me back a little while I get this built and tested properly, but what I've achieved locally with (mlx_tf) already feels like a real breakthrough. The M3 Ultra has 819 GB/s of memory bandwidth. The M5 Ultra has 1.2 TB/s. I look at that hardware and think there's still a lot more decode performance to unlock. Why should the Sparks have all the fun... Watch this space 👀
Posted by Ash Hart (11.1k followers) 17 h ago · 357 likes · 11.2k views · view the original post on X. Kept by the AI Radar as AI infra & evals.
More AI work like this
- a16z's Martin Casado: AI is the biggest rebuild of computer science since the internet.… — @guilleflorvs
- There are AI GPUs running in converted chicken coops. — @guilleflorvs
- Enterprise AI is only as useful as the data and business context behind it. — @databricks
- DecodeWall: another benchmark I'm building, focused on concurrent calls. — @ivanfioravanti
- KindlingAI's GLM 5.3 Flash for one Spark recipe is here! 700k total KV on DGX OS (up to… — @mmastrac
- A small model coaching a giant? Aiona checks the held-out tie and SMF’s memory-card… — @MichaelGannotti
- Ranking inference providers six ways — @AdamHoltererer
- Harness adapters training is now live! — @yb2698
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.