uzu
uzu is A high-performance inference engine for AI models. Contribute to trymirai/uzu development by creating an account on GitHub.. It is ranked #899 on the AI Radar, in AI infra & evals, first seen 25 days ago and shared in 4 posts (66.7k views).
GitHub - trymirai/uzu: A high-performance inference engine for AI models · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation…
What people said about uzu on X
Before buying more hardware for local AI, check the engine. Avi's Qwen3.5 9B test on a base M5 MacBook: llama.cpp: 22 tok/s MLX: 25.1 uzu: 92.1 uzu uses its own checkpoint and speculative decoding here. Same laptop though 🤯
— @ashxhart, 10 days ago · 176 likes · see the post
💥卧槽！本地LLM推理迎来真正突破！uzu引擎比llama.cpp快4倍，M5 Mac上9B模型直接飙到92 tok/s！ 一次解码平均产出7.5个token，彻底撕开本地推理的内存带宽天花板！ 核心亮点： 🔹实测碾压：在基础版M5 MacBook Pro上跑Qwen3.5 9B（4-bit），llama.cpp仅22.0 tok/s、MLX 25.1 tok/s，uzu直接92.1 tok/s，约4倍速度。 🔹技术黑科技：采用激进投机解码（Speculative…
— @NFT_Chen, 9 days ago · 94 likes · see the post
Uzu is an open source inference engine that lets you run AI models directly inside your iOS and Mac apps. - Zero latency, full data privacy, no inference costs - Simple high-level API in Python, Swift and TypeScript - Built to use unified memory on Apple devices - Easy to add support for new models - MIT license NO…
— @RoundtableSpace, 7 days ago · 80 likes · see the post
Alternatives to uzu
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
uzu in numbers
- Rank on the AI Radar: #899 of 10412
- Shared in 4 posts by 4 accounts: @ashxhart, @NFT_Chen, @RoundtableSpace
- 66.7k views on those posts
- First seen 25 days ago, last shared 7 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is uzu?
A high-performance inference engine for AI models. Contribute to trymirai/uzu development by creating an account on GitHub. It was first shared on X 25 days ago and is ranked #899 on the AI Radar.
Is uzu free?
It is open source.
Who shared uzu?
4 accounts on X, including @ashxhart, @NFT_Chen, @RoundtableSpace, in 4 posts totalling 66.7k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.