llm-compressor
llm-compressor is LLM-Compressor v0.14.0 Key Highlights ✨ GPTQ Performance Improvements #3128 GPTQ now ships a Triton-based quantization kernel, approximately 15× faster end-to-end than the previous implementatio.... It is ranked #283 on the AI Radar, in AI infra & evals, first seen 1 h ago and shared in 1 post (1k views).
Release v0.14.0 · vllm-project/llm-compressor · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} vllm-project / llm-compressor Public Notifications You must be signed in to change notification settings Fork 672 Star 3.8k v0.14.0 Latest Latest Compare Choose a tag to compare Sorry, something went wrong. Filter Loading Sorry,…
What people said about llm-compressor on X
LLM Compressor v0.14.0 is out, and GPTQ just got its biggest speedup since launch. A new Triton kernel makes quantization ~15x faster end to end. Batching layers that share a shape pushes that to ~30x on some MoE workloads. Even the old eager path is 1.5-2x faster. Also new: expanded MSE/iMatrix observers that beat…
— @RedHat_AI, 1 h ago · 41 likes · see the post
Alternatives to llm-compressor
- Built to power AI innovators — Prompts to get started available in the blog
- Ling-3.0-flash-Fin — 🚀 ZDTaichu5.0-9B is now on ModelScope! 🤖
- classifier.dev — now outperforms jev and is free
- glm-5.3-flash-exl3-2x-dgx-sparks — GLM-5.3 Flash EXL3 for 2-4x DGX Sparks. Contribute to MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks development by…
- StepFun Open Platform — Step API · Stable · High-Performance · Easy Integration. Leading models and tools to accelerate the deployment of your…
- halo — Star us on GitHub
llm-compressor in numbers
- Rank on the AI Radar: #283 of 1874
- Shared in 1 post by 1 account: @RedHat_AI
- 1k views on those posts
- First seen 1 h ago, last shared 1 h ago
- Pricing seen by Jev: open source
- Market: AI infra & evals
FAQ
What is llm-compressor?
LLM-Compressor v0.14.0 Key Highlights ✨ GPTQ Performance Improvements #3128 GPTQ now ships a Triton-based quantization kernel, approximately 15× faster end-to-end than the previous implementatio... It was first shared on X 1 h ago and is ranked #283 on the AI Radar.
Is llm-compressor free?
It is open source.
Who shared llm-compressor?
1 account on X, including @RedHat_AI, in 1 post totalling 1k views.
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 44.8k posts from 5k X accounts over the last 14 days, 1.9k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-23 18:46 UTC. Full method.