llm-compressor
llm-compressor is LLM-Compressor v0.14.0 Key Highlights ✨ GPTQ Performance Improvements #3128 GPTQ now ships a Triton-based quantization kernel, approximately 15× faster end-to-end than the previous implementatio.... It is ranked #2136 on the AI Radar, in AI infra & evals, first seen 45 days ago and shared in 1 post (6k views).
Release v0.14.0 · vllm-project/llm-compressor · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation v0.14.0 Compare Choose a tag to compare Sorry, something went wrong. Filter Loading Sorry, something went wrong. Uh oh! There was an error while loading. Please reload this page . No results found View all tags dsikka released this…
What people said about llm-compressor on X
LLM Compressor v0.15.0 from @vllm_project is out. New: HIGGS mixed-precision autoquant, block-wise QAD that distills with no teacher model, REAP and MoNe expert pruning, and MXFP6 support. Plus ~6x faster MXFP4 observation. Notes: https://github.com/vllm-project/llm-compressor/releases/tag/0.15.0
— @RedHat_AI, 5 days ago · 45 likes · see the post
Alternatives to llm-compressor
- Nous Portal — Great time to try it out
- TensorFold — Setup guide
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- AI/ML API — Crawl Reddit with your AI agent >
- OrcaRouter — Claim yours
- together.ai — Together AI
llm-compressor in numbers
- Rank on the AI Radar: #2136 of 10560
- Shared in 1 post by 1 account: @RedHat_AI
- 6k views on those posts
- First seen 45 days ago, last shared 5 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is llm-compressor?
LLM-Compressor v0.14.0 Key Highlights ✨ GPTQ Performance Improvements #3128 GPTQ now ships a Triton-based quantization kernel, approximately 15× faster end-to-end than the previous implementatio... It was first shared on X 45 days ago and is ranked #2136 on the AI Radar.
Is llm-compressor free?
It is open source.
Who shared llm-compressor?
1 account on X, including @RedHat_AI, in 1 post totalling 6k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.2k posts from 5k X accounts over the last 14 days, 10.6k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-07 19:50 UTC. Full method.