nanbeige4.3-33b-w4a16-2x-rtx-3090
nanbeige4.3-33b-w4a16-2x-rtx-3090 is Nanbeige4.3-33B int4 (AutoRound W4A16) on 2x RTX 3090 in vLLM: recipe, C1-C6 bench, 69-scenario eval - tonyd2wild/Nanbeige4.3-33B-W4A16-2x-RTX-3090. It is ranked #4013 on the AI Radar, in AI infra & evals, first seen 11 days ago and shared in 2 posts (9.1k views).
GitHub - tonyd2wild/Nanbeige4.3-33B-W4A16-2x-RTX-3090: Nanbeige4.3-33B int4 (AutoRound W4A16) on 2x RTX 3090 in vLLM: recipe, C1-C6 bench, 69-scenario eval · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation Nanbeige4.3-33B-W4A16-2x-RTX-3090 Public Notifications You must be signed in to change notification…
What people said about nanbeige4.3-33b-w4a16-2x-rtx-3090 on X
🔧 Nanbeige4.3-33B dropped with no int4 that vLLM can run on RTX 3090s. So we made one. 📦 Full recipe: AutoRound W4A16 quant, vLLM launcher, C1-C6 bench, 69-scenario eval 🖥️ 2x RTX 3090, NVLink, TP2 ⚡ 66 tok/s single stream https://github.com/tonyd2wild/Nanbeige4.3-33B-W4A16-2x-RTX-3090
— @Tech2Wild, 11 days ago · 47 likes · see the post
🧠 Nanbeige4.3-33B int4 weights are live on Hugging Face 🗜️ 66 GB down to 20.8 GB (AutoRound W4A16, GPTQ format) 🖥️ Runs on two 24 GB cards in vLLM with Marlin kernels 📏 128K context, 213K-token KV pool 🔓 Apache 2.0 https://huggingface.co/Tech2wild/Nanbeige4.3-33B-W4A16-AutoRound
— @Tech2Wild, 11 days ago · 20 likes · see the post
Alternatives to nanbeige4.3-33b-w4a16-2x-rtx-3090
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
nanbeige4.3-33b-w4a16-2x-rtx-3090 in numbers
- Rank on the AI Radar: #4013 of 10412
- Shared in 2 posts by 1 account: @Tech2Wild
- 9.1k views on those posts
- First seen 11 days ago, last shared 11 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is nanbeige4.3-33b-w4a16-2x-rtx-3090?
Nanbeige4.3-33B int4 (AutoRound W4A16) on 2x RTX 3090 in vLLM: recipe, C1-C6 bench, 69-scenario eval - tonyd2wild/Nanbeige4.3-33B-W4A16-2x-RTX-3090 It was first shared on X 11 days ago and is ranked #4013 on the AI Radar.
Is nanbeige4.3-33b-w4a16-2x-rtx-3090 free?
It is open source.
Who shared nanbeige4.3-33b-w4a16-2x-rtx-3090?
1 account on X, including @Tech2Wild, in 2 posts totalling 9.1k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.