megatron-lm
megatron-lm is Ongoing research training transformer models at scale - NVIDIA/Megatron-LM. It is ranked #846 on the AI Radar, in AI infra & evals, first seen 10 days ago and shared in 1 post (11.7k views).
GitHub - NVIDIA/Megatron-LM: Ongoing research training transformer models at scale · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} NVIDIA / Megatron-LM Public Notifications You must be signed in to change notification settings Fork 4.5k Star 17.9k main Branches Tags Go to file Code Open more actions menu Latest commit History…
What people said about megatron-lm on X
🏭 震惊，英伟达把自己训千亿参数大模型的那套底层库开源了，就是 Megatron-LM。 GitHub 上 1.7 万 star，四千四百多个 fork、一千两百多个 issue 开着，从今年 5 月到 8 月连发 0.17、0.18、0.19 三个版本，基本一个月一个大版本。 自己动手训大模型，最先撞的墙从来不是算法，是一张卡装不下。模型一大就得切，切完还得让几千张卡之间的通信不把时间全吃掉，这套东西自己写，光调通就能耗掉几个月。 Megatron-LM 把这块做成了能直接拼的积木：张量并行、流水线并行、数据并行、专家并行、上下文并行几种切法都实现好了，混合精度从 FP16、BF16 一路支持到 FP8 和…
— @Ryrenz, 10 days ago · 185 likes · see the post
Alternatives to megatron-lm
- Ling-3.0-flash-Fin — 🚀 ZDTaichu5.0-9B is now on ModelScope! 🤖
- classifier.dev — now outperforms jev and is free
- Jev API, Pricing & Playground — Jev is now available on the @vercel AI Gateway
- Darkbloom — Private AI inference through hardware-attested Apple Silicon providers. Your prompts stay encrypted, your data stays…
- glm-5.3-flash-exl3-2x-dgx-sparks — GLM-5.3 Flash EXL3 for 2-4x DGX Sparks. Contribute to MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks development by…
- Intelligence Benchmarking — Detailed intelligence benchmarking methodology for LLM quality evaluations.
megatron-lm in numbers
- Rank on the AI Radar: #846 of 1190
- Shared in 1 post by 1 account: @Ryrenz
- 11.7k views on those posts
- First seen 10 days ago, last shared 10 days ago
- Pricing seen by Jev: open source
- Market: AI infra & evals
FAQ
What is megatron-lm?
Ongoing research training transformer models at scale - NVIDIA/Megatron-LM It was first shared on X 10 days ago and is ranked #846 on the AI Radar.
Is megatron-lm free?
It is open source.
Who shared megatron-lm?
1 account on X, including @Ryrenz, in 1 post totalling 11.7k views.
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 27.2k posts from 4.8k X accounts over the last 14 days, 1.2k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 18:08 UTC. Full method.