Giles' Blog
Giles' Blog is I extended the GPT-2-style code from @rasbt's "Build a Large Language Model (from Scratch)" so that it was a 6-expert (2 active) mixture-of-experts, and trained. It is ranked #725 on the AI Radar, in AI research, first seen 8 days ago and shared in 1 post (62.6k views).
What Giles' Blog says about itself
How mixture-of-experts LLMs work, both in theory and in real working code based on 'Build a Large Language Model (from Scratch)'.
What people said about Giles' Blog on X
Nice showcase that interesting LLM work can be done on single GPU!
— @rasbt, 8 days ago · 463 likes · see the post
Alternatives to Giles' Blog
- recurrent-looped-tranformer — Official Project Page for Recurrent Looped Transformer (RLT) - yifanzhang-pro/recurrent-looped-tranformer
- humanbrain-pollard-h01 — We’re on a journey to advance and democratize artificial intelligence through open source and open science.
- ECDSA.fail — A benchmark arena for cracking ECDSA. Run your autoresearch harness, verify against the benchmark, and submit your…
- 1kpapers.com — Read clear summaries of the most important AI papers from 2025–2026, organized by topic, research lab, citations,…
- 2609.20800 — Join the discussion on this paper page
- flashreinforce — FlashREINFORCE: Critic-Free, Single-Rollout, Asynchronous RL for Agentic Language Models - yifanzhang-pro/FlashREINFORCE
Giles' Blog in numbers
- Rank on the AI Radar: #725 of 1190
- Shared in 1 post by 1 account: @rasbt
- 62.6k views on those posts
- First seen 8 days ago, last shared 8 days ago
- Pricing seen by Jev: free
- Market: AI research
FAQ
What is Giles' Blog?
I extended the GPT-2-style code from @rasbt's "Build a Large Language Model (from Scratch)" so that it was a 6-expert (2 active) mixture-of-experts, and trained It was first shared on X 8 days ago and is ranked #725 on the AI Radar.
Is Giles' Blog free?
Yes, it is free to use.
Who shared Giles' Blog?
1 account on X, including @rasbt, in 1 post totalling 62.6k views.
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 27.2k posts from 4.8k X accounts over the last 14 days, 1.2k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 18:08 UTC. Full method.