What if a model could predict the next word using just 2 to 4 previous words? Meet this…
This is a AI post classified by Jev as AI research (a model release), kept by the AI Radar because it carries real work, not commentary.
What if a model could predict the next word using just 2 to 4 previous words? Meet this n-gram style transformer trained on 10M words from BabyLM. A fascinating experiment in efficient language modeling.
Posted by Hugging Models (68.4k followers) 1 h ago · 2 likes · 697 views · view the original post on X. Kept by the AI Radar as AI research.
More AI work like this
- Meet a tiny text generator trained on BabyLM data. This 10M parameter model uses a… — @HuggingModels
- Interesting work on long-horizon research agents. — @dair_ai
- We are now using Claude Opus 5.5 to create blog-style overviews for every arXiv paper — @askalphaxiv
- Meet this text-generation transformer with a twist: it's a hard 3-gram model. Trained on… — @HuggingModels
- Meet a tiny language model with a big name: hard_3gram_4_6_384_babylm_10m_seed43. It's a… — @HuggingModels
- VLAs? WAMs? Are language and video models the right foundations for robotics? — @DJiafei
- Great paper from Google and colleagues. — @omarsar0
- New podcast with @datagenproc of @EpochAIResearch digging into the open questions… — @natolambert
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 43k posts from 5k X accounts over the last 14 days, 1.8k tools, 19 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-22 20:11 UTC. Full method.