state-bench
state-bench is Contribute to allenai/state-bench development by creating an account on GitHub.. It is ranked #626 on the AI Radar, in Frontier models, first seen 2 days ago and shared in 1 post (19.4k views).
GitHub - allenai/state-bench · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation state-bench Public Notifications You must be signed in to change notification settings Fork 1 ( 1 ) Star 0 ( 0 ) You must be signed in to star a repository About No description, website, or topics provided. Resources Readme Apache-2.0 license…
What people said about state-bench on X
Can LLMs track state changes over long texts—like an object changing hands or a variable reassignment? On our new StateBench eval, frontier models including GPT-6 Sol & Claude Opus 5.5 fell to 13% accuracy or lower on the hardest, longest problems. 🧵 https://github.com/allenai/state-bench
— @allen_ai, 2 days ago · 245 likes · see the post
Alternatives to state-bench
- Thinking Machines Lab — Mantic have been using Tinker since it launched. This guest post is a technical deep dive on what they have built so…
- openai.com —
- Tencent Hy — Tencent Hy
- clocktowerbench.com — You can see the full benchmark at the website, and I’ve also made it so that you and your friends can play again the AIs
- Claude — Basecamp for Claude is live!
- Mercor — Evaluate frontier AI models with Mercor's APEX AI Benchmarks & Leaderboards. Measure AI productivity across software…
state-bench in numbers
- Rank on the AI Radar: #626 of 10410
- Shared in 1 post by 1 account: @allen_ai
- 19.4k views on those posts
- First seen 2 days ago, last shared 2 days ago
- Pricing seen by AGK Intelligence: open source
- Market: Frontier models
FAQ
What is state-bench?
Contribute to allenai/state-bench development by creating an account on GitHub. It was first shared on X 2 days ago and is ranked #626 on the AI Radar.
Is state-bench free?
It is open source.
Who shared state-bench?
1 account on X, including @allen_ai, in 1 post totalling 19.4k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.6k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:05 UTC. Full method.