odysseysbench.com
odysseysbench.com is Data + Evals. It is ranked #878 on the AI Radar, in AI agents, first seen 9 days ago and shared in 4 posts (23.2k views).
What odysseysbench.com says about itself
Odysseys2 is a web agent benchmark developed by researchers at Carnegie Mellon University and Browser Use, with 100 tasks grounded in real user needs.
Odysseys2: A Web Agent Benchmark Based on Real User Requests Odysseys 2 October 2026 · 12 min read Odysseys 2 : A Web Agent Benchmark Based on Real User Requests. Odysseys2 is a web agent benchmark developed by researchers at Carnegie Mellon University and Browser Use , with 100 tasks grounded in real user needs that run on the live internet. While the original Odysseys drew on user browsing histories, Odysseys2 uses tasks constructed from the real user request distribution provided by Browser Use . Odysseys2 evaluates tasks with an LLM judge which takes in the files agents produce alongside their action histories and screenshots, and…
What people said about odysseysbench.com on X
Introducing: Odysseys2 - hardest long horizon benchmark for web agents based on real user tasks 🏗️ We collaborated with @JangLawrenceK @rsalakhu from Carnegie Mellon University > SOTA agent fully completes only 47/100 > 5 agents complete none > 8-12 real rubrics per task, 60 min on the live web Web agents are…
— @browser_use, 9 days ago · 143 likes · see the post
We spent months with CMU building the benchmark we actually wanted > 100 long tasks from what people really automate > best agent fully completes 47/100 > a stricter judge cuts average scores in half evals are the bottleneck for agents now
— @gregpr07, 9 days ago · 25 likes · see the post
Exciting collaboration with the @browser_use team on Odysseys2, the next generation of our long-horizon web navigation benchmark: Data + Evals: https://odysseysbench.com/v2/ Developed jointly with Browser Use, Odysseys2 contains 100 challenging tasks grounded in real user requests and executed on the live internet.…
— @rsalakhu, 9 days ago · 16 likes · see the post
Alternatives to odysseysbench.com
- Z.ai — chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B) during…
- Console by Nace.AI — Cloud Inference
- dsh-superagent-prototype — DeepSeek open-sourced the design behind its always-on 'Super-agent': no chat window, and reportedly nearly half the…
- REA for Growth — 4,000+ data endpoints, one key.
- Muse — We've now paid out more than $1M in @muse bug bounties. That includes $300,000 to a security researcher who found the…
- Simulations — Test agent changes against real production scenarios to understand their impact on behavior, latency, and cost before…
odysseysbench.com in numbers
- Rank on the AI Radar: #878 of 10412
- Shared in 4 posts by 3 accounts: @browser_use, @gregpr07, @rsalakhu
- 23.2k views on those posts
- First seen 9 days ago, last shared 9 days ago
- Pricing seen by AGK Intelligence: not stated
- Market: AI agents
FAQ
What is odysseysbench.com?
Data + Evals It was first shared on X 9 days ago and is ranked #878 on the AI Radar.
Is odysseysbench.com free?
Pricing is not stated on the page we read.
Who shared odysseysbench.com?
3 accounts on X, including @browser_use, @gregpr07, @rsalakhu, in 4 posts totalling 23.2k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.