babelarena
babelarena is Contribute to QwenLM/BabelArena development by creating an account on GitHub.. It is ranked #2985 on the AI Radar, in AI infra & evals, first seen 11 days ago and shared in 2 posts (5.1k views).
GitHub - QwenLM/BabelArena · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation BabelArena Public Notifications You must be signed in to change notification settings Fork 0 ( 0 ) Star 5 ( 5 ) You must be signed in to star a repository About No description, website, or topics provided. Resources Readme License…
What people said about babelarena on X
New post from Qwen Developers Unfortunately it's not (directly) about Qwen4, but cool nonetheless. They just open sourced Babel Arena; A large scale multilingual benchmark for LLM agents. 699 canonical tasks from four agent benchmark families, spanning 13 domains, each adapted into 23 languages for 16,077 task…
— @ItsmeAjayKV, 11 days ago · 35 likes · see the post
😨Qwen实测打脸!同一购物任务,英语25次工具调用就搞定,泰卢固语直接飙到201次,通关了,效率却崩了8倍! 这是Qwen刚开源的BabelArena核心发现:Agent换语言后,不只是“答得不好”,而是工具调用、控制流、token消耗全面失真。 Qwen发现一览: 🔹效率崩塌:Qwen-3.8-Max同一购物任务,英语仅25次工具调用拿到4个商品,泰卢固语却要201次(反复空搜本地化目录),两边都“通过”。 🔹失败模式突变:低资源语言里,工具使用和控制流错误占比明显更高,不再是简单的答案质量问题。 🔹资源消耗翻倍:低资源语言下输入token最高约2倍于英语,但交互轮次并没有同比例增加。…
— @NFT_Chen, 10 days ago · 19 likes · see the post
Alternatives to babelarena
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
babelarena in numbers
- Rank on the AI Radar: #2985 of 10412
- Shared in 2 posts by 2 accounts: @ItsmeAjayKV, @NFT_Chen
- 5.1k views on those posts
- First seen 11 days ago, last shared 10 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is babelarena?
Contribute to QwenLM/BabelArena development by creating an account on GitHub. It was first shared on X 11 days ago and is ranked #2985 on the AI Radar.
Is babelarena free?
It is open source.
Who shared babelarena?
2 accounts on X, including @ItsmeAjayKV, @NFT_Chen, in 2 posts totalling 5.1k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.