tool-eval-bench
tool-eval-bench is @SeraAndroid tool-eval-bench. It is ranked #3147 on the AI Radar, in AI infra & evals, first seen 33 days ago and shared in 5 posts (61.6k views).
What tool-eval-bench says about itself
Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp. ...
GitHub - SeraphimSerapis/tool-eval-bench: Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp. · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation tool-eval-bench Public Notifications…
What people said about tool-eval-bench on X
I love the new web UI on top of tool-eval-bench!
— @ivanfioravanti, 11 days ago · 20 likes · see the post
Amazing - happy to see it outperforming NVFP4 on decode performance and memory! We're working towards building it into gr8, but we've tuned this recipe for both stability and speed on multiple DGX Sparks. https://github.com/kindlingai/glm-5.3-flash-exlr8-gx10
— @mmastrac, 13 days ago · 16 likes · see the post
Alternatives to tool-eval-bench
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
tool-eval-bench in numbers
- Rank on the AI Radar: #3147 of 10412
- Shared in 5 posts by 4 accounts: @ivanfioravanti, @mmastrac
- 61.6k views on those posts
- First seen 33 days ago, last shared 11 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is tool-eval-bench?
@SeraAndroid tool-eval-bench It was first shared on X 33 days ago and is ranked #3147 on the AI Radar.
Is tool-eval-bench free?
It is open source.
Who shared tool-eval-bench?
4 accounts on X, including @ivanfioravanti, @mmastrac, in 5 posts totalling 61.6k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.