hle-lite
hle-lite is 173 hard multiple-choice questions from the audited HLE-Verified Gold subset: exact grading, no LLM judge, paired McNemar tests for comparing LLMs - Incept5-AI/hle-lite. It is ranked #4820 on the AI Radar, in AI infra & evals, first seen 8 days ago and shared in 1 post (954 views).
GitHub - Incept5-AI/hle-lite: 173 hard multiple-choice questions from the audited HLE-Verified Gold subset: exact grading, no LLM judge, paired McNemar tests for comparing LLMs · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation hle-lite Public Notifications You must be signed in to change notification settings Fork 0 ( 0 )…
What people said about hle-lite on X
I had a little play with @0xBakeer's TandemLLM last night. Well, actually I wrote a 20-second prompt and Claude had a good play. I was using v0.15.0 serving Qwen3.8-Flash-Next on a DGX Spark. https://github.com/0xBakeer/TandemLLM A quick overview of the results... It takes the lead for one-user with small prompts,…
— @jtdavies, 8 days ago · 9 likes · see the post
Alternatives to hle-lite
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- OrcaRouter — Claim yours
- AI/ML API — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Nous Portal — Great time to try it out
- together.ai — Together AI
hle-lite in numbers
- Rank on the AI Radar: #4820 of 10425
- Shared in 1 post by 1 account: @jtdavies
- 954 views on those posts
- First seen 8 days ago, last shared 8 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is hle-lite?
173 hard multiple-choice questions from the audited HLE-Verified Gold subset: exact grading, no LLM judge, paired McNemar tests for comparing LLMs - Incept5-AI/hle-lite It was first shared on X 8 days ago and is ranked #4820 on the AI Radar.
Is hle-lite free?
It is open source.
Who shared hle-lite?
1 account on X, including @jtdavies, in 1 post totalling 954 views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.3k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 17:44 UTC. Full method.