kv-decider
kv-decider is Model-agnostic decision handoff and receiver-native KV prefix selection - b-ostrov/kv-decider. It is ranked #8745 on the AI Radar, in AI infra & evals, first seen 5 days ago and shared in 3 posts (119 views).
GitHub - b-ostrov/kv-decider: Model-agnostic decision handoff and receiver-native KV prefix selection · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation kv-decider Public Notifications You must be signed in to change notification settings Fork 0 ( 0 ) Star 0 ( 0 ) You must be signed in to star a repository About Model-agnostic…
What people said about kv-decider on X
early stage of the experiment is still like this early KV-decider A/B on 50 synthetic prompts: the decider selected receiver-native KV prefixes, cutting median end-to-end TTFT from 2.00s to 1.00s. p95 barely changed because only 30/50 requests hit the cache; decode speed stayed flat. Promising, but not…
— @b_ostrov, 5 days ago · 2 likes · see the post
my cluster has been running only on Qwen3.8-Next-Flash in Split mode for the last 2 months (Inference resources are distributed between Mac MU2 192 and Spark) This paper seemed very interesting. https://arxiv.org/abs/2610.15095 The point is that the agent would receive information immediately on kv I'm running dozens…
— @b_ostrov, 5 days ago · 1 likes · see the post
my cluster has been running only on Qwen3.8-Next-Flash in Riga Split for the last 2 months (Inference resources are distributed between Mac MU2 192 and Spark) This paper seemed very interesting. https://arxiv.org/abs/2610.15095 The point is that the agent would receive information immediately on kv I'm running dozens…
— @b_ostrov, 5 days ago · 0 likes · see the post
Alternatives to kv-decider
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
kv-decider in numbers
- Rank on the AI Radar: #8745 of 10412
- Shared in 3 posts by 1 account: @b_ostrov
- 119 views on those posts
- First seen 5 days ago, last shared 5 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is kv-decider?
Model-agnostic decision handoff and receiver-native KV prefix selection - b-ostrov/kv-decider It was first shared on X 5 days ago and is ranked #8745 on the AI Radar.
Is kv-decider free?
It is open source.
Who shared kv-decider?
1 account on X, including @b_ostrov, in 3 posts totalling 119 views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.