llama-rpc-rdma
llama-rpc-rdma is Ready-to-use client: Llama-RPC-RDMA — a llama.cpp fork whose RPC backend speaks RDMA natively. Auto-negotiates RDMA vs TCP on the same -rpc CLI. That's what mov. It is ranked #10232 on the AI Radar, in AI infra & evals, first seen 55 days ago and shared in 1 post (215 views).
What llama-rpc-rdma says about itself
LLM inference in C/C++. Contribute to b-ostrov/Llama-RPC-RDMA development by creating an account on GitHub.
GitHub - b-ostrov/Llama-RPC-RDMA: LLM inference in C/C++ · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} b-ostrov / Llama-RPC-RDMA Public forked from ServeurpersoCom/llama.cpp Notifications You must be signed in to change notification settings Fork 0 Star 1 master Branches Tags Go to file Code Open more actions menu Latest…
Alternatives to llama-rpc-rdma
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- fireworks.ai — Start building through our API, no dedicated GPUs needed
- OrcaRouter — Claim yours
- aimlapi.com — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
llama-rpc-rdma in numbers
- Rank on the AI Radar: #10232 of 10402
- Shared in 1 post by 1 account: @b_ostrov
- 215 views on those posts
- First seen 55 days ago, last shared 55 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is llama-rpc-rdma?
Ready-to-use client: Llama-RPC-RDMA — a llama.cpp fork whose RPC backend speaks RDMA natively. Auto-negotiates RDMA vs TCP on the same -rpc CLI. That's what mov It was first shared on X 55 days ago and is ranked #10232 on the AI Radar.
Is llama-rpc-rdma free?
It is open source.
Who shared llama-rpc-rdma?
1 account on X, including @b_ostrov, in 1 post totalling 215 views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.6k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 15:10 UTC. Full method.