tensorrt-llm
tensorrt-llm is TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor.... It is ranked #1201 on the AI Radar, in AI infra & evals, first seen 14 days ago and shared in 1 post (42.8k views).
GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another…
Alternatives to tensorrt-llm
- Spark-X2.6 — 6 open routing models from 0.3B to 27B, built to make decisions and extract exactly what you need in a single call. 🤖
- OrcaRouter — Claim yours
- AI/ML API — Crawl Reddit with your AI agent >
- LongCatAI — Take a closer look at what it can do
- Nous Portal — Great time to try it out
- together.ai — Together AI
tensorrt-llm in numbers
- Rank on the AI Radar: #1201 of 10425
- Shared in 1 post by 1 account: @RoundtableSpace
- 42.8k views on those posts
- First seen 14 days ago, last shared 14 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI infra & evals
FAQ
What is tensorrt-llm?
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor... It was first shared on X 14 days ago and is ranked #1201 on the AI Radar.
Is tensorrt-llm free?
It is open source.
Who shared tensorrt-llm?
1 account on X, including @RoundtableSpace, in 1 post totalling 42.8k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.3k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 17:44 UTC. Full method.