All categories
10 entries
Routing & gateways
Sends each request to the right model.
Where this sits
- Modelthe weights
- RoutingRuntimeruns & routes it
- Harnessmakes it act
- Memorymakes it remember
- Toolsgives it hands
New API
Unified gateway that converts many LLM APIs.
50K
One API
LLM API management and distribution gateway.
37K
Portkey Gateway
Fast AI gateway with guardrails and fallbacks.
13K
Bifrost
High-performance LLM and MCP gateway.
8.8K
Plano
AI-native proxy with smart LLM routing.
7.1K
LLMRouter
Research library of LLM routing methods.
3K
Envoy AI Gateway
Envoy-based gateway for generative AI services.
2.2K
NVIDIA PAIR
Shares AI requests across the computers on your home network.
1.6K
Strands Decider
Small decision model that routes agent choices.
On the channel655
NVIDIA LLM Router
Routes each prompt to the best-fit model.
354
# Routing & gateways (10) Sends each request to the right model. | slug | name | tier | stars | what | md | |---|---|---|---|---|---| | new-api | New API | catalog | 50036 | Unified gateway that converts many LLM APIs. | /setups/new-api.md | | one-api | One API | catalog | 37168 | LLM API management and distribution gateway. | /setups/one-api.md | | portkey-gateway | Portkey Gateway | catalog | 13194 | Fast AI gateway with guardrails and fallbacks. | /setups/portkey-gateway.md | | bifrost | Bifrost | catalog | 8833 | High-performance LLM and MCP gateway. | /setups/bifrost.md | | plano | Plano | catalog | 7090 | AI-native proxy with smart LLM routing. | /setups/plano.md | | llmrouter | LLMRouter | catalog | 3006 | Research library of LLM routing methods. | /setups/llmrouter.md | | envoy-ai-gateway | Envoy AI Gateway | catalog | 2229 | Envoy-based gateway for generative AI services. | /setups/envoy-ai-gateway.md | | nvidia-pair | NVIDIA PAIR | catalog | 1621 | Shares AI requests across the computers on your home network. | /setups/nvidia-pair.md | | strands-decider | Strands Decider | catalog | 655 | Small decision model that routes agent choices. | /setups/strands-decider.md | | nvidia-llm-router | NVIDIA LLM Router | catalog | 354 | Routes each prompt to the best-fit model. | /setups/nvidia-llm-router.md |