Inside The Machine
All categories
10 entries

Routing & gateways

Sends each request to the right model.

Where this sits
AGENT VIEW · text/markdown · or send Accept: text/markdown
# Routing & gateways (10)

Sends each request to the right model.

| slug | name | tier | stars | what | md |
|---|---|---|---|---|---|
| new-api | New API | catalog | 50036 | Unified gateway that converts many LLM APIs. | /setups/new-api.md |
| one-api | One API | catalog | 37168 | LLM API management and distribution gateway. | /setups/one-api.md |
| portkey-gateway | Portkey Gateway | catalog | 13194 | Fast AI gateway with guardrails and fallbacks. | /setups/portkey-gateway.md |
| bifrost | Bifrost | catalog | 8833 | High-performance LLM and MCP gateway. | /setups/bifrost.md |
| plano | Plano | catalog | 7090 | AI-native proxy with smart LLM routing. | /setups/plano.md |
| llmrouter | LLMRouter | catalog | 3006 | Research library of LLM routing methods. | /setups/llmrouter.md |
| envoy-ai-gateway | Envoy AI Gateway | catalog | 2229 | Envoy-based gateway for generative AI services. | /setups/envoy-ai-gateway.md |
| nvidia-pair | NVIDIA PAIR | catalog | 1621 | Shares AI requests across the computers on your home network. | /setups/nvidia-pair.md |
| strands-decider | Strands Decider | catalog | 655 | Small decision model that routes agent choices. | /setups/strands-decider.md |
| nvidia-llm-router | NVIDIA LLM Router | catalog | 354 | Routes each prompt to the best-fit model. | /setups/nvidia-llm-router.md |