AI for LLM gateways
Route, cache, and fall back across model providers.
| # | Tool | Category | Pricing | Visit |
|---|---|---|---|---|
| 1 | OpenRouter Single API for 100+ LLMs — compare models, route to the best, pay per token | LLM Frameworks | Freemium | Visit |
| 2 | LiteLLM Python SDK and proxy to call 100+ LLMs with one interface | LLM Frameworks | Free | Visit |
| 3 | Portkey AI gateway for LLM routing, fallbacks, caching, and observability — production-ready in minutes | LLM Frameworks | Freemium | Visit |
| 4 | Helicone One-line LLM observability proxy — log, monitor, and debug LLM API calls | LLM Frameworks | Freemium | Visit |
| 5 | Together AI Open-source LLM inference and fine-tuning API — run Llama, Mistral, and 100+ models with competitive pricing | LLM Frameworks | Freemium | Visit |
| 6 | Groq Ultra-fast LLM inference API — run Llama, Mixtral, and Gemma at 500+ tokens/second on custom LPU hardware | LLM Frameworks | Freemium | Visit |