ModelRoute
Resilient Multi-Provider LLM API Gateway
A production-oriented gateway that keeps model traffic moving when providers slow down, fail, or hit limits.
- Three routing strategies across OpenAI and Gemini adapters with bounded retries and automatic fallback.
- Async FastAPI handling, Redis caching, atomic Lua rate limiting, and PostgreSQL p50/p95 observability.