gateway

Overview Portkey is an AI gateway and observability platform for routing requests across model providers, applying guardrails, tracking cost and improving reliability. Its open-source gateway and hosted controls suit production LLM systems, but configuration and separate model fees add...

Overview LiteLLM is an open-source SDK and self-hosted gateway that presents a common API across many model providers with routing, budgets, rate limits, fallbacks and logging. It reduces integration work, but centralizes keys and traffic in a critical component that must be hardened and updated...