litellm

Overview LiteLLM is an open-source SDK and self-hosted gateway that presents a common API across many model providers with routing, budgets, rate limits, fallbacks and logging. It reduces integration work, but centralizes keys and traffic in a critical component that must be hardened and updated...