Portkey

Overview​

Portkey is an AI gateway and observability platform for routing requests across model providers, applying guardrails, tracking cost and improving reliability. Its open-source gateway and hosted controls suit production LLM systems, but configuration and separate model fees add complexity.

Best for​

Engineering teams operating multi-provider LLM applications that need routing, retries, guardrails, observability and cost controls

Pricing and availability​

Portkey offers hosted plans alongside an open-source gateway. Platform charges are separate from model-provider usage, and enterprise capabilities such as advanced security or support may use custom pricing.

Platforms and integrations​

Available through: web, api.

A universal API connects many model providers and supports routing, fallbacks, caching, rate limits, budgets, guardrails, MCP and observability. The gateway can also be self-hosted.

Privacy and security​

Portkey documents token-based access, encryption and enterprise identity controls. Teams should review hosted versus self-managed data paths, provider retention, key storage, logging and residency.

Key strengths​

• One API layer can route across many model providers
• Reliability, cost and guardrail controls target production systems
• Open-source gateway provides a self-hosting option

Key limitations​

• Adds another operational layer to the model stack
• Provider charges remain separate from platform pricing
• Advanced routing and observability require careful configuration

Editorial note​

CoinBotLab independently maintains this record using current provider documentation and independent sources. Features, pricing, availability and policies can change.