LiteLLM
Unified gateway for 100+ LLMs with spend tracking
LiteLLM is a Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI format, with cost tracking, guardrails, loadbalancing and logging. Supports Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM.
Proxed AI
Secure AI API management for iOS apps with DeviceCheck
Proxed.AI is a secure proxy backend for iOS apps that protects your AI API keys and controls AI responses. Uses Apple DeviceCheck to lock down API keys and provides a visual schema builder to structure AI outputs.
Compare Portkey alternatives
Portkey is a hosted AI gateway that sits between your application and LLM providers, adding routing, observability, and guardrails behind a unified API — priced on a per-log basis with a free tier capped at 10,000 logs a month and paid tiers starting at $49/month. Portkey was acquired by Palo Alto Networks in 2026, which has pushed some teams toward gateways they can run entirely on their own infrastructure instead.
LiteLLM is the closest self-hostable match, unifying 100+ LLM providers behind one API with spend tracking, without requiring you to route traffic through a third-party account. Proxed AI is a narrower option focused specifically on securing AI API calls from iOS apps.
FAQ
Is there a free, open-source alternative to Portkey?
Yes. LiteLLM and Proxed AI are both open source and free to self-host.
What's the best open-source alternative to Portkey?
LiteLLM is the closest match for general-purpose LLM gateway needs — unified routing and spend tracking across 100+ providers, runnable entirely on your own infrastructure.
What are the top open-source alternatives to Portkey?
Browse all open-source alternatives to Portkey above, or explore the full Developer Tools category for more options.