LiteLLM

LiteLLM

Unified gateway for 100+ LLMs with spend tracking

Open source alternative to:OpenAI APILangChainOpenRouter

Unified gateway for 100+ LLM APIs in OpenAI format.

Cost tracking, guardrails, loadbalancing, and logging.

Python SDK and proxy server (AI Gateway).

Supports Bedrock, Azure, OpenAI, VertexAI, Anthropic, and more.

Self-hostable with full control over AI spend.

Screenshots

LiteLLM screenshot 1

Category

Developer Tools

Tags

ai