LiteLLM

Verified

Open-source proxy and SDK for 100+ LLM providers.

LiteLLM provides a unified OpenAI-compatible interface to 100+ providers, both as a Python SDK and a self-hostable proxy server with keys, budgets, fallbacks, caching, and logging. It is a common open-source gateway.

License

Open source (MIT)

Deployment

Self-hosted, Managed

Pricing

Open-source; LiteLLM Cloud/Enterprise adds managed features.

SDKs / languages

Python, Any (proxy)

Founded

2023

Strengths

Open-source, self-hostable
Unifies 100+ providers
Budgets, keys, fallbacks, caching

Limitations

You operate the proxy
Broad scope can mean rough edges

Alternatives

Cloudflare AI Gateway

Proxy your AI traffic through Cloudflare for caching and analytics.

Helicone

Open-source LLM logging and monitoring via a proxy.

Kong AI Gateway

AI features on the Kong API gateway.

OpenRouter

One API and account for hundreds of models.

Portkey

AI gateway with observability, guardrails, and prompt management.

Compare all ai gateways & llm routing →

Facts verified 19 July 2026. Neutral summary, not an endorsement; verify current details with the vendor.