What is LiteLLM?
LiteLLM is an open-source library and proxy server that provides a unified OpenAI-compatible API across many LLM providers and local model servers. It handles routing, load balancing, logging, budgeting, and fallback between models. Teams deploy LiteLLM to standardize LLM access and add observability across heterogeneous model backends.
