A lightweight proxy server and SDK that standardizes 100+ LLM APIs into the OpenAI format with built-in load balancing. It provides centralized logging, cost tracking, and guardrails for enterprise-grade LLM deployments.
Tech Stack
PythonAI, ML & Data
Why litellm?
• Massive provider support
• Easy drop-in integration
• Robust error handling
Limitations
• Adds a network hop
• Proxy configuration overhead
• Logging requires database setup
3/6/2026
Last Update
6,190
Forks
1,683
Issues
Other
License
Financial Leak Detected
Stop the "SaaS Tax"
Your team could be burning cash. Switching to litellm instantly boosts your runway.
