Skip to content

BerriAI-litellm

Streamlines integration with 100+ language models via Python SDK.

BerriAI-litellm is a lightweight AI gateway written in Rust with a Python SDK. It can call over 100 LLM APIs in OpenAI-compatible format and includes features such as cost tracking, guardrails, load balancing and logging. The gateway is intended for developers who want to integrate multiple LLMs into their workflows.

Similar tools

Same job, different trade-offs.

Automate tasks, organize inbox with custom rules, stay connected with teammates through real-time updates and notifications.

Freemium

Create personalized campaigns, track performance analytics, generate recommendations, and gain predictive insights.

Paid
Scroll to Top