Skip to content

BerriAI-litellm

Streamlines integration with 100+ language models via Python SDK.

Research

BerriAI-litellm is a lightweight AI gateway written in Rust with a Python SDK. It can call over 100 LLM APIs in OpenAI-compatible format and includes features such as cost tracking, guardrails, load balancing and logging. The gateway is intended for developers who want to integrate multiple LLMs into their workflows.

Similar tools

Same job, different trade-offs.

Scroll to Top