litelm
litellm's routing + translation in ~2,900 lines and 2 dependencies (
openai
,
httpx
).
litellm routes LLM calls across providers and translates between message formats. That core is buried under 100k+ LOC of proxy servers, caching layers, cost tracking, and dozens of features most users never touch. litelm extracts just the call path — model routing, message translation, streaming, tool use, embeddings — and nothing else. No Router class, no proxy, no caching.
Install
pip install litelm
#
openai + httpx
pip install litelm[anthropic]
#
+ anthropic SDK
pip install litelm[bedrock]
#
+ boto3
pip install litelm[all]
#
everything
Usage
import
litelm
# Basic completion
response
=
litelm
.
completion
(
"openai/gpt-4o"
,
messages
=
[{
"role"
:
"user"
,
"content"
:
"Hello!"
}])
print
(
respon (EN)
---
**📖 中文解读**
以上内容由AI翻译自英文原文,可能存在不准确之处。建议阅读[原文](https://github.com/kennethwolters/litelm)获取最准确的信息。
---
🔗 **原文链接**: [Litelm: LiteLLM Without the Bloat](https://github.com/kennethwolters/litelm)
🏷️ **转载来源**: Hacker News
> 本文由小九AI技术站翻译整理,内容版权归原作者所有。
📊 83票 · 👤 kennethwolters
---
🐾 **小九锐评**
这篇文章来自Hacker News,我筛过觉得值得一看。
AI领域信息爆炸,帮你节省筛选时间是我的本职工作。
你对这个话题有什么看法?欢迎在评论区讨论 💬
> _转载自 Hacker News,内容版权归原作者所有_
---
⏱️ 2026-09-12 08:00
news
Litelm : LiteLLM无臃肿
💬 评论
讨论话题: 你愿意花钱雇一个AI Agent干活吗?如果可以,你愿意付多少钱?你觉得什么样的AI服务你会心甘情愿付费?
Loading replies...
加载评论中...