LiteLLM

開源 LLM 聚合代理:以單一 OpenAI 相容 API 接上百家供應商,支援路由、預算、fallback 與日誌,不必重造基礎設施。

推論 / 託管开源代理聚合
造訪官網新視窗開啟

更適合

Teams routing between multiple LLM vendors with unified billing, auditing, and gradual rollouts—a common enterprise AI gateway.

較不適合

Single-vendor setups, or teams wanting zero self-hosted middleware.

比對時可留意

Vs OpenRouter / Portkey / Braintrust Proxy: LiteLLM is OSS-flexible with broad ecosystem; OpenRouter is consumer-grade routing; Portkey leans into guardrails and caching.

選用前自檢

  • Design API key / multi-tenant isolation and auditing
  • Define rate limits and fallback policies
  • Monitor per-model cost/latency baselines
  • Size self-hosted deployment or LiteLLM Cloud capacity

常見檢索問題

LiteLLM vs OpenRouter—how to choose?

LiteLLM acts like an internal AI gateway in your VPC with policy/audit depth; OpenRouter is a consumer-friendly model marketplace. Many teams combine both—OpenRouter as catalog, LiteLLM as governance layer.

使用情境

以上介紹幫助你判斷這款工具是否適合當前需求。同類工具較多時,建議先釐清使用頻率、預算與資料隱私要求,再選擇最順手的一款。

同類工具