LiteLLM

오픈소스 LLM 프록시 게이트웨이. OpenAI 호환 API 하나로 100+ 벤더 통합—라우팅·예산·폴백·로그까지.

적합한 경우

Teams routing between multiple LLM vendors with unified billing, auditing, and gradual rollouts—a common enterprise AI gateway.

덜 맞는 경우

Single-vendor setups, or teams wanting zero self-hosted middleware.

비교 시 참고

Vs OpenRouter / Portkey / Braintrust Proxy: LiteLLM is OSS-flexible with broad ecosystem; OpenRouter is consumer-grade routing; Portkey leans into guardrails and caching.

점검 체크리스트

Design API key / multi-tenant isolation and auditing
Define rate limits and fallback policies
Monitor per-model cost/latency baselines
Size self-hosted deployment or LiteLLM Cloud capacity

검색 Q&A

LiteLLM vs OpenRouter—how to choose?

LiteLLM acts like an internal AI gateway in your VPC with policy/audit depth; OpenRouter is a consumer-friendly model marketplace. Many teams combine both—OpenRouter as catalog, LiteLLM as governance layer.

활용 상황

위 소개로 이 도구가 적합한지 가늠할 수 있습니다. 비슷한 도구가 많다면 사용 빈도, 예산, 데이터 프라이버시를 먼저 정리하고 고르세요.