Tag: #litellm
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
LiteLLM in Practice — 100+ LLMs Behind One Interface
A hands-on quickstart for calling OpenAI, Anthropic, Gemini, Bedrock, OpenRouter, and local models through one OpenAI-shaped interface with LiteLLM — from install to streaming, Router, and the Proxy Server.
2026-07-06 · 9 min read #litellm#llm#ai-gateway#python#openai-compatibleLiteLLM Complete Guide 2025: Unify 100+ LLMs with a Single API Proxy Server
Everything about LiteLLM! 100+ LLM unified API, OpenAI-compatible proxy server, cost tracking/budget management, load balancing/fallback, model routing, virtual keys, rate limiting, Guardrails, production deployment (Doc
2026-03-25 · 18 min read #litellm#llm#api#proxy#openai[Architecture] Complete Guide to LiteLLM: Unified Serving of 100+ LLMs
A comprehensive guide on integrating 100+ LLMs through a single API with LiteLLM, covering Proxy server setup, cost tracking, rate limiting, load balancing, and production deployment.
2026-03-20 · 15 min read #architecture#litellm#llm#ai-gateway#mlops