Tag: #ai-gateway
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 7 posts
7 posts are tagged #ai-gateway; the most recent was published on 2026-08-09.
Often tagged together: #llm 4 #2026-04 3 #ai-platform 3 #cloudflare 2 #litellm 2
Most read in the last 90 days:
Coding Agent Spend Is Controlled by Friction, Not by Caps
Two engineering posts Databricks published back to back in July and August 2026 show that the handling of coding agent spend is moving away from budget caps and toward a gateway plus progressive friction. This post takes
2026-08-09 · 8 min read #mlops#llm#cost#ai-gateway#developer-productivityHow to Use OpenRouter — 300+ LLMs Through One API
How to call 300+ models from 60+ providers through a single OpenAI-compatible endpoint with OpenRouter — from getting a key and your first curl request to SDK drop-in, routing, fallbacks, and streaming.
2026-07-06 · 8 min read #openrouter#llm#ai-gateway#api#openai-compatibleLiteLLM in Practice — 100+ LLMs Behind One Interface
A hands-on quickstart for calling OpenAI, Anthropic, Gemini, Bedrock, OpenRouter, and local models through one OpenAI-shaped interface with LiteLLM — from install to streaming, Router, and the Proxy Server.
2026-07-06 · 9 min read #litellm#llm#ai-gateway#python#openai-compatibleCloudflare AI Gateway Practical Guide: Observability, Reliability, and Cost Control for AI Traffic
A practical, current guide to Cloudflare AI Gateway as of April 12, 2026, covering observability, caching, retries, rate limiting, model fallback, and Dynamic Routing.
2026-04-12 · 5 min read #ai-platform#cloudflare#ai-gateway#observability#cachingAI Gateway Platforms Comparison Guide: Vercel AI Gateway vs Cloudflare AI Gateway vs Amazon Bedrock AgentCore Gateway
A practical comparison of AI gateway layers as of 2026-04-12, showing where Vercel AI Gateway, Cloudflare AI Gateway, and Amazon Bedrock AgentCore Gateway belong in the stack.
2026-04-12 · 4 min read #ai-platform#ai-gateway#comparison#vercel#cloudflareBuilding Multi-Model Apps with Vercel AI SDK 6 and AI Gateway: A 2026 Practical Guide
A practical guide to building multi-model AI apps in 2026 with Vercel AI SDK 6 and AI Gateway, covering agents, MCP, provider routing, fallbacks, human approval, and a Next.js adoption checklist.
2026-04-12 · 7 min read #ai-platform#ai-sdk#ai-gateway#multi-model#fallbacks[Architecture] Complete Guide to LiteLLM: Unified Serving of 100+ LLMs
A comprehensive guide on integrating 100+ LLMs through a single API with LiteLLM, covering Proxy server setup, cost tracking, rate limiting, load balancing, and production deployment.
2026-03-20 · 15 min read #architecture#litellm#llm#ai-gateway#mlops