Tag: #routing
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 4 posts
MoE Routing — How an Expert Gets Picked
Reading the config fields of a mixture-of-experts layer against real models. Comparing Mixtral 2-of-8, Qwen3 8-of-128, the 256 routed experts plus a shared expert in DeepSeek-V3, and the sparsity of 48 in Kimi K2, then w
2026-08-12 · 6 min read #ai-papers#model-internals#mixture-of-experts#moe#routingWhat ROV Blocked, What ASPA Still Can't — the June 2026 Telegram Hijack and the Next Layer of Routing Security ♪ Listenable
On June 16, 2026, India's Rcom (AS18101) hijacked Telegram's prefixes, and Kentik's measurement shows the hijacked path reached only 1.6% of Kentik's own BGP sources — a case where RPKI ROV actually worked. But that's be
2026-07-16 · 23 min read #network#bgp#rpki#routing#securityCloudflare AI Gateway Practical Guide: Observability, Reliability, and Cost Control for AI Traffic
A practical, current guide to Cloudflare AI Gateway as of April 12, 2026, covering observability, caching, retries, rate limiting, model fallback, and Dynamic Routing.
2026-04-12 · 5 min read #ai-platform#cloudflare#ai-gateway#observability#cachingLLM Routing and Cascade Strategy: Cost Optimization with Multi-Model Orchestration ♪ Listenable
Covers how to optimize cost with LLM routing and cascade strategies. Builds everything from query-complexity routing, model cascades, semantic routers and the FrugalGPT approach through to a production multi-model orches
2026-03-08 · 26 min read #llm#routing#cascade#model-orchestration#cost-optimization