Tag: #cost-optimization
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 15 posts
15 posts are tagged #cost-optimization; the most recent was published on 2026-08-14.
Often tagged together: #2026-03 6 #llm 5 #2026-04 3 #observability 3 #opentelemetry 3
Most read in the last 90 days:
Gemini 3.7 Flash, Its Introductory Price and Its Three-Week Cadence — Why Model Cost Is a Conditional Value, Not a Fixed One
What a practitioner should take from the Gemini 3.7 Flash announcement is not the size of the benchmark gains but two other things: an introductory price that doubles on a named date, and the fact that the previous model
2026-08-14 · 7 min read #llm#cost-optimization#benchmark#api-design#capacity-planningThe Block-Level Confidence Scores in Mistral OCR 4.1 — The Value That Decides Where People Go in a Document Pipeline
Mistral released OCR 4.1 with paragraph-level bounding boxes, structural block labels, and block-level confidence scores. For anyone who has built a document pipeline, the third one is what matters, because confidence sc
2026-08-14 · 6 min read #ocr#document-ai#data-pipeline#human-in-the-loop#cost-optimizationLLM API Cost Optimization — Break-Even Math for Output Tokens, Prompt Caching and Routing
Cutting an LLM API bill in half is arithmetic, not intuition. Because output tokens cost several times what input tokens cost, the biggest lever is almost always controlling output length, with prompt caching next. This
2026-07-26 · 12 min read #llm#cost-optimization#prompt-caching#rag#model-routingHow to Actually Cut Your LLM API Bill — Why "90% Off From Caching" Is 25% on the Invoice ♪ Listenable
A prompt cache read costs one-tenth of the input price. But that does not take 90% off your invoice. Follow the worked example Anthropic publishes in its own docs and, even with the cache fully warm, the total drops only
2026-07-17 · 22 min read #llm#cost-optimization#prompt-caching#api#aiIngress Multitenancy and Cost Optimization — A Platform Teams Choice
The trade-offs of a shared controller vs per-tenant controllers, namespace isolation, load balancer cost, resource quotas, noisy-neighbor prevention, security boundaries, and showback models — multi-tenant Ingress operat
2026-06-14 · 9 min read #ingress#kubernetes#networking#multitenancy#devopsAWS Well-Architected Framework Complete Guide 2025: Six Pillars, Practical Adoption, Cost/Security/Performance
Everything about the AWS Well-Architected Framework: six pillars (Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, Sustainability), practical checklists, Well-Architected Tool usa
2026-04-15 · 14 min read #aws#well-architected#cloud-architecture#security#reliabilityServerless Architecture Patterns Complete Guide 2025: Lambda, Step Functions, Event Sourcing, Cost Optimization ♪ Listenable
Everything about Serverless patterns! Lambda design patterns (single purpose/monolithic/fan-out), Step Functions (state machines/workflows), Cold Start optimization, Provisioned Concurrency, Serverless DB (Aurora Serverl
2026-04-14 · 23 min read #serverless#lambda#step-functions#event-driven#cold-startPrompt Caching for Agent Apps: A Practical Guide to Lower Cost and Latency
A practical guide to prompt caching for agent applications, including why it matters, how OpenAI and Anthropic differ, prompt structuring patterns, ROI scenarios, common mistakes, and a migration checklist.
2026-04-12 · 7 min read #prompt-caching#latency#cost-optimization#ai-agent#llmopsAWS Dynamic Infrastructure Complete Guide: Auto Scaling, Spot Instances, and IaC for 90% Cost Savings ♪ Listenable
A complete guide to automatically creating AWS infrastructure when needed and removing it when not. EC2 Auto Scaling, Spot Instances (90% discount), Lambda, Fargate, Terraform/CDK IaC — practical strategies to dramatical
2026-03-23 · 31 min read #aws#ec2#auto-scaling#spot-instances#terraform1 Million Token Context Windows: Is RAG Becoming Obsolete?
With Gemini 1.5 Pro's 1M token context and Claude's 200K, many developers ask: why bother with RAG? We compare real costs, latency, and quality to give you an honest answer.
2026-03-18 · 6 min read #context-window#rag#llm#long-context#ai-developmentKubernetes FinOps and Cloud Cost Optimization ♪ Listenable
A practical guide to Kubernetes FinOps and cloud cost optimization strategies, covering resource rightsizing, spot instances, and cost allocation.
2026-03-15 · 21 min read #kubernetes#finops#cost-optimization#cloud#resource-managementObservability Data Pipeline Cost Optimization: Sampling, Filtering, and Tiering Strategies ♪ Listenable
A strategy guide for solving cost issues from observability data explosion. Covers OpenTelemetry Collector-based sampling policies, log filtering pipelines, metric cardinality management, storage tiering architecture, an
2026-03-08 · 25 min read #observability#cost-optimization#sampling#opentelemetry#telemetry-pipelineLLM Routing and Cascade Strategy: Cost Optimization with Multi-Model Orchestration ♪ Listenable
Covers how to optimize cost with LLM routing and cascade strategies. Builds everything from query-complexity routing, model cascades, semantic routers and the FrugalGPT approach through to a production multi-model orches
2026-03-08 · 26 min read #llm#routing#cascade#model-orchestration#cost-optimizationObservability Telemetry Pipeline Cost Optimization: Sampling, Filtering, and Tiering Strategies
A practical guide to tackling observability cost explosion. Covers OpenTelemetry Collector-based sampling policies, log filtering pipelines, metric cardinality management, storage tiering architecture, and a phased optim
2026-03-08 · 7 min read #english#observability#cost-optimization#opentelemetry#telemetry-pipelineJapanese Observability Telemetry Pipeline Cost Optimization Guide
A practical guide to observability telemetry pipeline cost optimization in Japanese.
2026-03-08 · 8 min read #japanese#observability#cost-optimization#opentelemetry#telemetry-pipeline