Tag: #prompt-caching
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 6 posts
6 posts are tagged #prompt-caching; the most recent was published on 2026-07-31.
Often tagged together: #cost-optimization 3 #llm 3 #2026-04 2 #ai 2 #model-routing 2
Most read in the last 90 days:
GPT-5.6 and the Limits of Price-Performance — How to Find Your Workload's Place on the Curve
On July 30, 2026, OpenAI cut GPT-5.6 Luna by 80% and Terra by 20%. That is three weeks after the July 9 general availability, and the top-end Sol price is unchanged. Luna went from 1 dollar input and 6 dollars output per
2026-07-31 · 12 min read #ai#llm#openai#inference-cost#prompt-cachingLLM API Cost Optimization — Break-Even Math for Output Tokens, Prompt Caching and Routing
Cutting an LLM API bill in half is arithmetic, not intuition. Because output tokens cost several times what input tokens cost, the biggest lever is almost always controlling output length, with prompt caching next. This
2026-07-26 · 12 min read #llm#cost-optimization#prompt-caching#rag#model-routingHow to Actually Cut Your LLM API Bill — Why "90% Off From Caching" Is 25% on the Invoice ♪ Listenable
A prompt cache read costs one-tenth of the input price. But that does not take 90% off your invoice. Follow the worked example Anthropic publishes in its own docs and, even with the cache fully warm, the total drops only
2026-07-17 · 22 min read #llm#cost-optimization#prompt-caching#api#aiPrompt Caching for Agent Apps: A Practical Guide to Lower Cost and Latency
A practical guide to prompt caching for agent applications, including why it matters, how OpenAI and Anthropic differ, prompt structuring patterns, ROI scenarios, common mistakes, and a migration checklist.
2026-04-12 · 7 min read #prompt-caching#latency#cost-optimization#ai-agent#llmopsGPT-5 for Developers: A Practical Guide to Agentic Coding, Tools, and Cost Control
A practical guide to GPT-5 for developers, covering what changed from earlier workflows, how to choose model sizes and controls, and how to ship agentic coding systems with better latency and cost discipline.
2026-04-12 · 7 min read #openai#gpt-5#coding#agentic-coding#tool-usePractical LLM API Cost Optimization: How to Cut Costs by 90%
Five battle-tested strategies to slash LLM API costs — prompt caching (90% reduction), model routing, semantic caching, Batch API, and output optimization — all with production-ready code and real cost calculations.
2026-03-18 · 12 min read #llm-cost-optimization#api-cost#prompt-caching#model-routing#ai-development