Tag: #cost
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 6 posts
6 posts are tagged #cost; the most recent was published on 2026-08-14.
Often tagged together: #llm 3 #observability 3 #ai-gateway 1 #arc-agi 1 #benchmark 1
Most read in the last 90 days:
When Traces Become Cost — Retention, Sampling, and Masking in Langfuse
Tracing feels free at low traffic and then comes back as storage cost and a privacy problem. This post splits the points where volume turns into cost into four, confirms from the official documentation that sampling deci
2026-08-14 · 9 min read #observability#langfuse#cost#sampling#data-retentionReasoning Effort Is Not a Model Choice but a Per-Request Deployment Parameter
The DeepSeek V4 Flash 0731 results page published by ARC Prize carries not one score but three, one per reasoning effort level. This post computes what can actually be read out of those three numbers: that the same step
2026-08-09 · 8 min read #llm#benchmark#arc-agi#inference#costCoding Agent Spend Is Controlled by Friction, Not by Caps
Two engineering posts Databricks published back to back in July and August 2026 show that the handling of coding agent spend is moving away from budget caps and toward a gateway plus progressive friction. This post takes
2026-08-09 · 8 min read #mlops#llm#cost#ai-gateway#developer-productivityThe Claim of 100x Cheaper Is True Only When the Task Was Narrowed — Verification and Break-Even
A case study published in August 2026 reports that a 4-billion-parameter-class open model, post-trained with reinforcement learning, matched frontier models on a retrieval task while cutting per-request cost by an order
2026-08-09 · 8 min read #llm#cost#fine-tuning#retrieval#open-modelsPutting Observability Data Into ClickHouse — Schema, Rollups, TTL, and Splitting the Work ♪ Listenable
When traces and logs grow to multiple terabytes a day, a single search engine or time-series database starts to buckle. This post lays out why ClickHouse fits observability data so well, in terms of columnar storage, com
2026-08-02 · 16 min read #observability#clickhouse#opentelemetry#data-modeling#costMaking Logs Searchable, and Not Going Broke Doing It — Structuring, Mapping Explosions, Retention, and Real Cost
The point where log costs overtake compute costs arrives for most organizations. What delays that point isn't the compression ratio — it's the decision about what becomes a field. This post covers field design for struct
2026-08-02 · 15 min read #observability#logging#opensearch#elasticsearch#cost