Tag: #sre
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 23 posts
23 posts are tagged #sre; the most recent was published on 2026-08-15.
Often tagged together: #reliability 8 #2026-03 6 #kubernetes 5 #postmortem 5 #devops 4
Most read in the last 90 days:
A Sense for Production — What Looks Different After You Have Been Through an Outage
Two people read the same design doc and one of them reads something else entirely: what logs exist when this breaks at three in the morning, how many minutes a rollback takes, and what happens to the data that already la
2026-08-15 · 7 min read #career#skills#sre#production#reliabilityThe Complete Guide to Error Handling: Designing Failure as Part of the Contract ♪ Listenable
This guide treats error handling as part of the interface contract rather than as exception syntax. It covers the two axes for classifying errors, the real axes of the exceptions-vs-return-values dispute, the rules for t
2026-08-15 · 22 min read #에러처리#재시도#rfc9457#타임아웃#관측가능성Diagnosing Kubernetes CrashLoopBackOff by Cause — What to Look At When the Logs Are Empty
A start-to-finish walkthrough of the situation where a Pod is stuck in CrashLoopBackOff but kubectl logs prints nothing. It starts with the precise meaning of BackOff — not a cause, but a restart delay that grows from 10
2026-07-26 · 14 min read #kubernetes#crashloopbackoff#troubleshooting#kubectl#sreUsing the Three Kubernetes Probes Properly — The Exact Boundaries of liveness, readiness, and startup
Three incidents — a pod with nothing wrong with it restarting on a schedule, a flood of 502s only right after a deploy, and a slow-starting application that never reaches Ready — all come out of probe design. After separ
2026-07-26 · 17 min read #kubernetes#liveness-probe#readiness-probe#graceful-shutdown#sreIncident Communication: Talking Through an Outage
When an outage hits, the technical fix is only half the job. This post covers the Incident Commander role and role separation, the status-update drumbeat you keep even when there is no news, the three questions every upd
2026-06-24 · 13 min read #incident#oncall#communication#sreOperator Best Practices and Anti-Patterns
A code-level rundown of what makes a good Operator and the common anti-patterns. From principles like a small API, idempotent reconcile, observability, and safe upgrades, through pitfalls like side-effect spam, status mi
2026-06-15 · 14 min read #kubernetes#operator#best-practices#reconcile#rbacBackstage in Production — TechDocs, Plugin Development, and the Production Checklist
Part 3 of the Backstage IDP series. Covers the docs-as-code pipeline with TechDocs and S3 publishing, frontend/backend plugin architecture and custom plugin development, the permission framework, upgrade strategy, and pe
2026-06-13 · 14 min read #backstage#techdocs#plugins#platform-engineering#devopsLoad/Performance Testing Tools 2026 — Deep Dive on k6, Locust, Vegeta, Gatling, Artillery, JMeter (Beyond JMeter)
Performance testing is still hard in 2026. But the tools have definitely gotten better. JS-scriptable k6, Python-friendly Locust, one-liner Vegeta, enterprise Gatling, YAML-quick Artillery, micro-benchmark wrk/wrk2 and a
2026-05-14 · 18 min read #load-testing#performance-testing#k6#locust#vegetaThe Complete DNS Guide — Resolvers, DNSSEC, DoH/DoT, Anycast, CoreDNS, and Everything Else (2025) ♪ Listenable
Everything about DNS — the history of the name system that started with hosts.txt, query flow (stub to recursive to root to TLD to authoritative), record types (A/AAAA/CNAME/MX/TXT/NS/SOA/SRV/CAA/HTTPS/SVCB), EDNS0 and p
2026-04-15 · 25 min read #dns#dnssec#doh#networking#securityAnatomy of Famous Postmortems — Learning From the Failures of Cloudflare, Fastly, AWS, Knight Capital, and GitLab
Cloudflare 2022 BGP, Fastly taking down half the internet in 2021, the AWS S3 typo of 2017, Knight Capital losing $440M in 8 minutes, the GitLab DB wipe, and more — the patterns and lessons extracted from famous failures
2026-04-15 · 12 min read #postmortem#sre#outage#reliability#cultureChaos Engineering Deep Dive — Netflix Simian Army, LitmusChaos/Chaos Mesh, AWS FIS, Game Day
Why Netflix started randomly killing production servers in 2010. From Chaos Monkey philosophy and the 4 principles, to the full Simian Army, LitmusChaos/Chaos Mesh/AWS FIS comparison, Game Day design, and blameless postm
2026-04-15 · 10 min read #chaos-engineering#sre#reliability#netflix#kubernetesChaos Engineering Complete Guide 2025: Resilience Testing, Chaos Monkey, Litmus, Game Day ♪ Listenable
Everything about Chaos Engineering! Chaos principles (hypothesis → experiment → observe → improve), Chaos Monkey/Litmus Chaos/Chaos Mesh, fault injection (network/CPU/memory/Pod/AZ), Game Day operations, progressive adop
2026-04-14 · 21 min read #chaos-engineering#resilience#chaos-monkey#litmus#fault-injectionSRE Practices Guide 2025: Incident Management, Postmortem, Error Budget, On-Call, Toil Elimination ♪ Listenable
Everything about SRE in practice! Incident management (detect → respond → recover → postmortem), Error Budget policy, On-Call operations (rotation/escalation/fatigue management), Toil elimination automation, SLO/SLI/SLA
2026-04-14 · 26 min read #sre#site-reliability#incident-management#postmortem#error-budgetPreventing IT Outages & Lab Setup Guide + Global Table Tennis News Analysis
Key elements for preventing IT system outages, effective lab environment setup, and an analysis of global table tennis tournaments and notable players.
2026-04-11 · 14 min read #culture#devops#reliability#sre#table-tennisObservability Complete Guide 2025: Making Systems Transparent with Prometheus, Grafana, and OpenTelemetry ♪ Listenable
Master the three pillars of observability (Metrics/Logs/Traces)! Prometheus queries (PromQL), Grafana dashboards, OpenTelemetry instrumentation, Jaeger distributed tracing, ELK/Loki logging, alerting strategies, SLI/SLO/
2026-03-23 · 16 min read #observability#monitoring#prometheus#grafana#opentelemetryDevOps/SRE Complete Guide: From CI/CD to Kubernetes and MLOps
A comprehensive guide covering DevOps and SRE fundamentals, Kubernetes operations, and AI/ML workflow automation with real-world code examples.
2026-03-17 · 13 min read #devops#sre#kubernetes#ci-cd#mlopsBlameless Postmortem and Incident Review Culture ♪ Listenable
A guide to building a blameless postmortem and incident review culture, covering facilitation techniques, action item tracking, and organizational learning.
2026-03-15 · 48 min read #culture#postmortem#incident-review#blameless#learning-organizationSLI/SLO/Error Budget-Based Reliability Engineering: A Practical Guide
A comprehensive guide to reliability engineering with SLI/SLO/Error Budget. Covers SLI selection, SLO target setting, Error Budget policies, Burn Rate alerts, and Prometheus-based implementation to build a complete relia
2026-03-13 · 13 min read #observability#sli#slo#error-budget#sreComplete Guide to Incident Management Communication: From Incident Declaration to Postmortem
A comprehensive guide to incident management communication for engineers. Covers incident declaration, real-time status updates, escalation, customer communication, and postmortem writing with practical templates and exp
2026-03-13 · 12 min read #english#incident-management#communication#postmortem#sreNetwork Troubleshooting Complete Guide — 6-Part Series Overview
An index post for a 6-part series on systematically diagnosing and resolving real-world network issues. Covers every layer from DNS resolution to cloud network architecture.
2026-03-08 · 8 min read #networking#troubleshooting#devops#sre