10.2.3 · Skill in Reliability engineering
Incident response
Handling outages and serious problems calmly and quickly.
Incident response covers detection, roles, communication, mitigation and follow-up. Mitigate first, investigate later. Blameless postmortems turn incidents into lasting improvements.
Resources
4- bookStart hereManaging incidents (Site Reliability Engineering, chapter 14) ↗Google SRE · 11 min
Clear roles and one person in charge, the simple structure that keeps an outage from turning into chaos.
- docsStart hereIncident response guide ↗PagerDuty · free guide
PagerDuty's own open incident process, from preparing on-call to running the response and the review.
- bookStart herePostmortem culture: learning from failure (Site Reliability Engineering, chapter 15) ↗Google SRE · 10 min
Blameless postmortems: writing up what happened so the system improves, not so someone gets blamed.
- docsGo deeperDifferent roles in incident response ↗PagerDuty · 8 min
What the incident commander, scribe and liaisons each do, so a small team knows who handles what.
Tools
none yetTools for this topic are being researched.