Operations | Monitoring | ITSM | DevOps | Cloud

The latest News and Information on Incident Management, On-Call, Incident Response and related technologies.

Incident Response Lessons From a 3 GW Grid Drop

When a transmission line faulted in Ashburn, Virginia on July 22, 2026, more than 3 GW of data center load vanished from the PJM grid in seconds. That is roughly three percent of total grid demand at the moment it happened, and the grid took about ten minutes to stabilize instead of the milliseconds a routine disturbance normally requires. For anyone who owns a pager, this is more than an energy story.

Cloud Outage Preparedness: On-Call Lessons for 2026

Cloud outage preparedness stopped being a nice-to-have this month. In a span of roughly 48 hours, Microsoft Azure lost a big chunk of its West US footprint and Amazon Web Services dropped connectivity between its us-west-2 region in Oregon and the Seattle metro. The AWS event alone rippled outward and knocked DoorDash, Reddit, Hulu, Apple Pay, Snapchat, Fortnite, and the PlayStation Network offline for millions of users, according to incident trackers. Neither outage was caused by anything exotic.

Cloud Outage Incident Response: Lessons From 2026

Cloud outage incident response stopped being a hypothetical exercise this summer. In a single stretch of July 2026, three of the biggest cloud providers stumbled in quick succession, and the ripple effects reached apps that millions of people use every day. If your team runs anything on a hyperscaler, the events of the last few weeks are a direct message: the question is no longer whether your provider will have a bad day, but whether your on-call rotation is ready when it does.

When Status Pages Lie: The Incident Detection Gap

On July 28, 2026, roughly 30,000 people flooded Downdetector with reports that Reddit was broken. Feeds would not load, logins failed, and the mobile app hung. Reddit's own status page, meanwhile, showed a calm wall of green: all systems operational. That contradiction is the whole story, and it is not unique to Reddit. It is one of the most common and most damaging failure modes in modern on-call, and it has a name: the incident detection gap.

T-Mobile SOS Outage: Incident Response Lessons

When more than 140,000 people reach for their phones at once and see nothing but the letters SOS, the topic of incident response stops being an abstract engineering concern and becomes something everyone feels. That is exactly what happened on the evening of July 27 into the morning of July 28, 2026, when a nationwide T-Mobile outage knocked huge numbers of devices into SOS only mode, cutting people off from regular calls, texts, and data.

Dashboards aren't (quite) dead

Historically, non-technical stakeholders would’ve had most of their data questions answered either through pre-built dashboards or by asking their Data team (or equivalent). Self-serve analytics tools went a step further by offering safe, governed datasets built by Data teams which let non-technical users dig into data without having to worry about how it joins together, how metrics like “revenue” are defined, and so on.

Cloud Outage Response: Lessons From July's Bad Week

In a single week, two of the largest cloud providers on earth failed at almost the same time, and a good chunk of the internet went with them. Effective cloud outage response stopped being a theoretical exercise and became the difference between a calm 30 minutes and a chaotic afternoon for thousands of on-call engineers. On July 23, 2026, a maintenance bug inside Microsoft Azure pulled IP routes off more devices than intended in the West US region, cutting Microsoft 365 access for millions.

Cloud Outage Response: AWS us-west-2 Lessons

Cloud outage response got another live fire drill on July 24, 2026, when AWS lost network connectivity between its us-west-2 region in Oregon and the Seattle metro. For most customers the pain lasted about 20 minutes, and a small set on AWS Direct Connect saw errors for roughly an hour and seventeen minutes. That is short as major cloud incidents go. What makes it worth your attention is not the duration.