Short Outages Are Breaking Your On-Call Process
Short outages now end before on-call responds. Retune alerting, escalation, and reviews for high frequency cloud incidents.

The biggest reliability story of 2026 is not one catastrophic meltdown. It is the drumbeat of short outages: twenty minute connectivity blips, single region degradations, and partial service failures that begin and end before most on-call engineers have finished reading the first alert. AWS has now logged four notable incidents in four months, two of them tracing to the same network path out of US-WEST-2. Cloudflare's status page recorded thirteen separate incidents inside a single eight day stretch in August. Neither pattern produced a fifteen hour disaster, and that is precisely the problem. Your escalation policy, your alert thresholds, and your postmortem criteria were almost certainly designed for the disaster.
This post covers why short outages have become the dominant failure mode, what they quietly break in a conventional on-call setup, and how to retune alerting, escalation, and review so your team actually learns something from an incident that lasted less time than your daily standup.
Why short outages are now the dominant failure mode
Cloud providers have gotten dramatically better at containing blast radius. Regional isolation works. Cell based architecture works. Automated remediation works. The result is that the catastrophic, everything down, fifteen hour event has become rarer, while the number of small, sharp, partially scoped incidents has gone up. From a provider's perspective that is progress. From an on-call engineer's perspective it is a completely different job.
The AWS pattern: four incidents in four months
Look at AWS's 2026 record as reported by Tech Insider's running timeline. In May, a chiller hardware failure in a single Northern Virginia availability zone caused a thermal event and roughly fourteen hours of cooling recovery. In June, a network level disruption linked to a third party transit provider rippled across multiple regions. On July 24, an internet connectivity and networking hardware problem on the path between US-WEST-2 and the Seattle metro area took out Apple Pay, DoorDash, Reddit, Hulu, and PlayStation Network for about eighty minutes. In August, a second, shorter connectivity issue hit the same region and the same network path, resolved in a twenty minute window, followed by a twelve minute reconvergence event.
That August incident is the one worth sitting with. Twenty minutes of impact, plus a twelve minute tail of intermittent routing. No consumer app impact confirmed publicly. If your team runs in US-WEST-2, that incident happened to you, and there is a real chance nobody was paged, nobody acknowledged, and nobody wrote it down. It simply resolved.
The Cloudflare cluster: thirteen incidents in eight days
The same shape shows up at the edge. Between August 7 and August 14, Cloudflare logged thirteen separate incidents touching R2 object storage, Durable Objects, Workers KV, Workers AI, and network performance across four continents, according to coverage of the cluster and Cloudflare's own public incident history. The list included 503 errors on Magic Transit, elevated errors on Workers KV, authentication failures on a portal, and regional 5xx spikes in Kuwait, Bangkok, Jakarta, and Dammam.
Almost none of those would trip a global availability alert. A 5xx spike confined to Jakarta does not move a worldwide error rate graph. It absolutely moves the experience of every user in Jakarta. If you sell into that market, that was an outage. If your monitoring aggregates globally, it was a rounding error.
The background noise nobody counts
Underneath the named incidents there is a constant floor of network events. Network World's 2026 outage tracking counted 502 global network outage events in a single week in August across ISPs, cloud provider networks, collaboration app networks, and edge networks. One transit provider incident lasted thirty two minutes and hit multiple downstream customers across the United States.
Most of those never reach a status page you subscribe to. They reach your users. The gap between "our provider declared an incident" and "our customers had a bad time" has widened, and short outages live almost entirely inside that gap.
What short outages break in a traditional on-call setup
Conventional on-call design assumes an incident has a runway. Something breaks, monitoring notices, a page fires, an engineer wakes up, joins a bridge, forms a hypothesis, and mitigates. That sequence has a natural floor of fifteen to twenty five minutes even when it runs well. When the incident itself lasts twenty minutes, the entire sequence is a no op.
Escalation policies slower than the incident
A typical escalation policy pages the primary, waits five minutes, pages again, waits five more, then escalates to the secondary, then to a manager. That is fifteen minutes of ladder before a second human is even aware. For the August US-WEST-2 event, the incident would have been over before the secondary's phone rang. The policy did not fail loudly. It failed silently, which is worse, because nobody files a ticket about a policy that never got exercised.
Alert thresholds tuned for total failure
Thresholds like "error rate above five percent for ten minutes" exist to suppress noise, and they do that job well. They also guarantee you cannot detect a seven minute partial degradation. Teams end up in a trap: loosen the threshold and the pager becomes unbearable, tighten it and you become structurally blind to the most common failure mode you now face. Neither knob is the answer, because the problem is that one threshold is being asked to serve two different purposes.
The context gap at four in the morning
Even when the page does fire fast, the responder starts from zero. Which dependency is degraded? Did the provider declare anything? Did we deploy in the last hour? Is anyone else seeing this? On a long incident there is time to assemble that picture. On a twenty minute incident, assembling the picture is the incident. By the time the responder has three browser tabs open and a status page loading, routes have reconverged and the graph is green again.
Postmortem processes with a severity floor
Most teams review incidents above a severity bar, typically SEV2 and up, or anything over thirty minutes of impact. Short outages sit permanently below that bar. Individually that is defensible. Collectively it means the four AWS incidents, the thirteen Cloudflare incidents, and every brief provider blip in between generate exactly zero organizational learning. The pattern that matters, two AWS incidents on the identical Seattle metro network path, is only visible if you were writing the small ones down.
Retuning alerting for incidents that last twenty minutes
The goal is not to page more people more often. It is to separate detection from disturbance, so you can detect aggressively while paging conservatively.
Alert on user visible symptoms, not host health
Short outages rarely look like a dead host. They look like elevated latency on one route, a spike in 5xx from one region, or a client library retrying successfully but slowly. Symptom based alerting on request success rate, latency percentiles, and queue depth catches degradation that infrastructure alerts miss entirely. If your alert catalogue is mostly CPU, memory, and disk, you are instrumented for a class of failure that modern providers already handle for you.
Use two window burn rate alerts
Error budget burn rate alerting solves the threshold trap directly. A fast window, for example two percent of a thirty day budget consumed in one hour, catches sharp short incidents. A slow window, for example five percent consumed in six hours, catches the grinding degradations. Requiring both a short and a long window to agree before paging keeps false positives down while making a seven minute severe spike genuinely detectable. This is the single highest leverage change most teams can make, and it takes an afternoon.
Split "wake someone" from "tell someone"
Not every detection deserves a phone call, but every detection deserves a record. Practical severity routing for a high frequency world looks like this:
- Page immediately: fast burn rate breach on a customer facing SLO, or any signal that revenue impacting flows are failing. Phone, repeat, escalate.
- Post to the team channel with no page: regional degradation below the paging threshold, upstream provider status changes, single dependency latency shifts. Visible to whoever is awake, invisible to whoever is not.
- Log silently and aggregate: brief provider blips, single digit second timeouts, retries that succeeded. These feed the weekly pattern review, not the pager.
- Auto annotate: every deploy, feature flag change, and config push should land on the same timeline as the alerts, so correlation takes seconds rather than tab switching.
The third tier is where most teams have nothing at all, and it is where the AWS and Cloudflare pattern lives.
Rebuilding escalation for a twenty minute clock
Compress acknowledgement, not response
You cannot compress diagnosis. You can compress the time until a competent human knows something is happening. Cut the first escalation step to sixty or ninety seconds and notify the secondary in parallel rather than in sequence for your highest severity class. The cost is an occasional unnecessary notification to a second person. The benefit is that on a twenty minute incident you have humans engaged inside the first two minutes instead of the last two.
Make the first five minutes automatic
Everything a responder does in the opening minutes that a machine could have done is wasted incident time. When an incident opens, the tooling should already have created the channel, pulled the current on-call for every implicated service, attached the last ten deploys, fetched relevant provider status, linked the dashboards, and posted the runbook. That is not exotic automation. It is the difference between a responder starting at minute zero with context and starting at minute six with tabs.
Give the responder a dependency view
During a short provider incident the most valuable question is "is this us or is this them," and it needs answering in under two minutes. Teams that keep a live dependency panel, showing upstream provider status, third party API health, and recent internal changes side by side, resolve that question fast. Teams without one spend the entire incident window resolving it. Note that provider status pages are frequently the last thing to update, so treat your own synthetic checks against upstream endpoints as the faster signal.
A practical playbook for the next short outage
Concretely, here is what a team can run through in one sprint to be ready for the next twenty minute event:
- Inventory your single region exposure. List every production workload with no failover path. You are not committing to multi region, you are committing to knowing which services would have been down during the August US-WEST-2 blip.
- Add fast burn rate alerts to your top three user journeys. Login, checkout, and whatever your core write path is. One hour and six hour windows, paging only when both agree.
- Add regional breakdowns to your primary error dashboards. A global graph hides exactly the failures your providers are now producing.
- Run synthetic checks against upstream dependencies. Do not wait for a vendor status page. Probe the endpoints you actually call, from the regions you actually serve.
- Cut first escalation to ninety seconds for your top severity. Then run one game day to confirm the on-call rotation actually responds at that speed.
- Automate incident channel creation and context gathering. Measure the time from alert to "responder has full context" and drive it toward zero.
- Create a lightweight log for sub threshold events. One line each: time, symptom, suspected dependency, duration, whether a customer noticed.
- Review that log weekly, not per incident. Patterns emerge at the aggregate level, never at the individual event level.
None of these require a re-architecture, a vendor migration, or a headcount request. They are process and instrumentation changes, which is convenient, because process is exactly what short outages expose.
Why Slack is the right surface for high frequency incidents
When incidents were rare and long, it made sense for incident response to live in a dedicated tool that people logged into a few times a month. When incidents are frequent and short, the tool that wins is the one your engineers already have open. Every context switch costs a meaningful percentage of a twenty minute incident window.
This is the design bet behind Slack native on-call. With Pagerly, the rotation, the escalation, the incident channel, and the resolution all happen where the team already works. When an alert fires, the responder does not open a separate console to see who else is on-call, does not switch tools to page a database expert, and does not copy a timeline out of chat into a review document afterward. Schedules are visible in Slack, overrides and shift swaps happen with a message, and the incident conversation is already the incident record.
For short outages specifically, three properties matter most. First, acknowledgement happens in one tap from a notification the responder was already going to look at. Second, pulling in a second pair of eyes is a mention rather than a workflow, which matters when you have ninety seconds of useful decision time. Third, because the discussion happens in a channel, the retrospective is close to free, and cheap retrospectives are the only way sub threshold incidents ever get reviewed at all.
The point is not that a chat surface is inherently superior. It is that the cost of tool switching used to be amortized over hours of incident and now is not.
What to change in your postmortem process
Lower the review threshold, then aggregate
Writing a full postmortem for every twenty minute blip would crush a team, and nobody should try. The fix is to decouple recording from reviewing. Record everything, at one line of effort. Review in batches. A thirty minute weekly session looking at fifteen logged micro incidents produces better signal than fifteen individual documents nobody reads, and it surfaces the repeat offender dependency that no single incident report would have flagged.
Track patterns, not just root causes
The most useful finding in AWS's 2026 sequence is not any single root cause. It is that the July and August incidents both named the same network path between US-WEST-2 and the Seattle metro area. AWS has not said publicly whether they share a cause. For a customer, that is almost beside the point: a repeat on the same infrastructure is an actionable signal about where to put route diversity or failover budget, whether or not the underlying fault is identical.
Your internal equivalent exists too. It is the queue that backs up under the same conditions each month, the third party API that degrades every time its own provider deploys, the region that is always first to show 5xx. Those patterns only exist in aggregate. AWS's detailed writeup of the October 2025 US-EAST-1 event remains the gold standard for how much a public retrospective can teach, but you do not need that level of depth for a blip. You need the blip written down at all.
Ask a different set of questions
For short outages, the traditional postmortem questions are mostly unanswerable, because the incident ended before anyone acted. Ask these instead. Did we detect it? How long after impact started? Would a customer have told us before our monitoring did? Was the responder able to determine "us or them" quickly? Did anything about the response require a tool nobody had open? Answering those five reliably will improve your response more than a root cause you had no ability to influence.
Takeaways for reliability teams heading into Q4
The shape of failure has changed faster than the shape of on-call. Providers contained the blast radius, and the residual risk moved into a category most teams are not instrumented, staffed, or reviewed for. Here is the short version:
- Short outages are the norm now. Four AWS incidents in four months and thirteen Cloudflare incidents in eight days are not anomalies, they are the current baseline.
- Detection and paging are separate problems. Detect aggressively with burn rate alerts, page conservatively with severity routing, and log everything in between.
- Regional granularity is not optional. Global aggregates structurally hide the failures your providers now produce.
- Escalation ladders need a faster first rung. Ninety seconds to first acknowledgement, with parallel notification for your top severity.
- The first five minutes should be automated. Channel, context, deploys, dependency status, runbook, all assembled before the human arrives.
- Reduce tool switching. On a twenty minute clock, every console you have to open is a measurable fraction of your response budget.
- Record small incidents, review them in batches. Patterns live in aggregate, and the repeat offenders are where your remediation budget belongs.
None of this argues for panic about cloud reliability. AWS still runs an enormous amount of the internet extremely well, and the honest read of 2026 is that failures got smaller and more frequent rather than worse. But smaller and more frequent is a genuinely different operational problem, and teams that keep running a process designed for the fifteen hour outage will keep being surprised by the twenty minute one. Retune the alerting, compress the escalation, automate the first five minutes, and write down the small stuff. The next short outage is probably this week.
