Web, Payments, Bytes & Ventures

WPBV Radio

Tune into tech and money.

Cloudflare outage, 21 June 2022

The Cloudflare outage of 21 June 2022: what failed, why, and what Cloudflare changed, from its own incident report.

Provider
Cloudflare
Date
Duration, hours
1.3
Cause
Configuration change
Regions
19 busiest data centers (MCP locations) worldwide

Cloudflare BGP policy change takes 19 data centers offline (21 June 2022). The disruption lasted about 1 hour 15 minutes, according to Cloudflare’s own timeline.

What happened. A network configuration change to BGP prefix advertisement policies, part of a resilience project, was rolled out to the spines of 19 Multi-Colo PoP data centers. A re-ordering of policy terms withdrew a critical subset of prefixes, taking those locations offline; they handled about 50% of total requests.

What changes. Cloudflare will add MCP-specific test/deploy procedures, redesign the policy statement to prevent mis-ordering, and automate staggered rollouts with automated ‘commit-confirm’ rollback.

Questions

What caused the Cloudflare outage in June 2022?

A network configuration change to BGP prefix advertisement policies, part of a resilience project, was rolled out to the spines of 19 Multi-Colo PoP data centers.

Which services were affected?

Cloudflare network (CDN/proxy and services in affected locations).

Read how shared dependencies spread a failure in why one cloud outage can break unrelated apps, or browse the outage archive.

Started (UTC)
2022-06-21 06:27 UTC
Resolved (UTC)
2022-06-21 07:42 UTC
Services affected
Cloudflare network (CDN/proxy and services in affected locations)
Incident report
blog.cloudflare.com
Sources
SourceLink
Cloudflare incident reporthttps://blog.cloudflare.com/cloudflare-outage-on-june-21-2022/
WPBV Radio

What are you looking for?

Search by headline, topic or keyword.