Amazon, Microsoft Cloud Datacenters Go Dark After Lightning Strikes
Lightning strikes in Dublin, Ireland on Sunday resulted in brief outages at separate cloud datacenters run by Amazon and Microsoft.
According to Amazon's publicly accessible service health dashboard, the lightning caused one of its "availability zones" in Dublin to experience a power outage on Sunday, 10:41 a.m. PDT. Besides hampering Amazon's Elastic Compute Cloud (EC2) service in Europe, the lightning also caused an explosion and fire that affected backup power systems.
"The transient electric deviation caused by the explosion was large enough that it propagated to a portion of the phase control system that synchronizes the backup generator plant, disabling some of them," the Amazon team wrote at 3:01 p.m. PDT. "Power sources must be phase-synchronized before they can be brought online to load. Bringing these generators online required manual synchronization."
By late in the day on Aug. 8, Amazon had completed copying over data from affected snapshots on its EC2 platform in Dublin, allowing customers to run a recovery tool. The team apparently was still working on "restoring connectivity to affected Single-AZ database instances" for its Amazon Relational Database Service in Ireland, according to the health dashboard.
Meanwhile, Microsoft simply reported on Aug. 7, via Twitter, that a "Europe data center power issue affects access to BPOS," referring customers to their private service health dashboards for updates. That this power outage was caused by the same lightning strikes in Dublin that affected Amazon's datacenter was explained in a Data Center Knowledge story. Microsoft referred customers to private dashboards used by Business Productivity Online Service customers for further information. The publicly accessible Microsoft online service notifications page described nothing about the Dublin datacenter problems.
Microsoft apparently restored services somewhat quickly after the lightning strike in Dublin, or within the day on Sunday. The last Twitter post about the Dublin BPOS service outage stated that "BPOS services are back online for EMEA customers."
Microsoft's press release (PDF) on the Dublin facility describes it as "the largest data center outside the United States." It was opened in July of 2009, and uses natural cooling except for "a few days per year." The datacenter uses half the power of comparable facilities according to the press release.
Kurt Mackie is senior news producer for the 1105 Enterprise Computing Group.