well one would think that they could at least get power redundancy right... On Sat, Jun 30, 2012 at 1:07 AM, Roy <r.engehausen@gmail.com> wrote:
On 6/29/2012 10:38 PM, jamie rishaw wrote:
you know what's happening even more?
..Amazon not learning their lesson.
they just had an outage quite similar.. they "performed a full audit" on electrical systems worldwide, according to the rfo/post mortem.
looks like they need to perform a "full and we mean it" audit, and like I've been doing/participating in at dot coms for a decade plus: Actually Do Regular Load tests..
Related/equally to blame: companies that rely heavily on one aws zone, or arguably "one cloud" (period), are asking for it.
Please stop these crappy practices, people. Do real world DR testing. Play "What If This City Dropped Off The Map" games, because tonight, parts of VA infact did.
...
I am not a computer science guy but been around a long time. Data centers and clouds are like software. Once they reach a certain size, its impossible to keep the bugs out. You can test and test your heart out and something will slip by. You can say the same thing about nuclear reactors, Apollo moon missions, the NorthEast power grid, and most other technology disasters.