...

This gets me thinking about the backup generator that is supposed to be online.

Why didn't the generator kick-in before the UPS went down? Or, lets say, an automatic network monitor (ALA SNMP) that tells them when UPS power is about to run down (before the lights go out) so they can roll their generator into place.

It is amazing how many connectivity failures are power related. For an APC UPS, all it takes is a dedicated $500 sparcstation, the $99 powerchute UPS monitoring software, and a $99 modem attached to the sparc for sending out a text page every time the UPS coughs. Sorry for stating the obvious.