Still feeling the effects -- this outage was big. 2000 (That's right, TWO THOUSAND) DS3s were down for 12 hours or more. Alcatel has been on-site for 9 of them. Chris -----Original Message----- From: Alex Rubenstein [mailto:alex@nac.net] Sent: Tuesday, November 23, 1999 12:21 AM To: nanog@merit.edu Subject: Re: Majore North Jersey outage... Just spoke to Bell Atl, major DACS failure in 'newark-2', aka 95 williams st., newark. On Tue, 23 Nov 1999, Alex Rubenstein wrote:
Reports coming in from throughout the state show Fast Packet services (Frame, ATM), 411, 911, 0, 800, 900 services not working in much of north jersey (LATA 224).
Details to follow...
Was big? IS big... I watched all the BellAtlantic.net circuits into the ATM cloud come up while ours still languishes... Alex has the scoop, but I understand there's only 50% or so restored now. No real good info from anyone on what the cause is. They mumbled something about fiber and electricity on the support line, Northpoint said it was a botched upgrade... Charles On Tue, 23 Nov 1999, Martin, Christian wrote:
Still feeling the effects -- this outage was big. 2000 (That's right, TWO THOUSAND) DS3s were down for 12 hours or more. Alcatel has been on-site for 9 of them.
Chris
-----Original Message----- From: Alex Rubenstein [mailto:alex@nac.net] Sent: Tuesday, November 23, 1999 12:21 AM To: nanog@merit.edu Subject: Re: Majore North Jersey outage...
Just spoke to Bell Atl, major DACS failure in 'newark-2', aka 95 williams st., newark.
On Tue, 23 Nov 1999, Alex Rubenstein wrote:
Reports coming in from throughout the state show Fast Packet services (Frame, ATM), 411, 911, 0, 800, 900 services not working in much of north jersey (LATA 224).
Details to follow...
It's a DACs upgrade that went awry. It's been an interesting day. On Tue, 23 Nov 1999, Charles Sprickman wrote:
Was big? IS big... I watched all the BellAtlantic.net circuits into the ATM cloud come up while ours still languishes...
Alex has the scoop, but I understand there's only 50% or so restored now. No real good info from anyone on what the cause is. They mumbled something about fiber and electricity on the support line, Northpoint said it was a botched upgrade...
Charles
On Tue, 23 Nov 1999, Martin, Christian wrote:
Still feeling the effects -- this outage was big. 2000 (That's right, TWO THOUSAND) DS3s were down for 12 hours or more. Alcatel has been on-site for 9 of them.
Chris
-----Original Message----- From: Alex Rubenstein [mailto:alex@nac.net] Sent: Tuesday, November 23, 1999 12:21 AM To: nanog@merit.edu Subject: Re: Majore North Jersey outage...
Just spoke to Bell Atl, major DACS failure in 'newark-2', aka 95 williams st., newark.
On Tue, 23 Nov 1999, Alex Rubenstein wrote:
Reports coming in from throughout the state show Fast Packet services (Frame, ATM), 411, 911, 0, 800, 900 services not working in much of north jersey (LATA 224).
Details to follow...
On Tue, Nov 23, 1999 at 07:32:46PM -0500, Charles Sprickman wrote:
Alex has the scoop, but I understand there's only 50% or so restored now. No real good info from anyone on what the cause is. They mumbled something about fiber and electricity on the support line, Northpoint said it was a botched upgrade...
Last I heard, ~ 95% of their DACS shelves were restored (albeit in "simplex" mode), and ~ 80% of their circuits were back up. While most mission-critical services are now restored, some are not, most notably, a large hospital's DS3 ATM ports... More news to follow... -adam
Service is 90% up, 10% more to go. dacs is up in simplex mode, no redundancy per-shelf but as a whole traffic should flow with no effect noticeable by customers. Engineers will be working throughout the night on the b-side (redundant) end of each shelf. -jamie On Tue, Nov 23, 1999 at 01:51:41PM -0500, Martin, Christian wrote:
Still feeling the effects -- this outage was big. 2000 (That's right, TWO THOUSAND) DS3s were down for 12 hours or more. Alcatel has been on-site for 9 of them.
Chris
-----Original Message----- From: Alex Rubenstein [mailto:alex@nac.net] Sent: Tuesday, November 23, 1999 12:21 AM To: nanog@merit.edu Subject: Re: Majore North Jersey outage...
Just spoke to Bell Atl, major DACS failure in 'newark-2', aka 95 williams st., newark.
On Tue, 23 Nov 1999, Alex Rubenstein wrote:
Reports coming in from throughout the state show Fast Packet services (Frame, ATM), 411, 911, 0, 800, 900 services not working in much of north jersey (LATA 224).
Details to follow...
-- jamie rishaw (efnet:gavroche) -- Exodus Communications, Inc. Senior Network Engineer, Los Angeles / SoCal Data Centers
participants (5)
-
Adam Rothschild -
Alex Rubenstein -
Charles Sprickman -
Jamie Rishaw -
Martin, Christian