DE-CIX - Wednesday 11:00am - 1:30pm Eastern
Does anyone here know any more about what crashed in the DE-CIX NYC exchange yesterday between approximately 11am and 1:30pm? Between those times I'm told the Nokia switching fabric locked up and ultimately rebooted.
All, For clarification, DE-CIX New York operates over a dozen switches as part of our local switch fabric. ONE of our switches malfunctioned for about a two hour period prior to rebooting and that caused problems for customer networks connected to that switch during that period. All other switches were not impacted and the DE-CIX New York exchange did not go down. Ed d'Agostino ________________________________ From: NANOG <nanog-bounces+ed.dagostino=de-cix.net@nanog.org> on behalf of Matt Hoppes <mattlists@rivervalleyinternet.net> Sent: Thursday, October 29, 2020 11:29:03 AM To: North American Network Operators' Group; outages-discussion@outages.org Subject: DE-CIX - Wednesday 11:00am - 1:30pm Eastern Does anyone here know any more about what crashed in the DE-CIX NYC exchange yesterday between approximately 11am and 1:30pm? Between those times I'm told the Nokia switching fabric locked up and ultimately rebooted.
Hi Ed, Thank you for that clarification. On 10/29/20 12:05 PM, Ed dAgostino wrote:
All,
For clarification, DE-CIX New York operates over a dozen switches as part of our local switch fabric. ONE of our switches malfunctioned for about a two hour period prior to rebooting and that caused problems for customer networks connected to that switch during that period. All other switches were not impacted and the DE-CIX New York exchange did not go down.
Ed d'Agostino
------------------------------------------------------------------------ *From:* NANOG <nanog-bounces+ed.dagostino=de-cix.net@nanog.org> on behalf of Matt Hoppes <mattlists@rivervalleyinternet.net> *Sent:* Thursday, October 29, 2020 11:29:03 AM *To:* North American Network Operators' Group; outages-discussion@outages.org *Subject:* DE-CIX - Wednesday 11:00am - 1:30pm Eastern Does anyone here know any more about what crashed in the DE-CIX NYC exchange yesterday between approximately 11am and 1:30pm?
Between those times I'm told the Nokia switching fabric locked up and ultimately rebooted.
On Thu, Oct 29, 2020 at 11:10 AM Matt Hoppes < mattlists@rivervalleyinternet.net> wrote:
Hi Ed, Thank you for that clarification.
On 10/29/20 12:05 PM, Ed dAgostino wrote:
All,
For clarification, DE-CIX New York operates over a dozen switches as part of our local switch fabric. ONE of our switches malfunctioned for about a two hour period prior to rebooting and that caused problems for customer networks connected to that switch during that period. All other switches were not impacted and the DE-CIX New York exchange did not go down.
Ed d'Agostino
It looks as though something's going on again right now. I just lost sessions to one of the two route servers, and some but not all of my other peers on DE-CIX NY. Matt Harris|Infrastructure Lead Engineer 816-256-5446|Direct Looking for something? Helpdesk Portal|Email Support|Billing Portal We build and deliver end-to-end IT solutions.
Hi Matt, please open a ticket with support@de-cix.net and/or call +1-212-796-6914 so that we can have a direct communication with you. We will work with you on resolving the issue right away. Best regards, Thomas -- Dr. Thomas King Chief Technology Officer (CTO) DE-CIX Management GmbH | Lindleystraße 12 | 60314 Frankfurt am Main | Germany | www.de-cix.net | Phone +49 69 1730902 87 | Mobile +49 175 1161428 | Fax +49 69 4056 2716 | thomas.king@de-cix.net | Geschaeftsfuehrer Harald A. Summa and Sebastian Seifert | Registergericht AG Koeln HRB 51135 DE-CIX 25th anniversary: Without you the Internet would not be the same! Join us on the journey at https://withoutyou.de-cix.net From: NANOG <nanog-bounces+thomas.king=de-cix.net@nanog.org> on behalf of Matt Harris <matt@netfire.net> Date: Thursday, 29. October 2020 at 23:19 To: Matt Hoppes <mattlists@rivervalleyinternet.net> Cc: North American Network Operators' Group <nanog@nanog.org> Subject: Re: DE-CIX - Wednesday 11:00am - 1:30pm Eastern Matt Harris | Infrastructure Lead Engineer 816‑256‑5446 | Direct Looking for something? Helpdesk Portal | Email Support | Billing Portal We build and deliver end‑to‑end IT solutions. On Thu, Oct 29, 2020 at 11:10 AM Matt Hoppes <mattlists@rivervalleyinternet.net> wrote: Hi Ed, Thank you for that clarification. On 10/29/20 12:05 PM, Ed dAgostino wrote:
All,
For clarification, DE-CIX New York operates over a dozen switches as part of our local switch fabric. ONE of our switches malfunctioned for about a two hour period prior to rebooting and that caused problems for customer networks connected to that switch during that period. All other switches were not impacted and the DE-CIX New York exchange did not go down.
Ed d'Agostino
It looks as though something's going on again right now. I just lost sessions to one of the two route servers, and some but not all of my other peers on DE-CIX NY.
participants (4)
-
Ed dAgostino -
Matt Harris -
Matt Hoppes -
Thomas King