- NANOG - lists.nanog.org

Re: Important IPv6 Policy Issue -- Your Input Requested
by Jerry Eyers 10 Nov '04

10 Nov '04

"Get a firewall" is not a valid response when you have lusers to drop the latest netgear whatever onto their PC and dial to some provider somewhere. Your firewall is useless to protect that segment. In many cases NAT is the ONLY protection you end up with in this scenario, a scenario that is far to common in the corporate world. Jerry -------Original Message------- From: Theo de Whaat Date: 11/09/04 15:28:44 To: jeyers(a)sloancc.net Subject: Re: Important IPv6 Policy Issue -- Your Input Requested Get a firewall. You shouldn't rely on NAT to provide this functionality. How long has IPv6 been on the horizon, promising to make NAT unnecessary? >I want my inside addresses to be >non accessible from the 'real world', ever.

6 6

Sandvine
by Paul Bradford 10 Nov '04

10 Nov '04

I just want to thank everybody for the OL e-mails about sandvine...time will tell how successful service flow management tools like this will be... the geek inside sad bad bad bad messing with my packets.... Thanks, Paul -- Paul A. Bradford Senior Network Engineer Adelphia Communications AS19548 and AS7843 Voice: 814-274-1353 AIM: llyolf

1 0

OT: Akamai DNS and Yahoo
by John Neiberger 10 Nov '04

10 Nov '04

I saw many references about this in the archives but I haven't seen a solution to it and we just started seeing this problem. Beginning sometime very recently, our DNS servers are not able to resolve www.yahoo.com. I have no problem if I point my PC to an external DNS server, but when I point it back at our internal servers I get timeouts when trying to resolve that domain. A Google search turned up dozens of posts over the past few years regarding people not being able to resolve www.yahoo.com, but the solutions don't seem to apply to our environment. We're running a version of BIND 8 on Solaris 9, and it's likely that this behavior began this weekend after we applied the most recent patch cluster for Solaris 9 and rebooted the server. For quite a while, all external DNS was failing and we still have some odd intermittent problems but the most noticable issue that is 100% reproducible is the failure to resolve Yahoo addresses. I saw a few Usenet posts that mentioned this could be a problem with Extensions for DNS and the fact that DNS replies could be larger than 512 bytes. This would be a problem if you were behind a PIX firewall running a certain version of software and with a certain feature configured because it would drop all UDP DNS packets over 512 bytes. This doesn't really fit our environment so I'm still looking for answers. Any thoughts? Thanks, John --

2 1

Earth to someone with a clue at Verizon mail operations
by alex＠yuriev.com 09 Nov '04

09 Nov '04

Earth to someone Verizon... Earth to verizon... Come in verizon.... come in Verizon... We have an urgent message for you - This is called mail debugging 101. IF upon a successful authentication to your POP servers, the POP servers claim that there is no mail in the inbox while your webmail shows dozen of new unread unopened messages, (you are presented the printout of a telnet session to port 110 of mail.verizon.net)) THEN the claim that it is the "MTU on a customer DSL router" that is causing the problem is wrong especially if the problem manifests itself on a NON-DSL connection. Making these claims for several days after three levels of escalation makes your well-ran operation look incompetent. END IF;

1 0

RE: Newedge Networks meltdown?
by Peering 09 Nov '04

09 Nov '04

I can understand not wanting to get Alcatel support...we use Alcatel's NMS too and it's pricey for everything, support, upgrades, etc. (thank goodness it's now on the edge of our network and not on the core...hail Juniper!!). But you gotta do what you gotta do. I can't imagine us being down that hard that long before we got the vendor involved. Diane Turley Network Engineer Xspedius Communications Co. 636-625-7178 -----Original Message----- From: owner-nanog(a)merit.edu [mailto:owner-nanog@merit.edu] On Behalf Of netadm Sent: Tuesday, November 09, 2004 2:32 PM To: nanog(a)merit.edu Subject: RE: Newedge Networks meltdown? Statement from New Edge to Customers: ------------------------------------- Edger Customers and Partners, We are experiencing major network issues with our Alcatel Network Management System (NMS). Early last evening we had degradation in our primary NMS and we switched to our secondary backup NMS as per standard procedure. We then experienced similar degradation difficulties with our backup NMS. We have worked through the night on this and we have brought in Alcatel. Much of our network is stable. We estimate about 30% of our permanent virtual circuits (PVC) for customers may have been impacted. Customer affecting symptoms can take the form of performance degradation on a circuit or an actual outage in the form of failure to sync at Layer 3. We are now back on our primary NMS and we believe we have this situation stabilized. We are rebuilding our customer PVC's and the situation should improve throughout the day. We have added extra resources in NOC and our call centers. Our Service Level Agreements (SLA) call for 99.5 % up time and we have always far surpassed these SLA targets. This is the first outage of its type in the five year history of New Edge Networks. We are deeply embarrassed by this network outage and we apologize to our customers. We will do everything possible to fix this and we will communicate on the hour as we do so. Dan Moffat CEO New Edge Networks -----Original Message----- From: Bubba Parker [mailto:sysadmin@citynetwireless.net] Sent: Tuesday, November 09, 2004 11:10 AM To: Mark Radabaugh Cc: nanog(a)merit.edu Subject: Re: Newedge Networks meltdown? I had a DS3 go down with them last night, they said that a lot of their PVCs all showed active must had to be bounced to continue working, and they'd only know which ones were down if people called and told so. On Tue, Nov 09, 2004 at 07:40:36AM -0500, Mark Radabaugh wrote: > > Seems there is a major problem within NewEdge networks this morning. > From the recording on the NOC line it sounds like they lost an internal > database and PVC's at many of the switches. > > Anyone know what happened? Let the speculation begin :-) > > Mark Radabaugh > Amplex > -- Bubba Parker sysadmin(a)citynetwireless.net CityNet LLC http://www.citynetinfo.com/

1 0

RE: Newedge Networks meltdown?
by netadm 09 Nov '04

09 Nov '04

Statement from New Edge to Customers: ------------------------------------- Edger Customers and Partners, We are experiencing major network issues with our Alcatel Network Management System (NMS). Early last evening we had degradation in our primary NMS and we switched to our secondary backup NMS as per standard procedure. We then experienced similar degradation difficulties with our backup NMS. We have worked through the night on this and we have brought in Alcatel. Much of our network is stable. We estimate about 30% of our permanent virtual circuits (PVC) for customers may have been impacted. Customer affecting symptoms can take the form of performance degradation on a circuit or an actual outage in the form of failure to sync at Layer 3. We are now back on our primary NMS and we believe we have this situation stabilized. We are rebuilding our customer PVC's and the situation should improve throughout the day. We have added extra resources in NOC and our call centers. Our Service Level Agreements (SLA) call for 99.5 % up time and we have always far surpassed these SLA targets. This is the first outage of its type in the five year history of New Edge Networks. We are deeply embarrassed by this network outage and we apologize to our customers. We will do everything possible to fix this and we will communicate on the hour as we do so. Dan Moffat CEO New Edge Networks -----Original Message----- From: Bubba Parker [mailto:sysadmin@citynetwireless.net] Sent: Tuesday, November 09, 2004 11:10 AM To: Mark Radabaugh Cc: nanog(a)merit.edu Subject: Re: Newedge Networks meltdown? I had a DS3 go down with them last night, they said that a lot of their PVCs all showed active must had to be bounced to continue working, and they'd only know which ones were down if people called and told so. On Tue, Nov 09, 2004 at 07:40:36AM -0500, Mark Radabaugh wrote: > > Seems there is a major problem within NewEdge networks this morning. > From the recording on the NOC line it sounds like they lost an internal > database and PVC's at many of the switches. > > Anyone know what happened? Let the speculation begin :-) > > Mark Radabaugh > Amplex > -- Bubba Parker sysadmin(a)citynetwireless.net CityNet LLC http://www.citynetinfo.com/

1 0

RE: Newedge Networks meltdown?
by Kathryn Kessey 09 Nov '04

09 Nov '04

> Anyone know what happened? Let the speculation begin :-) they use alcatel's centralized nms with one nms instance to reroute all paths (no rerouting capability without the nms, no pnni.) They won't pay for upgrades or support, and have such a contentious relationship with alcatel that alcatel demands cash to answer a support call (and that's not alcatel's fault.) Once they had a major nms database problem, it took their finance staff ~8 hours of outage time to decide to spend the money for the support call, then the ceo demanded to know why their support staff took so long to fix the problem. Don't yell at their support people, this attitude comes from the top. -----Original Message----- From: owner-nanog(a)merit.edu [mailto:owner-nanog@merit.edu]On Behalf Of Bubba Parker Sent: Tuesday, November 09, 2004 10:10 AM To: Mark Radabaugh Cc: nanog(a)merit.edu Subject: Re: Newedge Networks meltdown? I had a DS3 go down with them last night, they said that a lot of their PVCs all showed active must had to be bounced to continue working, and they'd only know which ones were down if people called and told so. On Tue, Nov 09, 2004 at 07:40:36AM -0500, Mark Radabaugh wrote: > > Seems there is a major problem within NewEdge networks this morning. > From the recording on the NOC line it sounds like they lost an internal > database and PVC's at many of the switches. > > Anyone know what happened? Let the speculation begin :-) > > Mark Radabaugh > Amplex > -- Bubba Parker sysadmin(a)citynetwireless.net CityNet LLC http://www.citynetinfo.com/

1 0

Verizon mail operations
by alex＠yuriev.com 09 Nov '04

09 Nov '04

Hi, If someone from Verizon's mail operations could kindly drop me a note I would greatly appreciate it. Thanks, Alex

1 0

Newedge Networks meltdown?
by Mark Radabaugh 09 Nov '04

09 Nov '04

Seems there is a major problem within NewEdge networks this morning. From the recording on the NOC line it sounds like they lost an internal database and PVC's at many of the switches. Anyone know what happened? Let the speculation begin :-) Mark Radabaugh Amplex

2 1

RE: Newedge Networks meltdown?
by James Laszko 09 Nov '04

09 Nov '04

More info on this --- when the circuit crashed, apparently all the reroutes caused an NMS crash and the path databases were all blown up.... James Laszko Pipeline Communications, Inc. james(a)pcipros.com -----Original Message----- From: owner-nanog(a)merit.edu [mailto:owner-nanog@merit.edu] On Behalf Of Mark Radabaugh Sent: Tuesday, November 09, 2004 4:41 AM To: nanog(a)merit.edu Subject: Newedge Networks meltdown? Seems there is a major problem within NewEdge networks this morning. From the recording on the NOC line it sounds like they lost an internal database and PVC's at many of the switches. Anyone know what happened? Let the speculation begin :-) Mark Radabaugh Amplex

1 0