On Mon, 26 Oct 1998, Network Operations Center wrote:
??
anybody knowing what's going on with CW ??
Just got off the phone with their first-level trouble reporting. They say that "Someone put in a block against C&W, and the resulting traffic overloaded our backbone". I've been looking for a better answer to show up here -- if e-mail can get through to me. -Chris ========================================================== Chris Candreva -- chris@westnet.com -- (914) 967-7816 WestNet Internet Services of Westchester http://www.westnet.com/
I came across this last night.
1740 1239 1800 209 286 3561, (suppressed due to dampening) 198.32.136.55 from 198.32.136.55 (134.24.127.27) Origin IGP, valid, external Dampinfo: penalty 3342, flapped 6 times in 00:17:37, reuse in 00:32:20
Sincerely, Andy Walden System Administrator MTCO Communications 1-800-859-6826 On Mon, 26 Oct 1998, Christopher X. Candreva wrote:
On Mon, 26 Oct 1998, Network Operations Center wrote:
??
anybody knowing what's going on with CW ??
Just got off the phone with their first-level trouble reporting. They say that "Someone put in a block against C&W, and the resulting traffic overloaded our backbone".
I've been looking for a better answer to show up here -- if e-mail can get through to me.
-Chris
========================================================== Chris Candreva -- chris@westnet.com -- (914) 967-7816 WestNet Internet Services of Westchester http://www.westnet.com/
There have been two problems affecting the performance of our network in the past 24 hours. The first problem which has been hammered out on this list is the leaking of our routes by other providers. Our noc is still working with some other ISPs to get this issue resolved. Currently some large backbones are still seeing some more specific pieces of our netblocks that are not pointing directly to our network. In addition to this (and possibly caused by this) we had an increase in traffic in our San Francisco node. This increase congested one of our Fddi rings. This caused problems for a subset of our routers in the San Francisco area. Steps were taken to alleviate the immediate problem and it will be closely monitored. To be clear, the problem was localized to just a handful of routers and just to a single node. The congestion problem was fixed early this morning. I apologize for delay in posting. Jeff Swinton Manager, Backbone Design Cable & Wireless Internet Engineering At 01:10 PM 10/26/98, Christopher X. Candreva wrote:
On Mon, 26 Oct 1998, Network Operations Center wrote:
??
anybody knowing what's going on with CW ??
Just got off the phone with their first-level trouble reporting. They say that "Someone put in a block against C&W, and the resulting traffic overloaded our backbone".
I've been looking for a better answer to show up here -- if e-mail can get through to me.
-Chris
========================================================== Chris Candreva -- chris@westnet.com -- (914) 967-7816 WestNet Internet Services of Westchester http://www.westnet.com/
<html> ??<br> <br> anybody knowing what's going on with CW ??<br> <br> also anybody from CNN.....you got barely connectivity southbound<br> <br> <br> done from nitrous....<br> <br> <font size=3>Tracing the route to cnn.com (207.25.71.25) <br> 1 p219.t3.ans.net (192.157.69.13) 0 msec 0 msec 4 msec <br> 2 h12-1.t60-6.Reston.t3.ans.net (140.223.61.29) [AS 1673] 8 msec 8 msec 8 msec <br> 3 f2-1.t60-2.Reston.t3.ans.net (140.223.60.132) [AS 1673] 8 msec 8 msec 8 msec <br> 4 h9-1.t104-0.Atlanta.t3.ans.net (140.223.61.22) [AS 1673] 28 msec 28 msec 28 msec <br> 5 f2-0.c104-10.Atlanta.t3.ans.net (140.222.104.120) [AS 1673] 32 msec 28 msec 28 msec <br> 6 * * * <br> 7 * * h0-0.enss3222.t3.ans.net (207.25.70.6) [AS 1324] !A <br> <br> <br> --<br> <br> Bert<br> Datanet Security<br> Naples, Fla<br> <br> </font></html>
Your e-mail is barely showing through all that HTML. We are a CW customer, and what I am seeing is that traffic destined for CW address blocks is going by way of Sprint. In one case, traffic to my network, when originating at best.com, looks like: traceroute to 206.97.151.8 (206.97.151.8), 30 hops max, 40 byte packets 1 core1-fe8-1-0.mv.best.net (206.184.139.129) 102.991 ms 0.630 ms 0.899 ms 2 Hssi4-0-0.GW1.SCL1.ALTER.NET (137.39.133.89) 2.435 ms 1.839 ms 3.061 ms 3 103.ATM3-0.XR2.SCL1.ALTER.NET (146.188.145.118) 1.533 ms 2.539 ms 2.327 ms 4 294.ATM2-0.TR2.SCL1.ALTER.NET (146.188.146.26) 3.034 ms 2.493 ms 2.858 ms 5 107.ATM6-0.TR2.LAX2.ALTER.NET (146.188.137.145) 8.721 ms 8.147 ms 8.474 ms 6 298.ATM7-0.XR2.LAX4.ALTER.NET (146.188.249.13) 8.273 ms 8.605 ms 9.889 ms 7 192.ATM6-0-0.BR1.LAX1.ALTER.NET (146.188.248.29) 8.647 ms 9.412 ms 11.511 ms 8 sl-bb4-ana-1-0.sprintlink.net (144.232.8.181) 161.911 ms 157.648 ms 160.786 ms 9 sl-bb22-ana-3-2.sprintlink.net (144.232.1.29) 150.348 ms 148.671 ms 155.872 ms 10 sl-bb2-ana-4-0-0.sprintlink.net (144.232.1.14) 162.540 ms * * 11 * core3-hssi3-0.Bloomington.cw.net (206.157.77.41) 2126.225 ms * 12 * * core1.Dallas.cw.net (204.70.4.217) 988.692 ms 13 border1-fddi-0.Dallas.cw.net (204.70.114.18) 996.910 ms 1015.055 ms 1014.235 ms 14 inturnet.Dallas.cw.net (204.70.115.42) 1003.216 ms * * 15 * bosch.intur.net (206.97.151.8) 997.691 ms * Traffic from me to best.com looks like: traceroute to shell4.ba.best.com (206.184.139.135), 30 hops max, 40 byte packets 1 eth-0.cisco-1.intur.net (206.97.151.1) 2.106 ms 2.073 ms 2.088 ms 2 border1-serial3-0.Dallas.cw.net (204.70.115.41) 72.321 ms 16.649 ms 203.451 ms 3 core1-fddi-0.Dallas.cw.net (204.70.114.17) 4.789 ms 5.113 ms 10.839 ms 4 bordercore1.SanFrancisco.cw.net (166.48.12.1) 72.705 ms 42.307 ms 41.859 ms 5 best-internet.SanFrancisco.cw.net (166.48.13.250) 1001.36 ms 1052.2 ms 1010.41 ms 6 core1-hssi8-0-0.mv.best.net (206.86.228.89) 979.218 ms 1007.01 ms 1000.45 ms 7 shell4.ba.best.com (206.184.139.135) 1013.52 ms * 1018.15 ms My guess is that at hop #5 the returns start going by way of the asymetric return path, and hence the long delay (and often high lossage). The problem seems to be that CW address space is being sucked into ALTER.NET or sprintlink.net for some reason. Is this still Qwest? -- -- *-----------------------------* Phil Howard KA9WGN * -- -- | Inturnet, Inc. | Director of Internet Services | -- -- | Business Internet Solutions | eng at intur.net | -- -- *-----------------------------* philh at intur.net * --
Traffic from me to best.com looks like:
traceroute to shell4.ba.best.com (206.184.139.135), 30 hops max, 40 byte packets 1 eth-0.cisco-1.intur.net (206.97.151.1) 2.106 ms 2.073 ms 2.088 ms 2 border1-serial3-0.Dallas.cw.net (204.70.115.41) 72.321 ms 16.649 ms 203.451 ms 3 core1-fddi-0.Dallas.cw.net (204.70.114.17) 4.789 ms 5.113 ms 10.839 ms 4 bordercore1.SanFrancisco.cw.net (166.48.12.1) 72.705 ms 42.307 ms 41.859 ms 5 best-internet.SanFrancisco.cw.net (166.48.13.250) 1001.36 ms 1052.2 ms 1010.41 ms 6 core1-hssi8-0-0.mv.best.net (206.86.228.89) 979.218 ms 1007.01 ms 1000.45 ms 7 shell4.ba.best.com (206.184.139.135) 1013.52 ms * 1018.15 ms
This is still quest yes, the routes are getting from qwest to sprint then going on to uu.net.. it looks like its only happening in la tho.. maybe a bad filter? At this time I'm not seeing anyone leaking routes to me, including sprint. -- Steven O. Noble -- Sr. Backbone Engineer, Exodus Communications (EXDS) -- Work:408.346.2333 -- All my love to the Canadian Mooing Frog.
On Mon, 26 Oct 1998, Network Operations Center wrote:
anybody knowing what's going on with CW ??<br>
Id really like to know too. CW has been having massive problems since last night. basically our CW link is totally unusable at the moment. So this is looking something like a 15+ hour CW outage. 5 core1-fddi-1.Sacramento.cw.net (204.70.164.33) 68.215 ms 48.120 ms 73.001 ms 6 core7.SanFrancisco.cw.net (204.70.4.93) 44.076 ms 50.416 ms 49.339 ms 7 Hssi5-1-0.BR1.SFO1.alter.net (206.157.77.78) 1025.028 ms 1135.500 ms * 8 114.ATM3-0.XR1.SFO1.ALTER.NET (146.188.148.210) 1071.055 ms * * 6 core2.SanFrancisco.cw.net (204.70.4.201) 157.969 ms 70.837 ms 97.183 ms 7 borderx1-fddi-1.SanFrancisco.cw.net (204.70.158.52) 121.741 ms 95.664 ms 88.498 ms 8 * * * -Dan
participants (7)
-
Andy Walden -
Christopher X. Candreva -
Dan Hollis -
Jeff Swinton -
noc＠nso.org -
Phil Howard -
steve＠altrina.exodus.net