I'm currently looking into a weird problem at an ATM peering point on the West Coast, when I ping from my peer router to any of my peers I get some but not total packet loss, when I ping from one router back or use the loopback interface as source things are fine. Whereas, with all my other ATM peering point routers, for example at MAE-EAST I can ping my peers cleanly from the same router. This isn't (to my knowledge) affecting traffic just wondering why this strange phenomenon should occur only in the one place. Any body else had any similar problems? Richard Hand __________________________________________________ Do You Yahoo!? Yahoo! Photos - 35mm Quality Prints, Now Get 15 Free! http://photos.yahoo.com/
We were seeing something similar yesterday (and yup - it's still there today). We also noted that if you turn on the record-route options, then your problem will disappear (I suspect packet options may cause delivery to be ok - though while the RR option helps, DF doesnt, but "timestamp" will). We're not seeing packet loss in any other scenario. I noticed, suspiciously, that there is always a very "hockey toothed" (every other packet) pattern in the lossage (load balancing onto a botched circuit?). Things I've played with: * size 50% (tried 800, 1200, 2500) * DF 50% * RR 100% * pattern seems to be generally 50% * timestamp 100% * TOS 50% We've opened up a case with cisco ... seems pretty bizarre, but could it be the ATM switch? As long as we're not using the source address of the ATM network - things are fine (e.g. sourcing off of the loopback, going one hop back, etc). - Tom On Fri, 6 Oct 2000, Richard Inhand wrote:
Date: Fri, 6 Oct 2000 04:50:10 -0700 (PDT) From: Richard Inhand <chapinhand@yahoo.com> To: nanog@merit.edu Subject: ATM Question
I'm currently looking into a weird problem at an ATM peering point on the West Coast, when I ping from my peer router to any of my peers I get some but not total packet loss, when I ping from one router back or use the loopback interface as source things are fine. Whereas, with all my other ATM peering point routers, for example at MAE-EAST I can ping my peers cleanly from the same router. This isn't (to my knowledge) affecting traffic just wondering why this strange phenomenon should occur only in the one place.
Any body else had any similar problems?
Richard Hand
__________________________________________________ Do You Yahoo!? Yahoo! Photos - 35mm Quality Prints, Now Get 15 Free! http://photos.yahoo.com/
On Fri, Oct 06, 2000 at 04:50:10AM -0700, Richard Inhand wrote:
I'm currently looking into a weird problem at an ATM peering point on the West Coast, when I ping from my peer router to any of my peers I get some but not total packet loss, when I ping from one router back or use the loopback interface as source things are fine. Whereas, with all my other ATM peering point routers, for example at MAE-EAST I can ping my peers cleanly from the same router. This isn't (to my knowledge) affecting traffic just wondering why this strange phenomenon should occur only in the one place.
Have you verified the return path of the packets from your peers? Are they getting to you via that peering connection or taking a different path back to you? If you ping without specifying a source address to use, the router will most likely be using the IP address of the interface that connects to the peering point. The router on the other end, due to the connected route, should respond directly back over that peering connection. If you are pinging from a different router or using a different interface off your peering router, then your peer's router is not directly connected and BGP or other routing protocols may be directing the reply packet back to you via a different path. You could verify this with traceroute's loose source route option, if you and your peers have not disabled this useful feature. Here is an example testing that one of my AADS peers is sending traffic back to me via our peering session. 140.189.1.80 = my loopback0 interface, adv via BGP to peers as 140.189/16 206.220.243.118 = my interface connecting to AADS NAP 206.220.243.116 = my peer's interface connecting to AADS NAP r-uwmilwaukee-isp#traceroute Protocol [ip]: Target IP address: 140.189.1.80 <--- my loopback Source address: Numeric display [n]: Y Timeout in seconds [3]: Probe count [3]: Minimum Time to Live [1]: Maximum Time to Live [30]: Port Number [33434]: Loose, Strict, Record, Timestamp, Verbose[none]: L Source route: 206.220.243.116 <--- my peer's interface Loose, Strict, Record, Timestamp, Verbose[LV]: V <--- toggle off verbose Loose, Strict, Record, Timestamp, Verbose[L]: Type escape sequence to abort. Tracing the route to 140.189.1.80 1 206.220.243.116 12 msec 4 msec 4 msec 2 206.220.243.118 20 msec * 20 msec If my peer was preferring a different path back to my network, I would see a lot more hops. This may not be your problem, but it is quite a useful tool when you don't have access to your peer's network to do troubleshooting on what they are doing with your routes. It is also useful for testing if your peer has pointed default at your network by using a destination address that isn't part of your network and seeing if the peer sends the packet back to you as the next hop. I request that all my peers have source routing enabled for troubleshooting purposes, at least on their router I peer with. I have only had one very small network refuse. Jeff -- Jeff Bartig | University of Wisconsin - Madison 1210 W Dayton, Rm B263 | Division of Information Technology Work Phone: (608) 262-8336 | Network Engineering Technology E-Mail: jeffb@doit.wisc.edu |
One of our guys just cleared out the CEF table on the effected interface - now pings go through just fine ... As noted earlier, mere changes in packet options were enough to cause different behavior [I'm trying to find a Bug-ID associated with this ....] - Tom On Fri, 6 Oct 2000, Jeff Bartig wrote:
Date: Fri, 6 Oct 2000 11:27:03 -0500 From: Jeff Bartig <jeffb@doit.wisc.edu> To: Richard Inhand <chapinhand@yahoo.com>, nanog@merit.edu Subject: Re: ATM Question
On Fri, Oct 06, 2000 at 04:50:10AM -0700, Richard Inhand wrote:
I'm currently looking into a weird problem at an ATM peering point on the West Coast, when I ping from my peer router to any of my peers I get some but not total packet loss, when I ping from one router back or use the loopback interface as source things are fine. Whereas, with all my other ATM peering point routers, for example at MAE-EAST I can ping my peers cleanly from the same router. This isn't (to my knowledge) affecting traffic just wondering why this strange phenomenon should occur only in the one place.
Have you verified the return path of the packets from your peers? Are they getting to you via that peering connection or taking a different path back to you?
participants (3)
-
Jeff Bartig -
Richard Inhand -
Thomas P. Brisco