November 2000 - Test - lists.nanog.org

Internet metrics
by Schmiedt, Jamie 30 Nov '00

30 Nov '00

I am looking for websites that deal with bandwidth and performance metrics as they pertain to the Internet? Anything and everything goes. I need to get a snapshot in time of things like "the average speed of the Internet", the average size of e-mail messages, the average size of a web page, peering points and hosting facilities, current bottlenecks be they hardware, software or networks. Any cool links for this sorta info will be greatly appreciated. Thanks in advance -jamie

2 1

Re: Traceroute versus other performance measurement
by smd＠clock.org 30 Nov '00

30 Nov '00

Mmm, network analysis stuff on NANOG. Scary! | Do I understand it correctly that the "invariant 5 tuple" refers to | 5 non-variable aspects of this performance test, being namely: Tuple definition, from the CS Jargon file, a copy of which is here: http://rkb.home.cern.ch/rkb/AN16pp/node289.html Note that a 5-tuple is basically a set of 5 elements/objects/records. The "invariant 5-tuple" here just has to do with 5 things which don't change in the test. There is another element which is unchanged during a ttcp run: TOS/diffserve, thus there is really a (or an at-least) 6-tuple invariance. In practice, only 5 of the elements in that n-tuple are used in making a forwarding decision; the choice of the fifth could well be vendor/release-dependent, at least judging by what people are saying here. | E.g.: performance measurements will gravitate towards a result not | representative for the totality of all traffic, as the 5 variables | are rather fixed, or at the least fixed for the duration of the test ? Well, if you are making a big flow, and the elements used by routers to make a hash which is used to select which of several equal-cost paths to use don't change, then the routers will use the same single path throughout the ttcp test. (Even if the hash->path mapping is adjusted, the ttcp test packets hash the same, so path flutter doesn't really change the principle). Thus if you have six 10Mbps lines in parallel, the ttcp packets will hash the same way, and use a single 10Mbps link (at a time). This is good, because TCP does not like out-of-order packets, and because traffic loads are fractal, out-of-order packets are likely where there are multiple paths, and if there are many multiple-paths this can lead to the TCP sender losing its brains with duplicate ACKs pushing the congestion window right through the floor. | Has intelligent switching and forwarding (Layer-4 and up) started to | make such a significant impact on end-to-end performance that all | traditional performance tests must necessarily be flawed ? Research question. My guess: probably not. A better question, maybe the one you want to ask, is how well does the Internet deal with lots of equal-cost paths? The answer: small numbers are OK, large numbers are probably not OK, and moreover, the goal of avoiding out-of-order TCP packets constrains any given TCP flow to one path, which means that that TCP flow will not be able to run any faster than the slowest component, across any given link. If that component is a bottleneck, oops. | (there must be a reason why my MRTG graphs of HTTP GET's to websites | are so much more consistent than icmp pings...) Consistent? I'm not following. Maybe there is a large-numbers issue here: if you are plotting lots and lots and lots and lots of flows, and only looking at a few pings, then if there is frequent very-short-term queueing delays at work, you will see them more clearly with the individual pings. A large number of pings aggregated together will probably converge upon whatever you see when you aggregate a large number of HTTP GETs. cf. http://skepdic.com/lawofnumbers.html and the cool toy at http://www.stat.berkeley.edu/~stark/Java/lln.htm Note that the tendency of small numbers of short-term samples to be wildly different than large-number samples when looking at ping (which ultimately is a measurement of queueing behaviour) is an important property of the Internet. The short-term behaviour is _fractal_, and is fractal across a surprising number of _generations_ (where a generation is, for example, 0.001 sec to 0.01 sec, that is an order of magnitude increase base ten). This really really messes up the fine-tuning of problem identification, because again the law of large numbers suggests that as the Internet grows in terms of numbers of users, more of them will see shockingly bad behaviour if they ping somewhere for a few seconds. :-( (In other words, Danie Senie was right with respect to users seeing strange things and asking about them). Sean.

2 1

Re: Will the lights stay on - Predictions about the US electrical (fwd)
by multics＠ruserved.com 30 Nov '00

30 Nov '00

At the time I worked on the contract with NYSPA around 1976, the reliability goal was one failure in 10 years. This did not include failures from accidents, like cars knocking down power poles, lightning strikes, etc. >From what I've seen at least where I am in NYS, we've had 2 2 hour outages in the last 6 years, one unscheduled, one scheduled for maintenance. The phone company hasn't been as reliable. Forwarded message: > On Tue, 28 November 2000, Bill Woodcock wrote: > > > Congress within the next five years will enact legislation mandating > > > minimum standards for reducing downtime and improving system > > > reliability > > > > Jeez, if that's all it takes, why didn't they do it years ago? :-) > > > NEW YORK, Nov 29 (Reuters) - New Jersey, in an effort to encourage utilities to improve the reliability of the state's electric system, adopted, late Tuesday, standards designed to reduce outage frequency and duration. > > http://biz.yahoo.com/rf/001129/n29106533.html > > > Essentially every book on security, quality control, reliability, etc includes > a statement "First, you must have the attention of the top management." How > do you get the attention of the top management? Will passing a law or a > regulation improve reliablity? It could, if it got the attention of the > management of the companies to increase the budget for doing the things > better reliability requires. > > I'm at the damage prevention convention this week. All the major carriers > had people on one of the panels on the problem of fiber cuts. The scariest > thing is most carriers only have 1 or 2 people in their entire organization > responsible for damage prevention. Worldcom has 2 people watching 60,000 > router miles. I think Level 3 had 1 person. Qwest International had 2 people. > ATT has a department, but even that seems to be downsized. When carriers are > merged, the damage prevention budget is usually cut in half. > > I was very impressed with the people from all the carriers. They are all > working very hard. But how much can 1 or 2 people really do? Fundamentally, > if you want to improve reliability you must make reliability important to > the top management of a company. Make it worth the budget management must > approve to hire the people to implement the reliability program. > > Do you know what I want in an SLA? > > I would prefer my circuit never fails, but when it does I don't want money. I > want a public apology from the CEO of the company. CEO's at major companies > tend to have very strong personalities. They hate to ever admit any problems. > Notice when carriers issue press releases with good news, it always > includes a quote from the CEO. But when they release bad news, it is always > a spokesperson. Maybe if the CEO had to deal with the fall out of reliability > problems, he or she would decide increasing the budget a bit is worth it. > > After Ebay's CEO had to appear on CNBC, suddenly reliability became important > for Ebay. After AOL's CEO had to appear, suddenly reliability became a > top management concern of AOL and they spent a lot of money on it. > > > > -- Richard Shetron multics(a)ruserved.com multics(a)acm.rpi.edu NO UCE What is the Meaning of Life? There is no meaning, It's just a consequence of complex carbon based chemistry; don't worry about it The Super 76, "Free Aspirin and Tender Sympathy", Las Vegas Strip.

1 0

Re: Will the lights stay on - Predictions about the US electrical grid
by Sean Donelan 30 Nov '00

30 Nov '00

On Tue, 28 November 2000, Bill Woodcock wrote: > > Congress within the next five years will enact legislation mandating > > minimum standards for reducing downtime and improving system > > reliability > > Jeez, if that's all it takes, why didn't they do it years ago? :-) NEW YORK, Nov 29 (Reuters) - New Jersey, in an effort to encourage utilities to improve the reliability of the state's electric system, adopted, late Tuesday, standards designed to reduce outage frequency and duration. http://biz.yahoo.com/rf/001129/n29106533.html Essentially every book on security, quality control, reliability, etc includes a statement "First, you must have the attention of the top management." How do you get the attention of the top management? Will passing a law or a regulation improve reliablity? It could, if it got the attention of the management of the companies to increase the budget for doing the things better reliability requires. I'm at the damage prevention convention this week. All the major carriers had people on one of the panels on the problem of fiber cuts. The scariest thing is most carriers only have 1 or 2 people in their entire organization responsible for damage prevention. Worldcom has 2 people watching 60,000 router miles. I think Level 3 had 1 person. Qwest International had 2 people. ATT has a department, but even that seems to be downsized. When carriers are merged, the damage prevention budget is usually cut in half. I was very impressed with the people from all the carriers. They are all working very hard. But how much can 1 or 2 people really do? Fundamentally, if you want to improve reliability you must make reliability important to the top management of a company. Make it worth the budget management must approve to hire the people to implement the reliability program. Do you know what I want in an SLA? I would prefer my circuit never fails, but when it does I don't want money. I want a public apology from the CEO of the company. CEO's at major companies tend to have very strong personalities. They hate to ever admit any problems. Notice when carriers issue press releases with good news, it always includes a quote from the CEO. But when they release bad news, it is always a spokesperson. Maybe if the CEO had to deal with the fall out of reliability problems, he or she would decide increasing the budget a bit is worth it. After Ebay's CEO had to appear on CNBC, suddenly reliability became important for Ebay. After AOL's CEO had to appear, suddenly reliability became a top management concern of AOL and they spent a lot of money on it.

4 3

Traceroute versus other performance measurement
by Paul Bradford 29 Nov '00

29 Nov '00

I have been reading NANOG posts for probably 2 years now.. this is my 1st post. I need help with a reality/sanity check. Traceroute is a good tool for checking for routing type problems (loops). Does anyone feel it's a good tool to use for testing "bandwidth".... My obvious answer is it isn't a good tool for that.... One problem I see is that the way traceroute works, if a transport mixes media between say Ethernet to LANE and back to Ethernet you give room for Destination unreachable responses from a trace route because you have to to packet switching medias with a fast cell switched media in between.... packets less than 64k (like traceroute info) are easily lost in the conversion from ethernet to LANE. Does this sound right? Thanks, Paul A. Bradford

8 7

STM4c and Cisco
by Ariel Biener 29 Nov '00

29 Nov '00

Hi guys/gals, For a certain operation, we will be ordering a STM4c circuit. The edge router (our side) is a Cisco 7507, running RSP8, with VIP4-80s. I saw that Cisco havea PA-OC12 card for the 750x series. My questions is as follows: This particular location is an Internet exchange. Traffic can be classified as general purpose, and I assume web access is the largest share of it. I heard of different limitations of the VIP4-80, as per how many pps it can do, and what my boss heard from Cisco was about 400Mbit/s worth of packets (if we take the usual packet size distribution into consideration). I wonder if this is true. AFAIK, there are PA-GE cards for 750x series too. Would they also be stuck at ~40% of their potential ? For that OC12 card, this makes it roughly 500Mb/s worth of cells (tax this for packet to cell conv. and you're at 400Mbit/s). Does any of you run STM4c circuits on 750x routers (not 12k or Junipers) ? If you do, have you ever came close to the full capacity of the link ? I need to know this before I order it (although this is more academic than anything else, since I have no choice in the matter anyway). thanks for you input, --Ariel -- Ariel Biener e-mail: ariel(a)post.tau.ac.il PGP(6.5.8) public key http://www.tau.ac.il/~ariel/pgp.html

2 1

MACs on PAIX
by Matt Hempel 29 Nov '00

29 Nov '00

I'm using MAC accounting on our Fast E connection at the PAIX to do per-peer traffic stats. It worked great until we put in a GSR. I don't know why it worked before or if anything has changed since. The stats aren't working now because the # of entries in the MAC accounting table exceed 512 (a hard IOS limit). The majority of these aren't in the ARP table ... they are inbound without translation ... just layer 2 noise. It seems odd to me that there are this many distinct addresses on the same shared segment. Not to mention that the port isn't switched. To wit: 0000.0000.0000(0 ): 110444951 packets, 27399M bytes, last: 80ms ago 0000.0003.0000(3 ): 9416 packets, 2738919 bytes, last: 455680ms ago 0000.037f.4129(20 ): 33 packets, 7700 bytes, last: 302129568ms ago Pretty serious chunks of bandwidth. There are a large group of these addresses that begin with 0000. --- are these some sort of bridged translation? Can you think of any other reason that so many MACs would appear on the same port? --matt hempel

3 2

looking glass resources, as promised :)
by Ariel Biener 29 Nov '00

29 Nov '00

Ok, this is what I gathered: Looking Glass locations: http://www.caida.org/analysis/routing/reversetrace/ http://www.traceroute.org Looking glass software: http://net.doit.wisc.edu/~plonka/FlowScan/ http://www.paranode.com/lg/ http://nitrous.digex.net/source/source.html ftp://ftp.enterzone.net/looking-glass/mrlg-3.0/ ftp://ftp.shrubbery.net/rancid/rancid-2.1b.tar.gz Charles Sprickman <spork(a)inch.com> also mentioned that some of the sites that offer LG service also have a link to the source they use, so, you can also try that, YMMV. again, thanks for the input, --Ariel -- Ariel Biener e-mail: ariel(a)post.tau.ac.il PGP(6.5.8) public key http://www.tau.ac.il/~ariel/pgp.html

1 0

Fw: Internet access in Honolulu, HI ? (fwd)
by Brian 29 Nov '00

29 Nov '00

Someone asked about Hawaii access, I got this from a coworker that used to live there. He can try the "Internet Cafe." I can't remember what street that is on. But, for the price of coffee he can stay there for hours. At least that's the way it use to be! Brian

2 1

Re: Traceroute versus other performance measurement
by smd＠clock.org 29 Nov '00

29 Nov '00

| I thought the 5th tuple of 5-tuple is usually the L4 protocol (TCP, UDP, | ICMP, etc.). If your algorithm also takes DS values into account, you'd | have a 6-tuple. It's possible to take into account TCP/UDP/whatnot but breaking fate-sharing based on something that is not inherently a hint to the routers of the Internet seems rather strange, especially considering that you can end up in weird situations where ICMP works and TCP doesn't, or vice-versa, making things very hard to diagnose. If a 5-tuple is being used, TOS/diffserv makes much more sense, because the settor of that byte is explicitly signalling to the routing system that packets are to be treated differently from others with different values in the same byte. There is also the fact that splitting traffic across multiple paths based on passenger transport protocol is unlikely to produce much of a win anyway; the bulk of traffic by packets and by bytes is associated with the other 4 elements is very likely to be TCP, and thus there is not much better opportunity for statistical traffic separation than by using the TOS/diffserv byte. While most traffic simply is not coloured today, the opportunity to colour in order to improve traffic separation is greater when there is an element involved that you are allowed to change. This is in essence a "poor man's explicit routing" in that the source (or something in between) can move traffic between one source and destination in a different way. That is somewhat different from using L4 type, which is and must always be invariant. Sean.

1 0