This is an auto-generated mail on Fri Sep 22 12:00:00 PDT 2000 It is not checked before it leaves my workstation. However, hopefully you will find this report interesting and will take the time to look through this to see if you can improve the amount of aggregation you perform. The report is split into sections: 0) General Status List the route table history for the last week, list any possibly bogus routes seen and give some status on ASes. 1) Gains by aggregating at the origin AS level This lists the "Top 30" players who if they decided to aggregate their announced classful prefixes at the origin AS level could make a significant difference in the reduction of the current size of the Internet routing table. This calculation does not take into account the inclusion of holes when forming an aggregate so it is possible even larger reduction should be possible. 2) Weekly Delta A summary of the last weeks changes in terms of withdrawn and added routes. Please note that this is only a snapshot but does give some indication of ASes participating in CIDR. Clearly, it is generally a good thing to see a large amont of withdrawls. 3) Interesting aggregates Interesting here means not an aggregate made as a set of classful routes. Thanks to xara.net for giving me access to their routing tables once a day. Please send any comments about this report directly to me. Check http://www.employees.org/~tbates/cidr-report.html for a daily update of this report. ------------------------------------------------------------------------------ CIDR REPORT for 22Sep00 0) General Status Table History ------------- Date Prefixes 150900 87093 160900 87265 170900 87208 180900 87379 190900 87348 200900 87707 210900 87719 220900 87996 Check http://www.employees.org/~tbates/cidr.plot.html for a plot of the table history. Possible Bogus Routes --------------------- *** Bogus 65.0.0.0/14 from AS6172 *** Bogus 65.33.0.0/16 from AS10994 *** Bogus 65.128.0.0/14 from AS209 *** Bogus 65.132.0.0/15 from AS209 *** Bogus 65.134.0.0/17 from AS209 *** Bogus 65.134.128.0/19 from AS209 *** Bogus 65.160.0.0/15 from AS1239 *** Bogus 65.162.0.0/16 from AS1239 *** Bogus 66.1.16.0/20 from AS3847 *** Bogus 66.4.0.0/17 from AS11686 *** Bogus 66.4.0.0/15 from AS11686 *** Bogus 66.4.128.0/17 from AS11686 *** Bogus 66.6.32.0/20 from AS701 *** Bogus 66.6.64.0/20 from AS14480 *** Bogus 66.6.96.0/20 from AS10970 *** Bogus 66.6.128.0/20 from AS3561 *** Bogus 66.6.192.0/20 from AS11282 *** Bogus 66.7.0.0/19 from AS16484 *** Bogus 66.7.64.0/19 from AS14618 *** Bogus 66.9.0.0/19 from AS6221 *** Bogus 66.9.16.0/23 from AS16445 *** Bogus 66.10.0.0/20 from AS7132 *** Bogus 66.10.32.0/20 from AS7132 *** Bogus 66.16.0.0/17 from AS14914 *** Bogus 66.18.13.0/24 from AS3549 *** Bogus 66.20.128.0/22 from AS7892 *** Bogus 105.200.37.0/24 from AS9768 *** Bogus 217.0.0.0/13 from AS3320 *** Bogus 217.8.0.0/20 from AS1299 *** Bogus 217.8.32.0/20 from AS3220 *** Bogus 217.8.128.0/20 from AS15552 *** Bogus 217.8.160.0/20 from AS8246 *** Bogus 217.8.160.0/20 from AS15560 *** Bogus 217.9.32.0/20 from AS15563 *** Bogus 217.9.36.0/22 from AS15563 *** Bogus 217.9.42.0 from AS15563 *** Bogus 217.9.64.0/20 from AS3269 *** Bogus 217.9.96.0/20 from AS15671 *** Bogus 217.9.128.0/20 from AS12969 *** Bogus 217.9.160.0 from AS15606 *** Bogus 217.9.224.0/20 from AS13124 *** Bogus 217.10.0.0/20 from AS1270 *** Bogus 217.10.64.0/20 from AS15594 *** Bogus 217.10.96.0/20 from AS5556 *** Bogus 217.10.96.0/20 from AS5378 *** Bogus 217.10.160.0/23 from AS15641 *** Bogus 217.10.162.0 from AS15641 *** Bogus 217.10.192.0 from AS12302 *** Bogus 217.11.0.0/20 from AS9034 *** Bogus 217.11.64.0/20 from AS702 *** Bogus 217.11.160.0/20 from AS3259 *** Bogus 217.11.224.0/20 from AS15685 *** Bogus 217.12.0.0/20 from AS15635 *** Bogus 217.12.32.0/20 from AS5378 *** Bogus 217.12.96.0 from AS15632 *** Bogus 217.12.96.0/23 from AS15632 *** Bogus 217.12.97.0 from AS15632 *** Bogus 217.12.192.0/20 from AS15626 *** Bogus 217.12.224.0/20 from AS15438 *** Bogus 217.13.0.0/20 from AS15659 *** Bogus 217.13.32.0 from AS15629 *** Bogus 217.13.33.0 from AS15629 *** Bogus 217.13.34.0 from AS15629 *** Bogus 217.13.192.0/20 from AS9126 *** Bogus 217.13.224.0/20 from AS3220 *** Bogus 217.14.64.0/20 from AS3303 *** Bogus 217.14.96.0/23 from AS13099 *** Bogus 217.14.128.0/20 from AS8851 *** Bogus 217.14.192.0/20 from AS3226 *** Bogus 217.15.0.0/20 from AS13064 *** Bogus 217.15.128.0/20 from AS13118 *** Bogus 217.16.96.0/20 from AS15687 *** Bogus 217.32.0.0/12 from AS2856 *** Bogus 217.117.117.0 from AS2007 *** Bogus 220.10.56.0 from AS3215 AS Summary ---------- Number of ASes in routing system: 8534 Number of ASes announcing only one prefix: 4865 (2696 cidr, 2169 classful) Largest number of cidr routes: 892 announced by AS701 Largest number of classful routes: 1087 announced by AS701 1) Gains by aggregating at the origin AS level --- 22Sep00 --- ASnum NetsNow NetsCIDR NetGain % Gain Description AS271 432 155 277 64.1% BCnet Backbone AS9706 310 104 206 66.5% Pusan Metropolitan City Office of AS1221 611 451 160 26.2% TELSTRA-AS AS9269 179 40 139 77.7% Hong Kong CTI AS816 566 429 137 24.2% UUNET Canada (ASN-UUNETCA-AS4) AS2609 128 8 120 93.8% EUnet-TN AS7657 324 211 113 34.9% The Internet Group Limited AS9304 124 17 107 86.3% Hutchcity AS7046 376 270 106 28.2% COQUI-NET PRTC Internet AS7545 159 56 103 64.8% TPG Internet Pty Ltd AS705 367 266 101 27.5% UNKNOWN AS6429 209 115 94 45.0% FirstCom Internet AS7496 125 34 91 72.8% Power Up AS4755 208 118 90 43.3% Videsh Sanchar Nigam Ltd. India AS8013 490 403 87 17.8% UNKNOWN AS174 536 450 86 16.0% Performance Systems International AS6595 138 57 81 58.7% UNKNOWN AS3908 256 176 80 31.2% Supernet, Inc. AS4293 331 252 79 23.9% Internal ASN for C&W AS724 244 168 76 31.1% UNKNOWN AS1785 384 309 75 19.5% AppliedTheory Communications AS1727 172 97 75 43.6% UNKNOWN AS577 250 177 73 29.2% Bell Backbone AS7018 581 514 67 11.5% AT&T WorldNet Service Backbone AS701 1087 1021 66 6.1% Alternet AS4792 77 11 66 85.7% SK Telecom Co., Ltd. AS13999 77 11 66 85.7% UNKNOWN AS5106 99 36 63 63.6% UNKNOWN AS3749 119 57 62 52.1% UNKNOWN AS226 170 108 62 36.5% USC/Information Sciences Institut For the rest of the previous weeks gain information please see http://www.employees.org:80/~tbates/cidr-report.html 2) Weekly Delta Please see http://www.employees.org:80/~tbates/cidr-report.html for this part of the report 3) Interesting aggregates Please see http://www.employees.org:80/~tbates/cidr-report.html for this part of the report
At Friday 03:00 PM 9/22/00, Tony Bates wrote:
Check http://www.employees.org/~tbates/cidr.plot.html for a plot of the table history.
Is this just me, or has noone commented on this in a while? Somehow we are seeing an exponential growth in the number of prefixes in the last 12 months, while it was linear for the 5 years before that ( http://www.employees.org/~tbates/cidr.hist.plot.html ) What 'threshold' has triggered this sudden event, with routes going from 60,000 to 90,000 in just 12 months? Multihoming becoming fashionable? Dinky-rink providers getting multihomed, and for lack of engineering experience announcing 32 /24's out of their scattered POPs in addition to their /19 aggregate because they can't get their load balancing right without it or have never heard of the 'NO_EXPORT' attribute (I could point fingers now)?
On Fri, 22 Sep 2000, Kai Schlichting wrote: [ http://www.employees.org/~tbates/cidr.plot.html for a plot ]
of engineering experience announcing 32 /24's out of their scattered POPs in addition to their /19 aggregate because they can't get their load balancing right without it or have never heard of the 'NO_EXPORT' attribute (I could point fingers now)?
I suspect data from inside providers with aggressive filtering policies might prove to be interesting. Some promising local providers were past the 150k mark a while ago for sum (internal + global bgp) routes and were growing superlinearly the entire time because of the ever increasing number of customers. /vijay
On Fri, Sep 22, 2000 at 03:44:50PM -0400, Vijay Gill wrote:
On Fri, 22 Sep 2000, Kai Schlichting wrote:
[ http://www.employees.org/~tbates/cidr.plot.html for a plot ]
of engineering experience announcing 32 /24's out of their scattered POPs in addition to their /19 aggregate because they can't get their load balancing right without it or have never heard of the 'NO_EXPORT' attribute (I could point fingers now)?
I suspect data from inside providers with aggressive filtering policies might prove to be interesting.
Some promising local providers were past the 150k mark a while ago for sum (internal + global bgp) routes and were growing superlinearly the entire time because of the ever increasing number of customers.
I have in one location over 100k prefixes received from one nice large international provider: Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd a.b.c.d 4 701 10776831 107250 13024503 0 0 1w4d 105250 My primary concern is that the current growth is going to outscale the medium sized providers as the one vendor that the above output came from doesn't appear to be providing enough memory in their equipment, or have enough memory options available. I am not predicting "the internet will end in 9 days, repent", but it is some cause for concern in the next 6-12 months. What would be nice is if someone were to put together an auto-nagger similar to the "your dns server is lame" of the old days messages. Back when the network tables were about 40-45k, I would read the output of "sh ip b" and send messages to people asking them to aggregate, but those days are over... (at least for me..) - jared -- Jared Mauch | pgp key available via finger from jared@puck.nether.net clue++; | http://puck.nether.net/~jared/ My statements are only mine. END OF LINE | Manger of IP networks built within my own home
On Fri, 22 Sep 2000, Jared Mauch wrote:
My primary concern is that the current growth is going to outscale the medium sized providers as the one vendor that the above output came from doesn't appear to be providing enough memory in their equipment, or have enough memory options available.
Fortunately, the large ISPs will act as the mine canary for this particular problem. Memory will go up as the big boys start to use their leverage with the vendors. I did some internal presentations on this particular topic at a particularly large ISP.
What would be nice is if someone were to put together an auto-nagger similar to the "your dns server is lame" of the old days messages. Back when the network tables were about 40-45k, I would read the output of "sh ip b" and send messages to people asking them to aggregate, but those days are over... (at least for me..)
The CIDR report does a fairly good job at this. /vijay
Don't forget my favorite target for 'aggregation agression', dear ol' UUNet, just for grins I polled one of my border routers, 1784 prefixes being heard with an AS path of ^701$, of which 271 are /24's, not to mention the rest of their unaggregated announcements. This apparentl lack of concern for how they affect the rest of the internet with their lasse fair attitude when it comes to making their customers announce properly to them (and thus to us) is simply amazing. ----- Original Message ----- From: "Kai Schlichting" <kai@pac-rim.net> To: <nanog@merit.edu> Sent: Friday, September 22, 2000 3:38 PM Subject: exponential route prefix growth, was: Re: The Cidr Report
At Friday 03:00 PM 9/22/00, Tony Bates wrote:
Check http://www.employees.org/~tbates/cidr.plot.html for a plot of the table history.
Is this just me, or has noone commented on this in a while? Somehow we are seeing an exponential growth in the number of prefixes in the last 12 months, while it was linear for the 5 years before that ( http://www.employees.org/~tbates/cidr.hist.plot.html )
What 'threshold' has triggered this sudden event, with routes going from 60,000 to 90,000 in just 12 months? Multihoming becoming fashionable? Dinky-rink providers getting multihomed, and for lack of engineering experience announcing 32 /24's out of their scattered POPs in addition to their /19 aggregate because they can't get their load balancing right without it or have never heard of the 'NO_EXPORT' attribute (I could point fingers now)?
What 'threshold' has triggered this sudden event, with routes going
IMHO, one of the triggers is larger enterprises deciding to multi-home to several disparate carriers. I've seen a number of companies recently who, rather than collocating at locations where they might enjoy better bandwidth and reliability at a lower cost, have gone the route of purchasing several tens of links and peering to each provider they connect to. Since they're usually multinational, they do this in several places, which I think contributes to what you're noticing. Which sucks, because the better choice for them is to ignore the political concerns and do the technically responsible thing, which is bring their content or resources, whatever they are, closer to points in the Internet where they are most commonly used. There's really very little to be gained by announcing their own space as opposed to having a collocation provider with good connectivity providing them blocks out of their space. They just come from a larger enterprise mentality where they work very hard to make sure all the resources are centralized and controlled by one or two people. sigh. t
At 15:38 09/22/2000 -0400, Kai Schlichting wrote:
At Friday 03:00 PM 9/22/00, Tony Bates wrote:
Check http://www.employees.org/~tbates/cidr.plot.html for a plot of the table history.
Is this just me, or has noone commented on this in a while? Somehow we are seeing an exponential growth in the number of prefixes in the last 12 months, while it was linear for the 5 years before that ( http://www.employees.org/~tbates/cidr.hist.plot.html )...
Actually, I have been looking at Tony's plots of active AS numbers for some time, and every time I do, I get a nervous twitch in my gut. Thanks for your post, Kai... You inspired me to do the obvious analysis. It turns out that the trend did not suddently become exponential; rather, it was exponential all the time, as near as I can figure. Tony was kind enough to ship me his source data. I cleaned up the obvious outliers (significant deviation from monotonic non-decreasing, i.e. the big dips in his graph) by hand and ran a quick exponential regression. The R-squared (goodness of fit) for the full sequence going back to 1996 comes out at .9957 - as good a fit as you are ever likely to see on real data. It's a beautiful, textbook result. Exponential! If I did not fat finger the math, the implications are obvious, and troubling. - Scott (speaking only for himself)
Kai Schlichting <kai@pac-rim.net> wrote:
What 'threshold' has triggered this sudden event, with routes going from 60,000 to 90,000 in just 12 months? Multihoming becoming fashionable? Dinky-rink providers getting multihomed, and for lack
Fashionable or not, multihoming is a usefull and sound practice. The problem is that regulatory organizations (ex. ARIN) make it very difficult to do it properly, and so cause inefficient use of address space and routing table bloat. -w
I'm tossing in my hat as a company who has recently multi-homed our enterprise network. We would have preferred to receive a continous block, /23 from ARIN. Unfortunatly they do not allocate smaller then a /20. We went to our provider and tried to justify a /23. They rejected our claim, even though our predicte growth puts us around 200 used IPs in a year. We ended up getting only one /24. Then another upstream provider, quite large, forced another /24 upon us. When we stated we didn't need/want it, they said they could take it back but it was not standard practice; all DS3 customers get a /24. Anyway... Think of all the other companies out there who get treated like this? Have you ever checked this URL out: http://www.employees.org/~tbates/checkas.html, select "Print Full Aggregation by AS Report." If you run this, almost 10,000 routes could be aggregated. This is a 11% savings! I've ran across content providers who have a /18, but announce them all as /24. That's 63 to many routes in my table. Minimum Savings: - UUNet CA (816): 137 - AT&T (7018): 67 - UUNet (701): 66 - Sprint CA (3602): 56 - Qwest (209): 44 - Genuity (1): 40 - Level 3 (3356): 17 Has there ever been consideration to create a group/organization to monitor these tables? Someone who can call these providers and enforce aggregation? Just a thought? Perhaps ICANN, ARIN, or someone could establish a team deticated to making sure the little guys don't get kicked out of the multi-homed world.
-----Original Message----- From: owner-nanog@merit.edu [mailto:owner-nanog@merit.edu]On Behalf Of William Waites Sent: Friday, September 22, 2000 4:48 PM To: kai@pac-rim.net Cc: nanog@merit.edu Subject: Re: exponential route prefix growth, was: Re: The Cidr Report
Kai Schlichting <kai@pac-rim.net> wrote:
What 'threshold' has triggered this sudden event, with routes going from 60,000 to 90,000 in just 12 months? Multihoming becoming fashionable? Dinky-rink providers getting multihomed, and for lack
Fashionable or not, multihoming is a usefull and sound practice. The problem is that regulatory organizations (ex. ARIN) make it very difficult to do it properly, and so cause inefficient use of address space and routing table bloat.
-w
On Fri, 22 Sep 2000, Aaron Moreau-Cook wrote:
up getting only one /24. Then another upstream provider, quite large, forced another /24 upon us. When we stated we didn't need/want it, they said they could take it back but it was not standard practice; all DS3 customers get a /24. Anyway... Think of all the other companies out there who get treated like this?
Who's forcing address space on customers? It's like pulling teeth to get address space from most of them! --- John Fraizer EnterZone, Inc
up getting only one /24. Then another upstream provider, quite large, forced another /24 upon us. When we stated we didn't need/want it, they said they could take it back but it was not standard practice; all DS3 customers get a /24. Anyway... Think of all the other companies out there who get treated like this?
i would not make the argument that this is good, best practice, beneficial, ... but i have to whine that it is *very* hard in a large provider to make it clear to and easy for sales and provisioning folk to adequately determine what a customer can actually justify (in an rir sense) and provision thusly. to us it may be obvious that a residential dsl customer might have a bonkers gadget-crazed geek population that actually warrants a /25 while an oc3 turn-up who insists on a natting firewall only needs a /29. this is very hard to explain to a normal human being in sales/provisioning who has to do 20-50 of them a day, is underpaid, and who is completely disconnected from the physics and consequences of address allocation policy. randy
At 07:47 PM 22/09/2000 -0400, William Waites wrote:
Kai Schlichting <kai@pac-rim.net> wrote:
What 'threshold' has triggered this sudden event, with routes going from 60,000 to 90,000 in just 12 months? Multihoming becoming fashionable? Dinky-rink providers getting multihomed, and for lack
Fashionable or not, multihoming is a usefull and sound practice. The problem is that regulatory organizations (ex. ARIN) make it very difficult to do it properly, and so cause inefficient use of address space and routing table bloat.
I cannot speak about ARIN, but in my interactions with APNIC, they are all too well aware of the issues around multihoming and global routing table size. Their job is to manage (/conserve) Internet resources including AS numbers, and more justification for AS numbers is being required as time goes on (similar to the experience our US compatriots are discovering with address space ;-). In some respects, address space conservation is at odds with routing table minimization, especially in a multihomed world, and when you throw in commercial pressures, common sense often goes out the window. The IETF CIDR-D(eployment) group was a forum to thrash over these issues, but as primarily operational issue, was wound up in the standards arena after CIDR was widely deployed and the BCP process was concluded. The IEPG still touches on this, but it really is in the realm of the operations groups now. Routing table size may well take over as the 'Internet boogy-man' from address space exhaustion, and I'm not convinced that IPv6 will help much here. Best practice behavior will help, but one has to remember the new universal constant of 'clue factor'. -- Chris Chaundy (Director - Network Services) connect.com.au pty ltd, Level 9, 114 Albert Road, Sth Melbourne, VIC 3205, Aust. Internet: chris@connect.com.au Phone: +61 3 9251 3671 Fax: +61 3 9251 3666
participants (12)
-
Aaron Moreau-Cook
-
Brett L. Hawn
-
Chris Chaundy
-
J. Scott Marcus
-
Jared Mauch
-
John Fraizer
-
Kai Schlichting
-
Randy Bush
-
Timothy Brown
-
Tony Bates
-
Vijay Gill
-
ww@pandora.styx.org