Re: Keynote/Boardwatch Internet Backbone Index A better te

From: Mark Borchers <markb@infi.net> To: Jack Rickard <jack.rickard@boardwatch.com> Cc: nanog@merit.edu Subject: Re: Keynote/Boardwatch Internet Backbone Index A better te Date: Friday, June 27, 1997 6:09 AM
Jack,
I think you've stated for yourself the reason that this Index has drawn some criticism.
By it's name it purports to be an index of backbone speed or backbone congestion or a combination of the above.
Not only is it not really an index of these items, it could further be argued that there's not even any reliable way to draw conclusions about backbone performance from the Keynote measurements. As you say, there are many other variables. So why not give this thing a name that reflects it's real identity as an end-to-end test from the Keynote Perspective Agent locations to various WWW servers.
This assumes that you consider web server location and web server performance to NOT be a part of overall network performance. Our view steps back a bit from that. The majority of traffic would appear to be webcentric. From an end users perspective, what does a web site on a specific network look like and how does that compare to a web site on another network? There are ENDLESS variables contributing to that including intercity links, hub architecture, host hardware, host software, peering, connectivity points with other networks, transit agreements, type of routers, ATM switching (or not). All contribute. We think most
I probably don't agree that it is not a reliable way to draw conclusions about backbone performance. The index has drawn criticism because it points up winners and losers and that's about it. There is no way to do this without criticism, and indeed it should be part of the process. The end user experience will reflect the sum of that, plus dialup variables which we simply do not include in this work. Jack Rickard ---------- people
notice Internet performance (or lack thereof) while viewing world wide web pages.

On Jun 27, Jack Rickard <jack.rickard@boardwatch.com> wrote:
I probably don't agree that it is not a reliable way to draw conclusions about backbone performance. The index has drawn criticism because it points up winners and losers and that's about it. There is no way to do this without criticism, and indeed it should be part of the process.
If you had actually read some of the responses without having made up your mind beforehand (which, as I recall from when I was a journalism student, is a sure sign that your pretenses of objectivity are lost), you might notice that both "winners" and "losers" are pointing out the SAME flaws in the study. Please go re-read the archives with a more open mind. *********************************************************************** J.D. Falk voice: +1-415-482-2840 Supervisor, Network Operations fax: +1-415-482-2844 PRIORI NETWORKS, INC. http://www.priori.net "The People You Know. The People You Trust." ***********************************************************************

At 04:24 PM 6/27/97 -0600, Jack Rickard wrote:
I probably don't agree that it is not a reliable way to draw conclusions about backbone performance. The index has drawn criticism because it points up winners and losers and that's about it. There is no way to do this without criticism, and indeed it should be part of the process.
Jack, let me point out that I am one of your largest critics on this one, and I'm not even up and running yet. I can't win or lose, its just a bad setup. It is not a reliable way to draw conclusions about backbone performance. (Note the sentence ends there, there is no probably, there is no agreement or disagreement, simply a statement. You may believe what you like.) This /is/ a study of how quickly backbone companies web servers serve web pages to the locations that you were testing from. I would bet that Netscape, Playboy, Sun, and a few other people who are very concerned about their web presence would have better "backbones" than any backbone provider according to your statistics. Daniel McRobb's post hit the nail on the head. If KC over at NLANR says that your study is good, I'll believe her. If /anyone/ who's opinion I trust says your study was good I'll at least reconsider my opinion. As it stands, I'll stand by my statements.
The end user experience will reflect the sum of that, plus dialup variables which we simply do not include in this work.
Justin "I've had more end users on my network than you have ever seen, or possibly even read about" Newton ********************************************************* Justin W. Newton voice: +1-415-482-2840 Senior Network Architect fax: +1-415-482-2844 PRIORI NETWORKS, INC. http://www.priori.net Director At Large, ISP/C http://www.ispc.org "The People You Know. The People You Trust." *********************************************************
participants (3)
-
J.D. Falk
-
Jack Rickard
-
Justin W. Newton