On Sun, Oct 15, 2023 at 9:47 AM Dave Taht <dave.taht@gmail.com> wrote:
[...]
The three forms of traffic I care most about are voip, gaming, and
videoconferencing, which are rewarding to have at lower latencies.
When I was a kid, we had switched phone networks, and while the sound
quality was poorer than today, the voice latency cross-town was just
like "being there". Nowadays we see 500+ms latencies for this kind of
traffic.

When you were a kid, the cost of voice calls across town were completely 
dwarfed by the cost of long distance calls, which were insane by today's 
standards.  But let's take the $10/month local-only dialtone fee from 1980; 
a typical household would spend less than 600 minutes a month on local calls, 
for a per-minute cost for local calls of about 1.6 cents/minute.
(data from https://babel.hathitrust.org/cgi/pt?id=umn.319510029171372&seq=75 )

Each call would use up a single trunk line--today, we would think of that as an
ISDN BRI at 64Kbits.  Doing the math, that meant on average you were using 
64Kbit/sec*600minutes*60sec/min or 2304000Kbit per month (2.3 Gbit/month).

A 1Mbit/sec circuit, running constantly, has a capacity to transfer 2592Gbit/month.
So, a typical household used about 1/1000th of a 1Mbit/sec circuit, on average, 
but paid about $10/month for that.  That works out to a comparative cost of 
$10,000/Mbit/month in revenue from those local voice calls.

You can afford to put in a *LOT* of "just like "being there"" infrastructure when
 you're charging your customers the equivalent of $10,000/month per Mbit to 
talk across town.  Remember, this isn't adding in any long-distance charges,
this is *just* for you to ring up Aunt Maude on the other side of town to ask when 
the bake sale starts on Saturday.  So, that revenue is going into covering 
the costs of backhaul to the local IXP, and to your ports on the local IXP, 
to put it into modern terms.
 
As to how to make calls across town work that well again, cost-wise, I
do not know, but the volume of traffic that would be better served by
these interconnects quite low, respective to the overall gains in
lower latency experiences for them.

If you can figure out how to charge your customers equivalent pricing 
again today, you'll have no trouble getting those calls across town to
work that well again.
Unfortunately, the consumers have gotten used to much lower 
prices, and it's really, really hard to stuff the cat back into the 
genie bottle again, to bludgeon a dead metaphor.
Not to mention customers have gotten much more used to the 
smaller world we live in today, where everything IP is considered "local", 
and you won't find many willing customers to pay a higher price for 
communicating with far-away websites.  Good luck getting customers 
to sign up for split contracts, with one price for talking to the local IXP 
in town, and a different, more expensive price to send traffic outside 
the city to some far-away place like Prineville, OR!  ;)

 I think we often forget just how much of a massive inversion the 
communications industry has undergone; back in the 80s, when 
I started working in networking, everything was DS0 voice channels, 
and data was just a strange side business that nobody in the telcos 
really understood or wanted to sell to.  At the time, the volume of money 
being raked in from those DS0/VGE channels was mammoth compared 
to the data networking side; we weren't even a rounding error.  But as the 
roles reversed and the pyramid inverted, the data networking costs didn't
rise to meet the voice costs (no matter how hard the telcos tried to push
VGE-mileage-based pricing models! 
-- see https://transition.fcc.gov/form477/FVS/definitions_fvs.pdf)
Instead, once VoIP became possible, the high-revenue voice circuits 
got pillaged, with more and more of the traffic being pulled off over to 
the cheaper data side, until even internally the telcos saw the writing 
on the wall, and started to move their trunked voice traffic over to IP 
as well.
But as we moved away from the SS7-based signalling, with explicit 
information about the locality of the destination exchange giving way 
to more generic IP datagrams, the distinction of "local" versus "long-distance" 
became less meaningful, outside the regulatory tariff domain.  
When everything is IP datagrams, making a call from you to a person on 
the other side of town may just as easily be exchanged at an exchange point 
1,000 miles away as it would be locally in town, depending upon where your 
carrier and your friend's carriers happen to be network co-incident.  So, for 
the consumer, the prices go drastically down, but in return, we accept 
potentially higher latencies to exchange traffic that in earlier days would
have been kept strictly local.

Long-winded way of saying "yes, you can go back to how it was when 
you were a kid--but can you get all your customers to agree to go back 
to those pricing models as well?"   ^_^;

Thanks!

Matt


--
Oct 30: https://netdevconf.info/0x17/news/the-maestro-and-the-music-bof.html
Dave Täht CSO, LibreQos