I would personally have end IT friendly mimick and test their existing systems on the nee ISP. Especially cloud tech having read a book on cloud by some PHD administrators they redefined cloud as being cloudy in a sense to do with not knowing what route your clients packets will take to reach the server. Sent via BT Email App From: Tim Burke <tim@mid.net> Sent: 8 August 2023 22:47:06 BST To: Mike Hammett <nanog@ics-il.net>, NANOG <nanog@nanog.org> Subject: Re: Last Mile ISP Quality Measurements We are doing something similar with netpath in Solarwinds, but mainly using the stream URLs of some popular streaming services that we see commonly used (FuboTV, etc). Came in handy recently in tracking down customer complaints that ended up being a peering capacity issue further upstream. Tim From: NANOG <nanog-bounces+tim=mid.net@nanog.org> on behalf of Mike Hammett <nanog@ics-il.net> Sent: Tuesday, August 8, 2023 4:08 PM To: NANOG <nanog@nanog.org> Subject: Last Mile ISP Quality Measurements What are other last mile ISPs doing to measure the quality of their connections? We all know pinging various destinations. We also all know that pinging a destination doesn't necessarily tell you the whole quality story. I currently have Smokeping pulling the HTTPS for about 20 - 25 of the "top" websites, per the old Alexa rankings. I feel as though I could be doing more. I am more closely wanting to emulate the end-user experience in a repeatable, quantifiable fashion. I'd like to do A/B comparisons as well. When I make X change, how does it change? If I'm already doing the low-hanging fruit path, then so be it. ----- Mike Hammett Intelligent Computing Solutions <http://www.ics-il.com/> <https://www.facebook.com/ICSIL> <https://plus.google.com/+IntelligentComputingSolutionsDeKalb> <https://www.linkedin.com/company/intelligent-computing-solutions> <https://twitter.com/ICSIL> Midwest Internet Exchange <http://www.midwest-ix.com/> <https://www.facebook.com/mdwestix> <https://www.linkedin.com/company/midwest-internet-exchange> <https://twitter.com/mdwestix> The Brothers WISP <http://www.thebrotherswisp.com/> <https://www.facebook.com/thebrotherswisp> <https://www.youtube.com/channel/UCXSdfxQv7SpoRQYNyLwntZg>