March 2020 - NANOG - lists.nanog.org

CISA: Guidance on the Essential Critical Infrastructure Workforce
by Sean Donelan 19 Mar '20

19 Mar '20

The U.S. Cyber and Infrastructure Security Agency (part of the U.S. Department of Homeland Security) has issued new Guidance on the Essential Critical Infrastructure Workforce. The memorandum is advisory, not presecriptive. DHS is only one of several agencies assigned some National Essential Functions so it is not exhaustive list. It looks like someone found the three-ring emergency plan binders. Sad its needed, but appreciative of the experts which helped write those planning documents over the years. https://www.cisa.gov/publication/guidance-essential-critical-infrastructure -workforce [...] The attached list identifies workers who conduct a range of operations and services that are essential to continued critical infrastructure viability, including staffing operations centers, maintaining and repairing critical infrastructure, operating call centers, working construction, and performing management functions, among others. The industries they support represent, but are not necessarily limited to, medical and healthcare, telecommunications, information technology systems, defense, food and agriculture, transportation and logistics, energy, water and wastewater, law enforcement, and public works. We recognize that State, local, tribal, and territorial governments are ultimately in charge of implementing and executing response activities in communities under their jurisdiction, while the Federal Government is in a supporting role. As State and local communities consider COVID-19-related restrictions, CISA is offering this list to assist prioritizing activities related to continuity of operations and incident response, including the appropriate movement of critical infrastructure workers within and between jurisdictions. Accordingly, this list is advisory in nature. It is not, nor should it be considered to be, a federal directive or standard in and of itself. [...]

2 1

DHS letters for fuel and facility access
by Sean Donelan 19 Mar '20

19 Mar '20

On some other mailing lists, FCC licensed operators are reporting they have received letters from the Department of Homeland Security authorizing "access" and "fuel" priority. Occasionally, DHS issues these letters after natural disasters such as hurricanes for hospitals and critical facilities. I haven't heard of them issued for pandemics.

17 28

UDP/123 policers & status
by Jared Mauch 19 Mar '20

19 Mar '20

I’m curious what people are seeing these days on the UDP/123 policers in their networks. I know while I was at NTT we rolled some out, and there are a number of variants that have occurred over the past 6-7 years. I’ve heard from people at the NTP Pool as well as having observed some issues with NTP at Akamai and time sync from time to time. Are you still seeing a lot of NTP attacks in your flows these days? Should we be looking to remove these, similar to how we did for SQL/Slammer after a time? - Jared

8 11

Quagga for production?
by Dmitry Sherman 18 Mar '20

18 Mar '20

Hello, Anybody working with Quagga for production peering with multiple peers and dynamic eBGP/iBGP announcement? Thanks. Dmitry

8 14

SD-WAN Operators Group
by Hiers, David 18 Mar '20

18 Mar '20

Hi, If you’re interested in SD-WAN, I’ve started a NANOG-knockoff over on groups.io. https://groups.io/g/sdwanoperators it has all the usual SMTP controls: * Post: sdwanoperators(a)groups.io<mailto:sdwanoperators@groups.io> * Subscribe: sdwanoperators+subscribe(a)groups.io<mailto:sdwanoperators+subscribe@groups.io> * Unsubscribe: sdwanoperators+unsubscribe(a)groups.io<mailto:sdwanoperators+unsubscribe@groups.io> * Group Owner: sdwanoperators+owner(a)groups.io<mailto:sdwanoperators+owner@groups.io> * Help: sdwanoperators+help(a)groups.io<mailto:sdwanoperators+help@groups.io> Regards, David ---------------------------------------------------------------------- This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, notify the sender immediately by return email and delete the message and any attachments from your system.

1 0

NetEase contact
by Jack Leung (R* NYC) 18 Mar '20

18 Mar '20

Hi all Does anyone here have a contact at NetEase, an online service provider out of China. We have a number of customers in Asia who have them as their provider/carrier and are hitting outdated DNS entries so I'm trying to get to the bottom of it. Support tickets have gone unanswered. Thanks! Jack

1 0

Google Fiber (KC) NOC contact
by Blake Hudson 18 Mar '20

18 Mar '20

Does someone from Google Fiber hang out on this list? I've contacted arin-contact(a)google.com (the WHOIS tech and admin contact), but not gotten any response and I suspect contacting a frontline callcenter would be fruitless. It appears that some portion of customers in KC are being provided with a lame/broken NTP server address and it's causing some VPN/Telephony problems for those affected. If someone has a better POC please let me know so we can get this cleared up for us and other businesses in the KC area. --Blake

2 1

traffic sag last night (early this morning)
by Aaron Gould 18 Mar '20

18 Mar '20

At 00:49 minutes past midnight today I saw a bit of a traffic sag across all 3 of my different upstream providers. All in Texas. Anyone else see that ? -Aaron

1 0

Re: COVID-19 vs. our Networks
by Clayton Zekelman 18 Mar '20

18 Mar '20

The Internet is not a telecommunications service, according to your FCC. If you want predictability, buy WAN circuits, not Internet circuits. If your provider is co-mingling Internet and WAN traffic (i.e. circuits with defined endpoints vs. public Internet or VPN), then you need to talk to them about their prioritization. If you have mission critical applications, put them on mission critical infrastructure, not the public Internet. Oh, that's right - Internet circuits are cheaper than WAN circuits. At 01:14 PM 14/03/2020, Mike Bolitho wrote: >Seems arbitrary. Â Lots of networks have lots >of Netflix/etc capacity.Â Who determines what >is "mission critical"?Â Our mission as an ISP >is to deliver Internet to our customers.Â If >they want to play online games or watch video, >who am I to say that isn't critical to THEIR mission?...Â >Â >...The last thing we need are a bunch of kids in >quarantine that have NOTHING to do because Mike >Bolitho thinks their entertainment isn't part of the "mission" of the Internet. > > >We already have that. It's called >Telecommunications Service Priority and this is the charge: > >Telecommunications Service Priority (TSP) is a >program that authorizes national security and >emergency preparedness (NS/EP) organizations to >receive priority treatment for vital voice and >data circuits or other telecommunications services. > > >I work for a hospital, we ran into some issues >last week due to congestion that was totally >outside of our control that was off of our WAN >(Thanks Call Of Duty). Now, the issue we ran >into was not mission critical at the time but it >was still disruptive. As more and more people >are driven home during this time, more and more >people will be using bandwidth intensive >streaming and online gaming products. If more >and more TSP coded entities are running into >issues, ISPs, IXPs, and CDNs will be forced to act. > >For more information: > ><https://www.cisa.gov/telecommunications-service-priority-tsp>https://www.cisa.gov/telecommunications-service-priority-tspÂ > > >https://www.fcc.gov/general/telecommunications-service-priority > ><https://en.wikipedia.org/wiki/Telecommunications_Service_Priority>https://en.wikipedia.org/wiki/Telecommunications_Service_PriorityÂ > >Â >These views are my own and do not reflect the >opinions or official stances of my employer etc etc. > >- Mike Bolitho > > >On Sat, Mar 14, 2020 at 9:27 AM Clayton Zekelman ><<mailto:clayton@mnsi.net>clayton(a)mnsi.net> wrote: >Seems arbitrary.Â Â Lots of networks have lots >of Netflix/etc capacity.Â Who determines what >is "mission critical"?Â Our mission as an ISP >is to deliver Internet to our customers.Â If >they want to play online games or watch video, >who am I to say that isn't critical to THEIR mission? >The last thing we need are a bunch of kids in >quarantine that have NOTHING to do because Mike >Bolitho thinks their entertainment isn't part of the "mission" of the Internet. >About the only thing that might be useful is >something to smooth out the big jumps in >utilization on game releases - but even that is >something that can be managed by adding capacity. >To quote Jay Leno - Crunch All You Want, We'll Make More. >At 12:16 PM 14/03/2020, Mike Bolitho wrote: >>Basically that. It's probably more streaming >>services that could crowd out what would be >>considered "mission critical" infrastructure. >>Maybe the Netflixs and HulusÃ of the world >>will limit 4K streaming or something along >>those lines. Basically cap resolution to 720p for the time being. >>- Mike Bolitho >>On Sat, Mar 14, 2020 at 1:06 AM Hugo Slabbert >><<mailto:hugo@slabnet.com>hugo(a)slabnet.com> wrote: >> >Ã The impact of all these bored school kids >> on the networks due to gaming might cause some >> issues. I know that if I'm working from home >> and my videoconferencing slows down because of >> someones gaming, I'm taking the necessary >> action (read, change some rules on my firewall).Ã >>People are welcome to do whatever they want on >>their own networks. I just didn't get the >>suggestion that online gaming services would >>shut down. Or were you saying, Mike, that >>online gaming would crowd out other services >>and so "shut down" those other services? >>On Fri., Mar. 13, 2020, 21:42 Owen DeLong >><<mailto:owen@delong.com>owen(a)delong.com> wrote: >>You donÃ¢t have kids, do you >>br> >>They have the attention span off Koi these >>days. TheyÃ¢â¬ll play most games for about 15 >>minutes or so before downloading the next one. >>(At least thatÃ¢s been my observation of >>behavior among mg my GFÃ¢s daughter r and her friends). >>Owen >> >> >>>On Mar 13, 2020, at 20:31 , Darin Steffl >>><<mailto:darin.steffl@mnwifi.com>darin.steffl(a)mnwifi.com > wrote: >>>Playing games doesn't take much bandwidth. >>>Downloading games does. So as long as everyone >>>already has their games and there's no >>>updates, playing the game is typically under >>>100 kbps which is negligible compared to >>>streaming video which takes 1 to 25 mbps.Ã >>>On Fri, Mar 13, 2020, 8:52 PM Sabri Berisha >>><<mailto:sabri@cluecentral.net>sabri(a)cluecentral.net> wrote: >>>Hi, >>>I don't know where y'all live, but here in the >>>SF Bay Area, pretty much all public and >>>private schools have closed down. My school >>>district (in Santa Clara County) will be closed until Spring Break. >>>The impact of all these bored school kids on >>>the networks due to gaming might cause some >>>issues. I know that if I'm working from home >>>and my videoconferencing slows down because of >>>someones gaming, I'm taking the necessary >>>action (read, change some rules on my firewall).Ã >>>Thanks, >>>Sabri >>>----- On Mar 13, 2020, at 4:12 PM, Hugo >>>Slabbert <<mailto:hugo@slabnet.com>hugo(a)slabnet.com> wrote: >>>I think under circumstances like this, I could >>>definitely see some of the online based games shutting services down. >>> >>>Ã >>>How so? >>>Signed, >>>Someone who works for an online gaming company >>>and has heard nothing of this. >>>--Ã >>>Hugo SlabbertÃÂ ÃÂ ÃÂ Ã | email, >>>xmpp/jabber: <mailto:hugo@slabnet.com>hugo(a)slabnet.com >>>pgp key: B178313EÃÂ Ã | also on Signal >>>On Fri, Mar 13, 2020 at 2:52 PM Mike Bolitho >>><<mailto:mikebolitho@gmail.com>mikebolitho(a)gmail.com> wrote: >>>I think under circumstances like this, I could >>>definitely see some of the online based games shutting services down. >>>- Mike Bolitho >>>On Fri, Mar 13, 2020 at 2:41 PM Ahmed Borno >>><<mailto:amaged@gmail.com>amaged(a)gmail.com> wrote: >>>Its already happening in Italy, and now that >>>schools are shutting down here as well, its going to get interesting:Ã >>><https://www.bloomberg.com/news/articles/2020-03-12/housebound-italian-kids-…>https://www.bloomberg.com/news/articles/2020-03-12/housebound-italian-kids-… >>> >>>The ultimate traffic test is coming, looking >>>forward to hearing about it on this thread. >>>Maybe its a good time to start a communication >>>channel between content providers/gaming companies and ISPs/CDNs. >>>On Fri, Mar 13, 2020 at 11:22 AM Rubens Kuhl >>><<mailto:rubensk@gmail.com>rubensk(a)gmail.com> wrote: >>> >>> >>>On Thu, Mar 12, 2020 at 3:46 PM >>><mailto:g@1337.io>g(a)1337.io <<mailto:lists@1337.io>lists(a)1337.io> wrote: >>>With talk of there being an involuntary >>>statewide (WA) and then national quarantines >>>(house arrest) for multiple weeks, has anyone >>>put thought into the impacts of this on your >>>networks if/when this comes to fruition? >>>We're already pushing the limits with >>>telecommuters / those that are WFH, but I can >>>only imagine what things will look like with >>>everyone stuck at home for any duration of time. >>> >>> >>>People will turn to you and every other ISP >>>hoping you keep them online. So besides demand >>>issues, keeping your network up will be important to a whole lot of people.Ã >>>Rubens >>>Ã >-- > >Clayton Zekelman >Managed Network Systems Inc. (MNSi) >3363 Tecumseh Rd. E >Windsor, Ontario >N8W 1H4 > >tel. 519-985-8410 >fax. 519-985-8409Â Â Â Â Â Â Â -- Clayton Zekelman Managed Network Systems Inc. (MNSi) 3363 Tecumseh Rd. E Windsor, Ontario N8W 1H4 tel. 519-985-8410 fax. 519-985-8409

16 45

WIKI documentation Software?
by Craig 18 Mar '20

18 Mar '20

Wanted to ask what WIKI software teams are using to save documentation to / how to's for staff, etc. pro's con's We have an older wiki bare-metal wiki server, that I want to get replaced before it kicks the bucket and was looking into various ones. thanks; CPV

17 18