- NANOG - lists.nanog.org

Re: Temp at Level 3 data centers
by Baldur Norddahl 11 Oct '17

11 Oct '17

Den 11. okt. 2017 22.47 skrev "William Herrin" <bill(a)herrin.us>: On Wed, Oct 11, 2017 at 4:32 PM, Jörg Kost <jk(a)ip-clear.de> wrote: > Do you guys still at least have biometric access control devices at your > Level3 dc? They even removed this things at our site, because there is no > budget for a successor for the failing unit. And to be consistent, they > event want to remove all biometric access devices at least across Germany. > Hi Jörg, IMO, biometric was a gimmick in the first place and a bad idea when carefully considered. All authenticators can be compromised. Hence, all authenticators must be replaceable following a compromise. If one of your DCs' palm vein databases is lost, what's your plan for replacing that hand? Basic two or three factor authentication: something that you know (password), something that you are (biometric) and something that you have (access card). You can tell your password to a coworker but he can not borrow your hand. Hence you need both. The password is the replaceable part.

1 0

Re: Temp at Level 3 data centers
by Zachary Winnerman 11 Oct '17

11 Oct '17

That's a good point, though if you are running your breakers that close I think you have bigger problems, as a power outage, however unlikely, could cause your equipment to not come back up at all. Software updates that reboot several servers in quick succession could also cause a breaker to trip under those circumstances. Unfortunately, there's no way to tell how close a breaker is to tripping without tripping it. Breakers may have amp meteres and a rated size, but the actual load before tripping is +-20% for common models, meaning a 20A breaker may trip as low as 16A. On 2017年10月11日 12:58, Matt Harris wrote: > Another thing to remember - and I've actually seen breakers tripped on > PDUs due to heat before because of this - is that it's going to spin > all of your fans harder to keep internal temps down if the ambient > temp is higher. This will increase your power draw, which means that > if you're paying for metered power by usage, you're going to pay more > - those fans really do add up in terms of power. In extreme cases, you > can draw too much power and trip a breaker on a PDU because every host > in a rack, or especially those towards the top, are spinning full > tilt. It's not a good condition and one that you should force them to > correct. > > > On Wed, Oct 11, 2017 at 11:54 AM, Zachary Winnerman > <zacharyw09264(a)gmail.com <mailto:zacharyw09264@gmail.com>> wrote: > > I recall some evidence that 80+F temps can reduce hard drive lifetime, > though it might be outdated as it was from before SSDs were around. I > would imagine that while it may not impact the ability for a server to > handle load, it may reduce equipment lifetime. It also could be an > indication that they lack redundancy in the case of an AC failure. > This > could cause equipment damage if the datacenter is unattended and > temperatures are allowed to rise. > > > On 2017年10月11日 11:45, Keith Stokes wrote: > > There are plenty of people who say 80+ is fine for equipment and > data centers aren’t built for people. > > > > However other things have to be done correctly. > > > > Are you sure your equipment is properly oriented for airflow > (hot/cold aisles if in use) and has no restrictions? > > > > On Oct 11, 2017, at 9:42 AM, Sam Kretchmer > <sam(a)coeosolutions.com > <mailto:sam@coeosolutions.com><mailto:sam@coeosolutions.com > <mailto:sam@coeosolutions.com>>> wrote: > > > > with a former employer we had a suite at the L3 facility on Canal in > > Chicago. They had this exact issue for the entire time we had > the suite. > > They kept blaming a failing HVAC unit on our floor, but it went > on for > > years no matter who we complained to, or what we said. > > > > Good luck. > > > > > > On 10/11/17, 7:31 AM, "NANOG on behalf of David Hubbard" > > <nanog-bounces(a)nanog.org > <mailto:nanog-bounces@nanog.org><mailto:nanog-bounces@nanog.org > <mailto:nanog-bounces@nanog.org>> on behalf of > dhubbard(a)dino.hostasaurus.com > <mailto:dhubbard@dino.hostasaurus.com><mailto:dhubbard@dino.hostasaurus.com > <mailto:dhubbard@dino.hostasaurus.com>>> wrote: > > > > Curious if anyone on here colo¹s equipment at a Level 3 facility > and has > > found the temperature unacceptably warm? I¹m having that experience > > currently, where ambient temp is in the 80¹s, but they tell me > that¹s > > perfectly fine because vented tiles have been placed in front of all > > equipment racks. My equipment is alarming for high temps, so > obviously > > not fine. Trying to find my way up to whomever I can complain > to that¹s > > in a position to do something about it but it seems the support > staff > > have been told to brush questions about temp off as much as > possible. > > Was wondering if this is a country-wide thing for them or unique > to the > > data center I have equipment in. I have equipment in several > others from > > different companies and most are probably 15-20 degrees cooler. > > > > Thanks, > > > > David > > > > > > > > --- > > > > Keith Stokes > > > > > > > > > > > > > > -- > Matt Harris - Chief Security Officer > Main: +1 855.696.3834 ext 103 > Mobile: +1 908.590.9472 > Email: matt(a)netfire.net <mailto:matt@netfire.net>

2 1

Why don't large carriers use alternate communication routes?
by Sean Donelan 11 Oct '17

11 Oct '17

This is an op-ed, but most California internet folks know about recurring outages for a decade on this fiber route. What was unusual is the local governments eventually used public funds to help pay for an east-west alternate fiber route. Instead of leasing capacity on alternate routes, the dominate carrier continued to use the single fiber route (which it owns). And the customer outages continue. Are the penalties for subscribe outages so minimal that it makes business sense not to use backup alternate routes? https://lostcoastoutpost.com/2017/oct/10/two-years-ago-t-promised-end-mass-… Two Years Ago, AT&T Promised to End Mass Telecommunication Outages. How’s That Working Out?

2 1

Question about Customer Population by ASN for Canada
by Jacques Latour 11 Oct '17

11 Oct '17

Hi all! I'm working on our IPv6 and DNSSEC adoption report for Canada and the data I use comes largely from APNIC (https://stats.labs.apnic.net/dnssec/CA) and (https://stats.labs.apnic.net/ipv6/CA) Labs.APNIC has a pretty cool system to measure this kind of stuff by deploying specially crafted google ads, see "How Big is that Network?" https://labs.apnic.net/?p=526, and APNIC is able to assess the population behind a network based on ad placement distribution. See https://stats.labs.apnic.net/cgi-bin/aspop?c=CA for Canada. The question I have is why does OVH come #6 with an estimated population of 1,480,927 behind its ASN? Remember these are actual placement of ads. Should I count those users as part of my stats? Rank ASN AS Name CC Users (est.) % of country % of Internet Samples 1 AS812 ROGERS-CABLE - Rogers Cable Communications Inc. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 5,420,034 16.72 0.16 555,718 2 AS577 BACOM - Bell Canada CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 4,474,012 13.8 0.132 458,722 3 AS6327 SHAW - Shaw Communications Inc. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 3,708,414 11.44 0.109 380,225 4 AS852 ASN852 - TELUS Communications Inc. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 2,914,405 8.99 0.086 298,815 5 AS5769 VIDEOTRON - Videotron Telecom Ltee CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 2,189,946 6.76 0.065 224,536 6 AS16276 OVH CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 1,480,927 4.57 0.044 151,840 7 AS15290 ALLST-15290 - Allstream Corp. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 1,272,374 3.93 0.038 130,457 8 AS855 CANET-ASN-4 - Bell Aliant Regional Communications, Inc. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 1,211,485 3.74 0.036 124,214 9 AS7992 COGECOWAVE - Cogeco Cable CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 1,112,002 3.43 0.033 114,014 10 AS5645 TEKSAVVY - TekSavvy Solutions, Inc. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 967,401 2.98 0.029 99,188 11 AS11260 EASTLINK-HSI - EastLink CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 695,598 2.15 0.021 71,320 12 AS47027 SEASIDE-COMM - Seaside Communications, Inc. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 425,561 1.31 0.013 43,633 13 AS803 SASKTEL - Saskatchewan Telecommunications CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 392,186 1.21 0.012 40,211 14 AS11814 DISTRIBUTEL-AS11814 - DISTRIBUTEL COMMUNICATIONS LTD. CA<https://stats.labs.apnic.net/cgi-bin/aspop?c=CA> 370,348 1.14 0.011 37,972 Jack

9 11

ATT NOC
by Gavin Henry 10 Oct '17

10 Oct '17

Hi all, For a while now (11 days) we've been trying to reach ATT as it some of our traffic is dying within their network. It's traffic destined for their customer networks so we can't raise a ticket with ATT directly. We've emailed their NOC, but nothing and since then been trying to raise tickes via phone with their customers that we can't reach, but we're not their customers either....I'm pretty certain one of our /22 is getting dropped, as our other /22 works (we're small guys). Can anyone help confirm our theory by putting us in touch? Thanks. -- Kind Regards, Gavin Henry. Managing Director.

2 5

California wildfires - communications status
by Sean Donelan 10 Oct '17

10 Oct '17

There have been many large wildfires in western states for the last couple of months, but most have been in less populated areas. Several folks have asked about cell phone problems because of the fires in California. Sonoma and Napa county sheriff departments are reporting widespread power outages, and spotty cell phone service in those counties. No specifics about how many cell towers are impacted. Landlines seem to be less affected. Comcast has announced open access to its WiFi access points in Napa and Sonoma county.

1 2

TWCC engineer lurking?
by Bryan Holloway 10 Oct '17

10 Oct '17

TWCC erroneously shut down one of our East coast circuits, and we keep getting bounced around from department to department, even though accounting has conceded that the circuit is fine and should be up. If anyone could assist, please contact me off-list? Thanks!

1 0

Hurricane Maria: Summary of communication status - and lack of
by Sean Donelan 10 Oct '17

10 Oct '17

This summary status is a bit different. Instead it is a report about what we don't know, and estimate how much we don't know based on official reporting. The FCC DIRS report is based on outages reported by service providers. Almost no local providers have been able to file either a positive or negative report on the DIRS website. So the data is very incomplete. Electric Services Puerto Rico: 1,569,796 customers out of service (100%) U.S. Virgin Islands: 90% of grid on St. Thomas and St. John destroyed by Hurricane Irma, a few critical facilities re-energized. 25,000 customers on St. Croix out of service after Hurricane Maria, but may be able to re-energize most of the St. Croix grid on Friday. Internet Services All submarine cables and landing stations appear operational. 2 colocation data centers on Puerto Rico appear to be operational. I couldn't tell if there any of the old Internet Exchange Points were still operating, or had ceased before the hurricanes. Puerto Rico: Approximately 880 networks out of 1200 not reachable (24 out 48 ASN). U.S. Virgin Islands: Approximately 13 networks out of 70 not reachable (2 out of 6 ASN) Public Safety Services Public Safety Answering Points (9-1-1 centers) Puerto Rico: 2 out of 2 PSAPs reporting. 2 operating normally. US Virgin Islands: 2 out of 2 PSAPs reporting. 2 operating without automatic location identifier NOAA Weather Forecast Office Puerto Rico: Office on backup generation, weather RADAR offline, 1 of 2 Weather Radio transmitters offline US Virgin Islands: Served by San Juan, PR WFO, 1 of 1 Weather Radio transmitter offline Wireless Services Puerto Rico: (1703 cell sites out of 1789) 95% of cell sites out of service. 48 out of 78 counties with 100% of cell sites out of service. U.S. Virgin Islands: (82 cell sites out of 107) 77% of cell sites out of service. Cable and Wireline Systems Puerto Rico (est. 11 companies-ILEC, CLECs and Cable in LATA) FCC summary implies no companies have reported yet. Large percentages of consumers without cable or wireline service U.S. Virgin Islands (est. 3 companies-ILEC, CLECs and Cable in LATA) FCC summary implies no companies have reported yet. Large percentage of consumers without cable or wireline service Broadcast facilities Puerto Rico 34 TV stations-not including repeaters, translators, boosters 1 TV station reporting - 1 station out of service 33 TV stations not reporting (public reports no TV stations operating on air) 141 radio stations-not including repeaters, translators 141 radio stations not reporting (public reports estimate a dozen radio stations operating on air) U.S. Virgin Islands 5 TV stations- not including repeaters, translaters, boosters 5 TV stations not reporting 26 radio stations-not including repeaters, translators 26 radio stations not reporting

17 62

Clueful contact at Microsoft for Office365?
by John Morrissey 09 Oct '17

09 Oct '17

Anyone have a clueful contact at Microsoft for Office365? We're having some deliverability issues, and haven't gotten anywhere by going through normal channels. The joys of turning up e-mail for a new domain, I guess. :-/ -john

1 0

contact ATT
by Trey Nolen 09 Oct '17

09 Oct '17

We have a managed router which AT&T has put in place. Because it is managed, we do not have control over the router. It is going down every 5 to 6 days. We were assured that it was a known issue for the model we have and worked for over 2 weeks to get the firmware updated. The update did not fix the problem and we desperately need to find someone at AT&T who has the authority to replace this router. If someone can contact me off list to help me get this accomplished, I'll be glad to furnish the tickets for circuit history and such. Thanks. Trey Nolen

1 0