Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] ________________________________ IS Group Wielingenstraat 8 T +31 (0)299 476 185 info@is.nl<mailto:info@is.nl> 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nl<http://www.is.nl> ________________________________ IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
The advantage of SMS is that it is out of band. Any smtp or other IP based solution requires a stable and working network environment, which is what the alert may be trying to tell you is down. ---- Matthew Huff | 1 Manhattanville Rd Director of Operations | Purchase, NY 10577 OTA Management LLC | Phone: 914-460-4039 aim: matthewbhuff | Fax: 914-694-5669 -----Original Message----- From: NANOG [mailto:nanog-bounces@nanog.org] On Behalf Of Thijs Stuurman Sent: Friday, November 21, 2014 10:52 AM To: nanog@nanog.org Subject: Incident notification Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] ________________________________ IS Group Wielingenstraat 8 T +31 (0)299 476 185 info@is.nl<mailto:info@is.nl> 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nl<http://www.is.nl> ________________________________ IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
The advantage of SMS is that it is out of band. Any smtp or other IP based solution requires a stable and working network environment, which is what the alert may be trying to tell you is down.
I do not worry so much about that, part of the monitoring solution is out of band for that reason. Kind regards / Met vriendelijke groet, Thijs Stuurman
On Fri, Nov 21, 2014 at 10:56 AM, Matthew Huff <mhuff@ox.com> wrote:
The advantage of SMS is that it is out of band. Any smtp or other IP based solution requires a stable and working network environment, which is what the alert may be trying to tell you is down.
Which is why you locate a small NMS outside your network (on a VM somewhere) whose only job is to start alerting when it can't reach the NMS inside your network. That also helps when your interior NMS system gets gummed up or when a general emergency in your locality damages your infrastructure at the same time as the SMS provider's infrastructure. If your monitoring system is structured well to begin with, email has efficacy comparable to sms. A smartphone app expecting heartbeats via your in-band infrastructure has effectiveness superior to both. Regards, Bill Herrin -- William Herrin ................ herrin@dirtside.com bill@herrin.us Owner, Dirtside Systems ......... Web: <http://www.dirtside.com/> May I solve your unusual networking challenges?
Pagerduty for phone calls. Can do SMS as well, I believe. Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Nov 21, 2014 at 10:52 AM, Thijs Stuurman <Thijs.Stuurman@is.nl> wrote:
Nanog list members,
I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway.
Therefore my question, what are you using to notify admins of incidents?
Kind regards / Met vriendelijke groet,
Thijs Stuurman
[IS Logo]
________________________________
IS Group
Wielingenstraat 8
T
+31 (0)299 476 185
info@is.nl<mailto:info@is.nl>
1441 ZR Purmerend
F
+31 (0)299 476 288
www.is.nl<http://www.is.nl>
________________________________
IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
We use OpsGenie for notifications (and on-call scheduling, etc). There are other similar options such as PagerDuty, etc, as well. Notifications can be submitted to the service in a variety of ways (email, web API, etc), has a variety of integrations with other tools (Nagios, Pingdom, etc) to aggregate all of your alerts, and there is a callback mechanism where the user can trigger custom actions right from the app (for example, I wrote an interface for it such that when we get an alert, the on-call person can choose to restart the affected service -- or even reboot the entire VM hosting it -- right from within the OpsGenie app). Each user can choose their method of contact (notification to the smartphone app, SMS, phone call, email, whatever), and on-call schedules (and exceptions) are easily managed. It works for us... YMMV. ;) - Peter On 11/21/2014 10:52 AM, Thijs Stuurman wrote:
Nanog list members,
I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway.
Therefore my question, what are you using to notify admins of incidents?
Kind regards / Met vriendelijke groet,
Thijs Stuurman
[IS Logo]
________________________________
IS Group
Wielingenstraat 8
T
+31 (0)299 476 185
info@is.nl<mailto:info@is.nl>
1441 ZR Purmerend
F
+31 (0)299 476 288
www.is.nl<http://www.is.nl>
________________________________
IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
I know of a firend that is using Growl / Prowl to push out the notifications to their phones, even to their TV's at home. Sk. -----Original Message----- From: NANOG [mailto:nanog-bounces@nanog.org] On Behalf Of Thijs Stuurman Sent: Friday, November 21, 2014 10:52 AM To: nanog@nanog.org Subject: Incident notification Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] ________________________________ IS Group Wielingenstraat 8 T +31 (0)299 476 185 info@is.nl<mailto:info@is.nl> 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nl<http://www.is.nl> ________________________________ IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
Pushover and email to sms from both an inband and off site monitoring vm. On November 21, 2014 9:52:00 AM CST, Thijs Stuurman <Thijs.Stuurman@is.nl> wrote:
Nanog list members,
I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway.
Therefore my question, what are you using to notify admins of incidents?
Kind regards / Met vriendelijke groet,
Thijs Stuurman
[IS Logo]
________________________________
IS Group
Wielingenstraat 8
T
+31 (0)299 476 185
info@is.nl<mailto:info@is.nl>
1441 ZR Purmerend
F
+31 (0)299 476 288
www.is.nl<http://www.is.nl>
________________________________
IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
!DSPAM:546f5ff6238696356864932!
-- Sent from my Android device with K-9 Mail. Please excuse my brevity.
Multiple nagios servers directly sending via amazon web services SES to pager duty. Unlikely SES would go completely down. Nagios boxes monitor eachother from different continents. On Nov 21, 2014 10:52 AM, "Thijs Stuurman" <Thijs.Stuurman@is.nl> wrote:
Nanog list members,
I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway.
Therefore my question, what are you using to notify admins of incidents?
Kind regards / Met vriendelijke groet,
Thijs Stuurman
[IS Logo]
________________________________
IS Group
Wielingenstraat 8
T
+31 (0)299 476 185
info@is.nl<mailto:info@is.nl>
1441 ZR Purmerend
F
+31 (0)299 476 288
www.is.nl<http://www.is.nl>
________________________________
IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
participants (8)
-
Charles N Wyble -
Javier J -
Josh Luthman -
Matthew Huff -
Peter Kristolaitis -
Sameer Khosla -
Thijs Stuurman -
William Herrin