U4 Outages and Repair

Wednesday, April 28, 2010

This blog has moved


This blog is now located at http://u4outages.blogspot.com/.
You will be automatically redirected in 30 seconds, or you may click here.

For feed subscribers, please update your feed subscriptions to
http://u4outages.blogspot.com/feeds/posts/default.

** RECOVERY Host Alert: Primary U4VMAIL Server is UP **

***** Nagios *****

Notification Type: RECOVERY
Host: Primary U4VMAIL Server
State: UP
Address: vm1.u4vmail.com
Info: PING OK - Packet loss = 0%, RTA = 107.08 ms

Date/Time: Wed Apr 28 03:26:38 EDT 2010

** RECOVERY Host Alert: Secondary SIP Server is UP **

***** Nagios *****

Notification Type: RECOVERY
Host: Secondary SIP Server
State: UP
Address: sip2.u4voip.com
Info: PING OK - Packet loss = 0%, RTA = 95.94 ms

Date/Time: Wed Apr 28 03:26:18 EDT 2010

** RECOVERY Host Alert: Primary SIP Server is UP **

***** Nagios *****

Notification Type: RECOVERY
Host: Primary SIP Server
State: UP
Address: sip.u4voip.com
Info: PING OK - Packet loss = 0%, RTA = 23.88 ms

Date/Time: Wed Apr 28 03:26:18 EDT 2010

Tuesday, April 27, 2010

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Tue Apr 27 12:24:46 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 319.17 ms

** RECOVERY Service Alert: sip2/Can SIP Register is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: Can SIP Register
Host: sip2
Address: sip2.u4voip.com
State: OK

Date/Time: Tue Apr 27 12:20:46 EDT 2010

Additional Info:

SIP OK - Test Duration: 122.96 ms

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Tue Apr 27 12:19:46 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 200.62 ms

** PROBLEM Service Alert: sip2/Can SIP Register is UNKNOWN **

***** Nagios *****

Notification Type: PROBLEM

Service: Can SIP Register
Host: sip2
Address: sip2.u4voip.com
State: UNKNOWN

Date/Time: Tue Apr 27 12:17:46 EDT 2010

Additional Info:

SIP UNKNOWN ERROR

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Tue Apr 27 12:16:46 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 744.61 ms

Monday, April 26, 2010

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Mon Apr 26 21:36:46 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 96.04 ms

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Mon Apr 26 21:33:46 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 360.29 ms

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Mon Apr 26 12:37:46 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 254.81 ms

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Mon Apr 26 12:08:46 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 103.15 ms

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Mon Apr 26 12:02:46 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 16%, RTA = 288.79 ms

Sunday, April 25, 2010

** RECOVERY Service Alert: localhost/load is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: load
Host: localhost
Address: 127.0.0.1
State: OK

Date/Time: Sun Apr 25 04:31:26 EDT 2010

Additional Info:

OK - load average: 0.01, 0.36, 0.31

** PROBLEM Service Alert: localhost/load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: load
Host: localhost
Address: 127.0.0.1
State: CRITICAL

Date/Time: Sun Apr 25 04:25:26 EDT 2010

Additional Info:

CRITICAL - load average: 2.03, 0.94, 0.39

Friday, April 23, 2010

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Fri Apr 23 21:40:46 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 152.23 ms

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Fri Apr 23 21:37:46 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 297.95 ms

Thursday, April 22, 2010

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Thu Apr 22 20:17:46 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 89.35 ms

** RECOVERY Service Alert: sip1/Can SIP Register is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: Can SIP Register
Host: sip1
Address: sip.u4voip.com
State: OK

Date/Time: Thu Apr 22 20:11:56 EDT 2010

Additional Info:

SIP OK - Test Duration: 207.16 ms

** RECOVERY Service Alert: sip2/Can SIP Register is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: Can SIP Register
Host: sip2
Address: sip2.u4voip.com
State: OK

Date/Time: Thu Apr 22 20:11:46 EDT 2010

Additional Info:

SIP OK - Test Duration: 287.75 ms

** PROBLEM Service Alert: sip2/Can SIP Register is UNKNOWN **

***** Nagios *****

Notification Type: PROBLEM

Service: Can SIP Register
Host: sip2
Address: sip2.u4voip.com
State: UNKNOWN

Date/Time: Thu Apr 22 20:05:46 EDT 2010

Additional Info:

SIP UNKNOWN ERROR

** PROBLEM Service Alert: sip1/Can SIP Register is UNKNOWN **

***** Nagios *****

Notification Type: PROBLEM

Service: Can SIP Register
Host: sip1
Address: sip.u4voip.com
State: UNKNOWN

Date/Time: Thu Apr 22 20:05:56 EDT 2010

Additional Info:

SIP UNKNOWN ERROR

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Thu Apr 22 20:05:48 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 878.63 ms

** RECOVERY Service Alert: sip1/MinuteHub Registration is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: MinuteHub Registration
Host: sip1
Address: sip.u4voip.com
State: OK

Date/Time: Thu Apr 22 20:02:46 EDT 2010

Additional Info:

OK: Carrier-X 70.42.72.144 5060 OK (1699 ms)

** PROBLEM Service Alert: sip1/MinuteHub Registration is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: MinuteHub Registration
Host: sip1
Address: sip.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 22 19:59:46 EDT 2010

Additional Info:

CRITICAL: Something is wrong with Carrier-X

** RECOVERY Service Alert: localhost/load is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: load
Host: localhost
Address: 127.0.0.1
State: OK

Date/Time: Thu Apr 22 17:02:29 EDT 2010

Additional Info:

OK - load average: 0.05, 0.41, 0.44

** PROBLEM Service Alert: localhost/load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: load
Host: localhost
Address: 127.0.0.1
State: CRITICAL

Date/Time: Thu Apr 22 16:56:29 EDT 2010

Additional Info:

CRITICAL - load average: 0.44, 1.23, 0.63

** RECOVERY Host Alert: Primary U4VMAIL Server is UP **

***** Nagios *****

Notification Type: RECOVERY
Host: Primary U4VMAIL Server
State: UP
Address: vm1.u4vmail.com
Info: PING OK - Packet loss = 0%, RTA = 94.43 ms

Date/Time: Thu Apr 22 16:49:51 EDT 2010

** RECOVERY Host Alert: Secondary SIP Server is UP **

***** Nagios *****

Notification Type: RECOVERY
Host: Secondary SIP Server
State: UP
Address: sip2.u4voip.com
Info: PING OK - Packet loss = 0%, RTA = 94.71 ms

Date/Time: Thu Apr 22 16:48:11 EDT 2010

** RECOVERY Host Alert: Primary SIP Server is UP **

***** Nagios *****

Notification Type: RECOVERY
Host: Primary SIP Server
State: UP
Address: sip.u4voip.com
Info: PING OK - Packet loss = 0%, RTA = 36.97 ms

Date/Time: Thu Apr 22 16:47:51 EDT 2010

** PROBLEM Host Alert: Primary U4VMAIL Server is DOWN **

***** Nagios *****

Notification Type: PROBLEM
Host: Primary U4VMAIL Server
State: DOWN
Address: vm1.u4vmail.com
Info: (Host Check Timed Out)

Date/Time: Thu Apr 22 16:46:51 EDT 2010

** RECOVERY Host Alert: Benson billing server is UP **

***** Nagios *****

Notification Type: RECOVERY
Host: Benson billing server
State: UP
Address: 192.168.5.40
Info: PING OK - Packet loss = 0%, RTA = 4.70 ms

Date/Time: Thu Apr 22 16:46:52 EDT 2010

Monday, April 19, 2010

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Mon Apr 19 19:37:48 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 110.09 ms

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Mon Apr 19 19:34:46 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 446.12 ms

Sunday, April 18, 2010

** RECOVERY Service Alert: localhost/load is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: load
Host: localhost
Address: 127.0.0.1
State: OK

Date/Time: Sun Apr 18 04:51:31 EDT 2010

Additional Info:

OK - load average: 0.12, 0.29, 0.55

** PROBLEM Service Alert: localhost/load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: load
Host: localhost
Address: 127.0.0.1
State: CRITICAL

Date/Time: Sun Apr 18 04:27:37 EDT 2010

Additional Info:

CRITICAL - load average: 1.79, 1.27, 0.60

Friday, April 16, 2010

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Fri Apr 16 14:48:50 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 92.99 ms

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Fri Apr 16 14:39:09 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 256.52 ms

** RECOVERY Service Alert: localhost/load is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: load
Host: localhost
Address: 127.0.0.1
State: OK

Date/Time: Fri Apr 16 04:14:37 EDT 2010

Additional Info:

OK - load average: 0.30, 0.41, 0.36

** PROBLEM Service Alert: localhost/load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: load
Host: localhost
Address: 127.0.0.1
State: CRITICAL

Date/Time: Fri Apr 16 04:08:38 EDT 2010

Additional Info:

CRITICAL - load average: 0.83, 0.59, 0.39

Thursday, April 15, 2010

** PROBLEM Service Alert: sip2/GlobalPops Registration is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: GlobalPops Registration
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:53:28 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/MinuteHub Registration is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: MinuteHub Registration
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:53:26 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/CPU Load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: CPU Load
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:53:20 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/Hard Drive Space is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: Hard Drive Space
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:53:24 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** RECOVERY Service Alert: sip2/GlobalPops Registration is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: GlobalPops Registration
Host: sip2
Address: sip2.u4voip.com
State: OK

Date/Time: Thu Apr 15 23:47:20 EDT 2010

Additional Info:

OK: GlobalPOPS is not registered on this server.

** RECOVERY Service Alert: sip2/MinuteHub Registration is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: MinuteHub Registration
Host: sip2
Address: sip2.u4voip.com
State: OK

Date/Time: Thu Apr 15 23:47:17 EDT 2010

Additional Info:

OK: Carrier-X is not registered on this server.

** RECOVERY Service Alert: sip2/CPU Load is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: CPU Load
Host: sip2
Address: sip2.u4voip.com
State: OK

Date/Time: Thu Apr 15 23:47:14 EDT 2010

Additional Info:

OK - load average: 0.00, 0.00, 0.00

** RECOVERY Service Alert: sip2/Hard Drive Space is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: Hard Drive Space
Host: sip2
Address: sip2.u4voip.com
State: OK

Date/Time: Thu Apr 15 23:47:10 EDT 2010

Additional Info:

DISK OK - free space: / 252746 MB (98% inode=99%):

** PROBLEM Service Alert: sip2/GlobalPops Registration is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: GlobalPops Registration
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:44:07 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/CPU Load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: CPU Load
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:44:05 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/MinuteHub Registration is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: MinuteHub Registration
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:44:01 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/Hard Drive Space is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: Hard Drive Space
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:44:03 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/Asterisk Channels In Use is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: Asterisk Channels In Use
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:41:01 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

** PROBLEM Service Alert: sip2/Asterisk Channels In Use is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: Asterisk Channels In Use
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Thu Apr 15 23:24:21 EDT 2010

Additional Info:

CHECK_NRPE: Error - Could not complete SSL handshake.

Sunday, April 11, 2010

** RECOVERY Service Alert: localhost/load is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: load
Host: localhost
Address: 127.0.0.1
State: OK

Date/Time: Sun Apr 11 04:49:51 EDT 2010

Additional Info:

OK - load average: 0.07, 0.31, 0.57

** PROBLEM Service Alert: localhost/load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: load
Host: localhost
Address: 127.0.0.1
State: CRITICAL

Date/Time: Sun Apr 11 04:24:46 EDT 2010

Additional Info:

CRITICAL - load average: 1.73, 0.67, 0.30

Wednesday, April 7, 2010

** RECOVERY Service Alert: sip1/MinuteHub Registration is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: MinuteHub Registration
Host: sip1
Address: sip.u4voip.com
State: OK

Date/Time: Wed Apr 7 11:08:29 EDT 2010

Additional Info:

OK: Carrier-X 70.42.72.144 5060 OK (34 ms)

** PROBLEM Service Alert: sip1/MinuteHub Registration is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: MinuteHub Registration
Host: sip1
Address: sip.u4voip.com
State: CRITICAL

Date/Time: Wed Apr 7 11:05:17 EDT 2010

Additional Info:

CRITICAL: Something is wrong with Carrier-X

Monday, April 5, 2010

** PROBLEM Service Alert: sip2/Asterisk Channels In Use is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: Asterisk Channels In Use
Host: sip2
Address: sip2.u4voip.com
State: CRITICAL

Date/Time: Mon Apr 5 06:28:20 EDT 2010

Additional Info:

CHECK_NRPE: Socket timeout after 10 seconds.

Sunday, April 4, 2010

** RECOVERY Service Alert: localhost/load is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: load
Host: localhost
Address: 127.0.0.1
State: OK

Date/Time: Sun Apr 4 04:54:04 EDT 2010

Additional Info:

OK - load average: 0.00, 0.23, 0.59

** PROBLEM Service Alert: localhost/load is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: load
Host: localhost
Address: 127.0.0.1
State: CRITICAL

Date/Time: Sun Apr 4 04:26:34 EDT 2010

Additional Info:

CRITICAL - load average: 2.26, 1.35, 0.71

Thursday, April 1, 2010

** RECOVERY Service Alert: VM1/ping is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: OK

Date/Time: Thu Apr 1 19:46:00 EDT 2010

Additional Info:

PING OK - Packet loss = 0%, RTA = 81.29 ms

** PROBLEM Service Alert: VM1/ping is CRITICAL **

***** Nagios *****

Notification Type: PROBLEM

Service: ping
Host: VM1
Address: vm1.u4vmail.com
State: CRITICAL

Date/Time: Thu Apr 1 19:42:58 EDT 2010

Additional Info:

PING CRITICAL - Packet loss = 0%, RTA = 354.54 ms

** RECOVERY Service Alert: sip1/CMS Registration is OK **

***** Nagios *****

Notification Type: RECOVERY

Service: CMS Registration
Host: sip1
Address: sip.u4voip.com
State: OK

Date/Time: Thu Apr 1 00:01:54 EDT 2010

Additional Info:

OK: sip.cmsinter.net/u4_corp_ 207.241.130.244 5060 OK (20 ms)