Nov 7 06:25:14 wikitech-static liblogging-stdlog: [origin software="rsyslogd" swVersion="8.24.0" x-pid="2724" x-info="http://www.rsyslog.com"] rsyslogd was HUPed Nov 7 06:26:01 wikitech-static CRON[1556]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:26:01 wikitech-static CRON[1558]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:26:02 wikitech-static check_icinga[1559]: 2021-11-07 06:26:02,331 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:26:02 wikitech-static check_icinga[1557]: 2021-11-07 06:26:02,347 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:26:05 wikitech-static check_icinga[1557]: 2021-11-07 06:26:05,305 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:26:05 wikitech-static check_icinga[1559]: 2021-11-07 06:26:05,685 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:28:01 wikitech-static CRON[1640]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:28:01 wikitech-static CRON[1641]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:28:02 wikitech-static check_icinga[1642]: 2021-11-07 06:28:02,804 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:28:02 wikitech-static check_icinga[1643]: 2021-11-07 06:28:02,811 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:28:06 wikitech-static check_icinga[1642]: 2021-11-07 06:28:06,067 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:28:06 wikitech-static check_icinga[1643]: 2021-11-07 06:28:06,126 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:30:01 wikitech-static CRON[1718]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:30:01 wikitech-static CRON[1720]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:30:02 wikitech-static check_icinga[1719]: 2021-11-07 06:30:02,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:30:02 wikitech-static check_icinga[1721]: 2021-11-07 06:30:02,344 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:30:05 wikitech-static check_icinga[1719]: 2021-11-07 06:30:05,478 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:30:05 wikitech-static check_icinga[1721]: 2021-11-07 06:30:05,524 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:32:01 wikitech-static CRON[1801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:32:01 wikitech-static CRON[1802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:32:02 wikitech-static check_icinga[1804]: 2021-11-07 06:32:02,811 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:32:02 wikitech-static check_icinga[1803]: 2021-11-07 06:32:02,834 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:32:05 wikitech-static check_icinga[1803]: 2021-11-07 06:32:05,783 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:32:05 wikitech-static check_icinga[1804]: 2021-11-07 06:32:05,936 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:34:01 wikitech-static CRON[1876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:34:01 wikitech-static CRON[1878]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:34:02 wikitech-static check_icinga[1877]: 2021-11-07 06:34:02,094 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:34:02 wikitech-static check_icinga[1879]: 2021-11-07 06:34:02,103 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:34:03 wikitech-static check_icinga[1877]: 2021-11-07 06:34:03,495 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)'] Nov 7 06:34:05 wikitech-static check_icinga[1879]: 2021-11-07 06:34:05,299 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:34:13 wikitech-static check_icinga[1877]: 2021-11-07 06:34:13,505 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:34:16 wikitech-static check_icinga[1877]: 2021-11-07 06:34:16,411 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:36:01 wikitech-static CRON[1965]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:36:01 wikitech-static CRON[1967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:36:02 wikitech-static check_icinga[1966]: 2021-11-07 06:36:02,560 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:36:02 wikitech-static check_icinga[1968]: 2021-11-07 06:36:02,567 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:36:05 wikitech-static check_icinga[1966]: 2021-11-07 06:36:05,225 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:36:05 wikitech-static check_icinga[1968]: 2021-11-07 06:36:05,752 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:38:01 wikitech-static CRON[2147]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:38:01 wikitech-static CRON[2148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:38:02 wikitech-static check_icinga[2149]: 2021-11-07 06:38:02,881 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:38:02 wikitech-static check_icinga[2150]: 2021-11-07 06:38:02,883 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:38:05 wikitech-static check_icinga[2149]: 2021-11-07 06:38:05,749 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:38:06 wikitech-static check_icinga[2150]: 2021-11-07 06:38:06,183 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:39:01 wikitech-static CRON[2201]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 06:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 06:39:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 06:40:01 wikitech-static CRON[2331]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:40:01 wikitech-static CRON[2333]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:40:02 wikitech-static check_icinga[2332]: 2021-11-07 06:40:02,363 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:40:02 wikitech-static check_icinga[2334]: 2021-11-07 06:40:02,375 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:40:05 wikitech-static check_icinga[2332]: 2021-11-07 06:40:05,118 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:40:05 wikitech-static check_icinga[2334]: 2021-11-07 06:40:05,474 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:42:01 wikitech-static CRON[2406]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:42:01 wikitech-static CRON[2407]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:42:03 wikitech-static check_icinga[2409]: 2021-11-07 06:42:03,082 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:42:03 wikitech-static check_icinga[2408]: 2021-11-07 06:42:03,131 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:42:06 wikitech-static check_icinga[2408]: 2021-11-07 06:42:06,048 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:42:06 wikitech-static check_icinga[2409]: 2021-11-07 06:42:06,119 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:44:01 wikitech-static CRON[2507]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:44:01 wikitech-static CRON[2508]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:44:02 wikitech-static check_icinga[2509]: 2021-11-07 06:44:02,258 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:44:02 wikitech-static check_icinga[2510]: 2021-11-07 06:44:02,354 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:44:05 wikitech-static check_icinga[2509]: 2021-11-07 06:44:05,029 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:44:05 wikitech-static check_icinga[2510]: 2021-11-07 06:44:05,591 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:46:01 wikitech-static CRON[2587]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:46:01 wikitech-static CRON[2588]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:46:02 wikitech-static check_icinga[2589]: 2021-11-07 06:46:02,715 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:46:02 wikitech-static check_icinga[2590]: 2021-11-07 06:46:02,750 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:46:05 wikitech-static check_icinga[2589]: 2021-11-07 06:46:05,569 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:46:06 wikitech-static check_icinga[2590]: 2021-11-07 06:46:06,004 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:47:01 wikitech-static CRON[2634]: (root) CMD (test -x /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.weekly )) Nov 7 06:48:01 wikitech-static CRON[2672]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:48:01 wikitech-static CRON[2673]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:48:02 wikitech-static check_icinga[2675]: 2021-11-07 06:48:02,422 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:48:02 wikitech-static check_icinga[2674]: 2021-11-07 06:48:02,449 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:48:05 wikitech-static check_icinga[2674]: 2021-11-07 06:48:05,549 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:48:05 wikitech-static check_icinga[2675]: 2021-11-07 06:48:05,678 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:50:01 wikitech-static CRON[2761]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:50:01 wikitech-static CRON[2763]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:50:02 wikitech-static check_icinga[2762]: 2021-11-07 06:50:02,814 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:50:02 wikitech-static check_icinga[2764]: 2021-11-07 06:50:02,831 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:50:05 wikitech-static check_icinga[2762]: 2021-11-07 06:50:05,989 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:50:06 wikitech-static check_icinga[2764]: 2021-11-07 06:50:06,123 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:52:01 wikitech-static CRON[2864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:52:01 wikitech-static CRON[2865]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:52:02 wikitech-static check_icinga[2866]: 2021-11-07 06:52:02,244 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:52:02 wikitech-static check_icinga[2867]: 2021-11-07 06:52:02,275 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:52:05 wikitech-static check_icinga[2867]: 2021-11-07 06:52:05,324 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:52:05 wikitech-static check_icinga[2866]: 2021-11-07 06:52:05,345 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:54:01 wikitech-static CRON[2941]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:54:01 wikitech-static CRON[2942]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:54:02 wikitech-static check_icinga[2944]: 2021-11-07 06:54:02,585 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:54:02 wikitech-static check_icinga[2943]: 2021-11-07 06:54:02,589 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:54:05 wikitech-static check_icinga[2944]: 2021-11-07 06:54:05,828 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:54:05 wikitech-static check_icinga[2943]: 2021-11-07 06:54:05,880 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:56:02 wikitech-static CRON[3016]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:56:02 wikitech-static CRON[3017]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:56:03 wikitech-static check_icinga[3019]: 2021-11-07 06:56:03,037 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:56:03 wikitech-static check_icinga[3018]: 2021-11-07 06:56:03,072 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:56:06 wikitech-static check_icinga[3018]: 2021-11-07 06:56:06,194 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 06:56:06 wikitech-static check_icinga[3019]: 2021-11-07 06:56:06,243 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:58:01 wikitech-static CRON[3208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 06:58:01 wikitech-static CRON[3209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 06:58:02 wikitech-static check_icinga[3211]: 2021-11-07 06:58:02,466 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 06:58:02 wikitech-static check_icinga[3210]: 2021-11-07 06:58:02,486 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 06:58:05 wikitech-static check_icinga[3210]: 2021-11-07 06:58:05,642 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 06:58:05 wikitech-static check_icinga[3211]: 2021-11-07 06:58:05,736 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:00:01 wikitech-static CRON[3313]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:00:01 wikitech-static CRON[3314]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:00:02 wikitech-static check_icinga[3315]: 2021-11-07 07:00:02,866 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:00:02 wikitech-static check_icinga[3316]: 2021-11-07 07:00:02,896 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:00:06 wikitech-static check_icinga[3316]: 2021-11-07 07:00:06,066 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:00:06 wikitech-static check_icinga[3315]: 2021-11-07 07:00:06,102 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:02:01 wikitech-static CRON[3395]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:02:01 wikitech-static CRON[3396]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:02:02 wikitech-static check_icinga[3398]: 2021-11-07 07:02:02,545 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:02:02 wikitech-static check_icinga[3397]: 2021-11-07 07:02:02,571 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:02:05 wikitech-static check_icinga[3397]: 2021-11-07 07:02:05,567 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:02:05 wikitech-static check_icinga[3398]: 2021-11-07 07:02:05,771 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:04:01 wikitech-static CRON[3472]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:04:01 wikitech-static CRON[3473]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:04:02 wikitech-static check_icinga[3475]: 2021-11-07 07:04:02,878 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:04:02 wikitech-static check_icinga[3474]: 2021-11-07 07:04:02,907 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:04:06 wikitech-static check_icinga[3474]: 2021-11-07 07:04:06,035 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:04:06 wikitech-static check_icinga[3475]: 2021-11-07 07:04:06,237 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:06:01 wikitech-static CRON[3574]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:06:01 wikitech-static CRON[3575]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:06:02 wikitech-static check_icinga[3576]: 2021-11-07 07:06:02,385 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:06:02 wikitech-static check_icinga[3577]: 2021-11-07 07:06:02,453 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:06:05 wikitech-static check_icinga[3576]: 2021-11-07 07:06:05,645 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:06:05 wikitech-static check_icinga[3577]: 2021-11-07 07:06:05,804 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:08:01 wikitech-static CRON[3655]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:08:01 wikitech-static CRON[3656]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:08:02 wikitech-static check_icinga[3658]: 2021-11-07 07:08:02,903 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:08:02 wikitech-static check_icinga[3657]: 2021-11-07 07:08:02,905 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:08:06 wikitech-static check_icinga[3657]: 2021-11-07 07:08:06,021 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:08:06 wikitech-static check_icinga[3658]: 2021-11-07 07:08:06,074 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:09:01 wikitech-static CRON[3706]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 07:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 07:09:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 07:10:01 wikitech-static CRON[3823]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:10:01 wikitech-static CRON[3825]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:10:02 wikitech-static check_icinga[3824]: 2021-11-07 07:10:02,303 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:10:02 wikitech-static check_icinga[3826]: 2021-11-07 07:10:02,340 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:10:05 wikitech-static check_icinga[3826]: 2021-11-07 07:10:05,565 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:10:05 wikitech-static check_icinga[3824]: 2021-11-07 07:10:05,767 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:12:01 wikitech-static CRON[3915]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:12:01 wikitech-static CRON[3916]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:12:02 wikitech-static check_icinga[3917]: 2021-11-07 07:12:02,898 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:12:02 wikitech-static check_icinga[3918]: 2021-11-07 07:12:02,989 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:12:06 wikitech-static check_icinga[3917]: 2021-11-07 07:12:06,018 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:12:06 wikitech-static check_icinga[3918]: 2021-11-07 07:12:06,153 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:14:01 wikitech-static CRON[4078]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:14:01 wikitech-static CRON[4079]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:14:02 wikitech-static check_icinga[4081]: 2021-11-07 07:14:02,314 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:14:02 wikitech-static check_icinga[4080]: 2021-11-07 07:14:02,317 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:14:05 wikitech-static check_icinga[4080]: 2021-11-07 07:14:05,474 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:14:05 wikitech-static check_icinga[4081]: 2021-11-07 07:14:05,591 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:16:01 wikitech-static CRON[4153]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:16:01 wikitech-static CRON[4154]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:16:02 wikitech-static check_icinga[4155]: 2021-11-07 07:16:02,726 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:16:02 wikitech-static check_icinga[4156]: 2021-11-07 07:16:02,753 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:16:05 wikitech-static check_icinga[4156]: 2021-11-07 07:16:05,892 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:16:05 wikitech-static check_icinga[4155]: 2021-11-07 07:16:05,923 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:17:01 wikitech-static CRON[4202]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 07:18:01 wikitech-static CRON[4257]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:18:01 wikitech-static CRON[4258]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:18:02 wikitech-static check_icinga[4259]: 2021-11-07 07:18:02,167 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:18:02 wikitech-static check_icinga[4260]: 2021-11-07 07:18:02,170 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:18:05 wikitech-static check_icinga[4259]: 2021-11-07 07:18:05,344 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:18:05 wikitech-static check_icinga[4260]: 2021-11-07 07:18:05,514 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:20:01 wikitech-static CRON[4335]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:20:01 wikitech-static CRON[4336]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:20:02 wikitech-static check_icinga[4338]: 2021-11-07 07:20:02,665 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:20:02 wikitech-static check_icinga[4337]: 2021-11-07 07:20:02,669 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:20:05 wikitech-static check_icinga[4337]: 2021-11-07 07:20:05,865 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:20:06 wikitech-static check_icinga[4338]: 2021-11-07 07:20:06,014 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:22:01 wikitech-static CRON[4431]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:22:01 wikitech-static CRON[4433]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:22:02 wikitech-static check_icinga[4432]: 2021-11-07 07:22:02,172 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:22:02 wikitech-static check_icinga[4434]: 2021-11-07 07:22:02,186 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:22:05 wikitech-static check_icinga[4432]: 2021-11-07 07:22:05,233 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:22:05 wikitech-static check_icinga[4434]: 2021-11-07 07:22:05,416 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:24:01 wikitech-static CRON[4506]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:24:01 wikitech-static CRON[4507]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:24:02 wikitech-static check_icinga[4508]: 2021-11-07 07:24:02,554 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:24:02 wikitech-static check_icinga[4509]: 2021-11-07 07:24:02,558 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:24:05 wikitech-static check_icinga[4508]: 2021-11-07 07:24:05,654 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:24:05 wikitech-static check_icinga[4509]: 2021-11-07 07:24:05,716 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:26:01 wikitech-static CRON[4581]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:26:01 wikitech-static CRON[4582]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:26:02 wikitech-static check_icinga[4584]: 2021-11-07 07:26:02,889 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:26:02 wikitech-static check_icinga[4583]: 2021-11-07 07:26:02,916 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:26:06 wikitech-static check_icinga[4584]: 2021-11-07 07:26:06,080 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:26:06 wikitech-static check_icinga[4583]: 2021-11-07 07:26:06,154 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:28:01 wikitech-static CRON[4656]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:28:01 wikitech-static CRON[4657]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:28:02 wikitech-static check_icinga[4658]: 2021-11-07 07:28:02,536 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:28:02 wikitech-static check_icinga[4659]: 2021-11-07 07:28:02,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:28:05 wikitech-static check_icinga[4658]: 2021-11-07 07:28:05,676 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:28:05 wikitech-static check_icinga[4659]: 2021-11-07 07:28:05,954 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:30:01 wikitech-static CRON[4736]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:30:01 wikitech-static CRON[4738]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:30:02 wikitech-static check_icinga[4737]: 2021-11-07 07:30:02,132 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:30:02 wikitech-static check_icinga[4739]: 2021-11-07 07:30:02,137 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:30:05 wikitech-static check_icinga[4739]: 2021-11-07 07:30:05,277 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:30:05 wikitech-static check_icinga[4737]: 2021-11-07 07:30:05,358 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:32:01 wikitech-static CRON[4811]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:32:01 wikitech-static CRON[4812]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:32:02 wikitech-static check_icinga[4813]: 2021-11-07 07:32:02,474 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:32:02 wikitech-static check_icinga[4814]: 2021-11-07 07:32:02,477 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:32:05 wikitech-static check_icinga[4813]: 2021-11-07 07:32:05,522 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:32:05 wikitech-static check_icinga[4814]: 2021-11-07 07:32:05,687 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:34:01 wikitech-static CRON[4946]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:34:01 wikitech-static CRON[4947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:34:02 wikitech-static check_icinga[4949]: 2021-11-07 07:34:02,810 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:34:02 wikitech-static check_icinga[4948]: 2021-11-07 07:34:02,813 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:34:04 wikitech-static check_icinga[4948]: 2021-11-07 07:34:04,259 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)'] Nov 7 07:34:05 wikitech-static check_icinga[4949]: 2021-11-07 07:34:05,879 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:34:14 wikitech-static check_icinga[4948]: 2021-11-07 07:34:14,298 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:34:16 wikitech-static check_icinga[4948]: 2021-11-07 07:34:16,863 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:36:01 wikitech-static CRON[5027]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:36:01 wikitech-static CRON[5028]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:36:03 wikitech-static check_icinga[5030]: 2021-11-07 07:36:03,001 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:36:03 wikitech-static check_icinga[5029]: 2021-11-07 07:36:03,039 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:36:05 wikitech-static check_icinga[5030]: 2021-11-07 07:36:05,823 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:36:06 wikitech-static check_icinga[5029]: 2021-11-07 07:36:06,189 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:38:01 wikitech-static CRON[5102]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:38:01 wikitech-static CRON[5103]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:38:02 wikitech-static check_icinga[5104]: 2021-11-07 07:38:02,342 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:38:02 wikitech-static check_icinga[5105]: 2021-11-07 07:38:02,373 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:38:05 wikitech-static check_icinga[5104]: 2021-11-07 07:38:05,062 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:38:05 wikitech-static check_icinga[5105]: 2021-11-07 07:38:05,578 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:39:01 wikitech-static CRON[5154]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 07:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 07:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 07:40:01 wikitech-static CRON[5280]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:40:01 wikitech-static CRON[5281]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:40:02 wikitech-static check_icinga[5283]: 2021-11-07 07:40:02,759 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:40:02 wikitech-static check_icinga[5282]: 2021-11-07 07:40:02,760 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:40:05 wikitech-static check_icinga[5282]: 2021-11-07 07:40:05,572 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:40:05 wikitech-static check_icinga[5283]: 2021-11-07 07:40:05,859 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:42:01 wikitech-static CRON[5364]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:42:01 wikitech-static CRON[5365]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:42:03 wikitech-static check_icinga[5366]: 2021-11-07 07:42:03,015 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:42:03 wikitech-static check_icinga[5367]: 2021-11-07 07:42:03,022 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:42:05 wikitech-static check_icinga[5366]: 2021-11-07 07:42:05,791 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:42:06 wikitech-static check_icinga[5367]: 2021-11-07 07:42:06,398 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:44:01 wikitech-static CRON[5439]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:44:01 wikitech-static CRON[5440]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:44:02 wikitech-static check_icinga[5441]: 2021-11-07 07:44:02,778 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:44:02 wikitech-static check_icinga[5442]: 2021-11-07 07:44:02,782 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:44:05 wikitech-static check_icinga[5442]: 2021-11-07 07:44:05,877 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:44:05 wikitech-static check_icinga[5441]: 2021-11-07 07:44:05,892 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:46:01 wikitech-static CRON[5520]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:46:01 wikitech-static CRON[5521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:46:02 wikitech-static check_icinga[5522]: 2021-11-07 07:46:02,137 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:46:02 wikitech-static check_icinga[5523]: 2021-11-07 07:46:02,144 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:46:05 wikitech-static check_icinga[5522]: 2021-11-07 07:46:05,041 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:46:05 wikitech-static check_icinga[5523]: 2021-11-07 07:46:05,300 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:48:01 wikitech-static CRON[5604]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:48:01 wikitech-static CRON[5605]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:48:02 wikitech-static check_icinga[5606]: 2021-11-07 07:48:02,409 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:48:02 wikitech-static check_icinga[5607]: 2021-11-07 07:48:02,438 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:48:05 wikitech-static check_icinga[5606]: 2021-11-07 07:48:05,465 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:48:05 wikitech-static check_icinga[5607]: 2021-11-07 07:48:05,555 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:50:01 wikitech-static CRON[5697]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:50:01 wikitech-static CRON[5698]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:50:02 wikitech-static check_icinga[5700]: 2021-11-07 07:50:02,656 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:50:02 wikitech-static check_icinga[5699]: 2021-11-07 07:50:02,679 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:50:05 wikitech-static check_icinga[5700]: 2021-11-07 07:50:05,731 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:50:05 wikitech-static check_icinga[5699]: 2021-11-07 07:50:05,879 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:52:01 wikitech-static CRON[5778]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:52:01 wikitech-static CRON[5779]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:52:03 wikitech-static check_icinga[5781]: 2021-11-07 07:52:03,030 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:52:03 wikitech-static check_icinga[5780]: 2021-11-07 07:52:03,035 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:52:06 wikitech-static check_icinga[5780]: 2021-11-07 07:52:06,153 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:52:06 wikitech-static check_icinga[5781]: 2021-11-07 07:52:06,250 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:54:01 wikitech-static CRON[5872]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:54:01 wikitech-static CRON[5873]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:54:02 wikitech-static check_icinga[5874]: 2021-11-07 07:54:02,415 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:54:02 wikitech-static check_icinga[5875]: 2021-11-07 07:54:02,422 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:54:05 wikitech-static check_icinga[5874]: 2021-11-07 07:54:05,519 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:54:05 wikitech-static check_icinga[5875]: 2021-11-07 07:54:05,596 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:56:01 wikitech-static CRON[5947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:56:01 wikitech-static CRON[5948]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:56:02 wikitech-static check_icinga[5950]: 2021-11-07 07:56:02,716 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:56:02 wikitech-static check_icinga[5949]: 2021-11-07 07:56:02,741 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:56:05 wikitech-static check_icinga[5950]: 2021-11-07 07:56:05,799 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 07:56:05 wikitech-static check_icinga[5949]: 2021-11-07 07:56:05,816 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:58:01 wikitech-static CRON[6040]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 07:58:02 wikitech-static CRON[6042]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 07:58:03 wikitech-static check_icinga[6041]: 2021-11-07 07:58:03,000 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 07:58:03 wikitech-static check_icinga[6043]: 2021-11-07 07:58:03,072 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 07:58:06 wikitech-static check_icinga[6041]: 2021-11-07 07:58:06,156 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 07:58:06 wikitech-static check_icinga[6043]: 2021-11-07 07:58:06,493 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:00:01 wikitech-static CRON[6125]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:00:01 wikitech-static CRON[6126]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:00:02 wikitech-static check_icinga[6128]: 2021-11-07 08:00:02,695 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:00:02 wikitech-static check_icinga[6127]: 2021-11-07 08:00:02,699 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:00:05 wikitech-static check_icinga[6128]: 2021-11-07 08:00:05,806 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:00:06 wikitech-static check_icinga[6127]: 2021-11-07 08:00:06,012 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:02:01 wikitech-static CRON[6202]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:02:01 wikitech-static CRON[6204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:02:02 wikitech-static check_icinga[6205]: 2021-11-07 08:02:02,266 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:02:02 wikitech-static check_icinga[6203]: 2021-11-07 08:02:02,270 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:02:05 wikitech-static check_icinga[6203]: 2021-11-07 08:02:05,299 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:02:05 wikitech-static check_icinga[6205]: 2021-11-07 08:02:05,375 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:04:01 wikitech-static CRON[6280]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:04:01 wikitech-static CRON[6281]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:04:02 wikitech-static check_icinga[6282]: 2021-11-07 08:04:02,537 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:04:02 wikitech-static check_icinga[6283]: 2021-11-07 08:04:02,566 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:04:05 wikitech-static check_icinga[6282]: 2021-11-07 08:04:05,712 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:04:05 wikitech-static check_icinga[6283]: 2021-11-07 08:04:05,742 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:06:01 wikitech-static CRON[6358]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:06:01 wikitech-static CRON[6359]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:06:02 wikitech-static check_icinga[6361]: 2021-11-07 08:06:02,963 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:06:02 wikitech-static check_icinga[6360]: 2021-11-07 08:06:02,966 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:06:06 wikitech-static check_icinga[6361]: 2021-11-07 08:06:06,197 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:06:06 wikitech-static check_icinga[6360]: 2021-11-07 08:06:06,368 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:08:01 wikitech-static CRON[6438]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:08:01 wikitech-static CRON[6439]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:08:03 wikitech-static check_icinga[6441]: 2021-11-07 08:08:03,161 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:08:03 wikitech-static check_icinga[6440]: 2021-11-07 08:08:03,163 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:08:06 wikitech-static check_icinga[6440]: 2021-11-07 08:08:06,246 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:08:06 wikitech-static check_icinga[6441]: 2021-11-07 08:08:06,296 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:09:01 wikitech-static CRON[6485]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 08:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 08:09:07 wikitech-static systemd[1]: Started Clean php session files. Nov 7 08:10:01 wikitech-static CRON[6608]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:10:01 wikitech-static CRON[6610]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:10:02 wikitech-static check_icinga[6612]: 2021-11-07 08:10:02,566 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:10:02 wikitech-static check_icinga[6611]: 2021-11-07 08:10:02,582 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:10:05 wikitech-static check_icinga[6612]: 2021-11-07 08:10:05,700 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:10:05 wikitech-static check_icinga[6611]: 2021-11-07 08:10:05,764 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:11:01 wikitech-static CRON[6659]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 08:11:02 wikitech-static check_icinga_validate_config[6660]: Valid config, nothing to do. Nov 7 08:12:01 wikitech-static CRON[6692]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:12:01 wikitech-static CRON[6693]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:12:02 wikitech-static check_icinga[6695]: 2021-11-07 08:12:02,914 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:12:02 wikitech-static check_icinga[6694]: 2021-11-07 08:12:02,919 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:12:05 wikitech-static check_icinga[6694]: 2021-11-07 08:12:05,879 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:12:06 wikitech-static check_icinga[6695]: 2021-11-07 08:12:06,060 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:14:01 wikitech-static CRON[6767]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:14:01 wikitech-static CRON[6768]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:14:02 wikitech-static check_icinga[6769]: 2021-11-07 08:14:02,182 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:14:02 wikitech-static check_icinga[6770]: 2021-11-07 08:14:02,207 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:14:05 wikitech-static check_icinga[6769]: 2021-11-07 08:14:05,261 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:14:05 wikitech-static check_icinga[6770]: 2021-11-07 08:14:05,433 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:16:01 wikitech-static CRON[6843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:16:01 wikitech-static CRON[6844]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:16:02 wikitech-static check_icinga[6846]: 2021-11-07 08:16:02,743 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:16:02 wikitech-static check_icinga[6845]: 2021-11-07 08:16:02,768 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:16:06 wikitech-static check_icinga[6846]: 2021-11-07 08:16:06,017 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:16:06 wikitech-static check_icinga[6845]: 2021-11-07 08:16:06,072 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:17:01 wikitech-static CRON[6890]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 08:18:01 wikitech-static CRON[6922]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:18:01 wikitech-static CRON[6923]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:18:03 wikitech-static check_icinga[6924]: 2021-11-07 08:18:03,218 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:18:03 wikitech-static check_icinga[6925]: 2021-11-07 08:18:03,221 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:18:06 wikitech-static check_icinga[6924]: 2021-11-07 08:18:06,165 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:18:06 wikitech-static check_icinga[6925]: 2021-11-07 08:18:06,336 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:19:02 wikitech-static systemd[1]: Started Session 1081818 of user root. Nov 7 08:19:03 wikitech-static systemd[1]: Started Session 1081819 of user root. Nov 7 08:20:01 wikitech-static CRON[7022]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:20:01 wikitech-static CRON[7023]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:20:02 wikitech-static check_icinga[7025]: 2021-11-07 08:20:02,473 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:20:02 wikitech-static check_icinga[7024]: 2021-11-07 08:20:02,476 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:20:05 wikitech-static check_icinga[7024]: 2021-11-07 08:20:05,529 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:20:05 wikitech-static check_icinga[7025]: 2021-11-07 08:20:05,820 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:22:01 wikitech-static CRON[7100]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:22:01 wikitech-static CRON[7102]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:22:02 wikitech-static check_icinga[7103]: 2021-11-07 08:22:02,950 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:22:02 wikitech-static check_icinga[7101]: 2021-11-07 08:22:02,963 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:22:05 wikitech-static check_icinga[7101]: 2021-11-07 08:22:05,977 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:22:06 wikitech-static check_icinga[7103]: 2021-11-07 08:22:06,104 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:24:01 wikitech-static CRON[7199]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:24:01 wikitech-static CRON[7200]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:24:02 wikitech-static check_icinga[7201]: 2021-11-07 08:24:02,230 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:24:02 wikitech-static check_icinga[7202]: 2021-11-07 08:24:02,306 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:24:05 wikitech-static check_icinga[7201]: 2021-11-07 08:24:05,266 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:24:05 wikitech-static check_icinga[7202]: 2021-11-07 08:24:05,777 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:26:01 wikitech-static CRON[7276]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:26:01 wikitech-static CRON[7277]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:26:02 wikitech-static check_icinga[7279]: 2021-11-07 08:26:02,940 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:26:02 wikitech-static check_icinga[7278]: 2021-11-07 08:26:02,946 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:26:05 wikitech-static check_icinga[7278]: 2021-11-07 08:26:05,862 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:26:05 wikitech-static check_icinga[7279]: 2021-11-07 08:26:05,945 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:28:01 wikitech-static CRON[7353]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:28:01 wikitech-static CRON[7354]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:28:02 wikitech-static check_icinga[7356]: 2021-11-07 08:28:02,161 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:28:02 wikitech-static check_icinga[7355]: 2021-11-07 08:28:02,253 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:28:05 wikitech-static check_icinga[7355]: 2021-11-07 08:28:05,393 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:28:05 wikitech-static check_icinga[7356]: 2021-11-07 08:28:05,498 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:30:01 wikitech-static CRON[7432]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:30:01 wikitech-static CRON[7433]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:30:02 wikitech-static check_icinga[7435]: 2021-11-07 08:30:02,755 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:30:02 wikitech-static check_icinga[7434]: 2021-11-07 08:30:02,758 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:30:05 wikitech-static check_icinga[7435]: 2021-11-07 08:30:05,934 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:30:05 wikitech-static check_icinga[7434]: 2021-11-07 08:30:05,999 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:32:01 wikitech-static CRON[7511]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:32:01 wikitech-static CRON[7512]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:32:02 wikitech-static check_icinga[7514]: 2021-11-07 08:32:02,157 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:32:02 wikitech-static check_icinga[7513]: 2021-11-07 08:32:02,161 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:32:05 wikitech-static check_icinga[7513]: 2021-11-07 08:32:05,134 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:32:05 wikitech-static check_icinga[7514]: 2021-11-07 08:32:05,417 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:34:01 wikitech-static CRON[7595]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:34:01 wikitech-static CRON[7596]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:34:02 wikitech-static check_icinga[7597]: 2021-11-07 08:34:02,661 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:34:02 wikitech-static check_icinga[7598]: 2021-11-07 08:34:02,742 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:34:04 wikitech-static check_icinga[7598]: 2021-11-07 08:34:04,126 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')"] Nov 7 08:34:05 wikitech-static check_icinga[7597]: 2021-11-07 08:34:05,845 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:34:14 wikitech-static check_icinga[7598]: 2021-11-07 08:34:14,170 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:34:17 wikitech-static check_icinga[7598]: 2021-11-07 08:34:17,066 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:36:01 wikitech-static CRON[7672]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:36:01 wikitech-static CRON[7674]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:36:02 wikitech-static check_icinga[7675]: 2021-11-07 08:36:02,230 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:36:02 wikitech-static check_icinga[7673]: 2021-11-07 08:36:02,306 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:36:05 wikitech-static check_icinga[7673]: 2021-11-07 08:36:05,112 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:36:05 wikitech-static check_icinga[7675]: 2021-11-07 08:36:05,232 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:38:01 wikitech-static CRON[7747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:38:01 wikitech-static CRON[7748]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:38:02 wikitech-static check_icinga[7749]: 2021-11-07 08:38:02,388 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:38:02 wikitech-static check_icinga[7750]: 2021-11-07 08:38:02,482 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:38:05 wikitech-static check_icinga[7749]: 2021-11-07 08:38:05,156 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:38:05 wikitech-static check_icinga[7750]: 2021-11-07 08:38:05,710 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:39:01 wikitech-static CRON[7794]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 08:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 08:39:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 08:40:01 wikitech-static CRON[7920]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:40:01 wikitech-static CRON[7921]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:40:02 wikitech-static check_icinga[7922]: 2021-11-07 08:40:02,816 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:40:02 wikitech-static check_icinga[7923]: 2021-11-07 08:40:02,841 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:40:05 wikitech-static check_icinga[7922]: 2021-11-07 08:40:05,573 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:40:06 wikitech-static check_icinga[7923]: 2021-11-07 08:40:06,187 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:42:01 wikitech-static CRON[7995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:42:01 wikitech-static CRON[7996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:42:02 wikitech-static check_icinga[7997]: 2021-11-07 08:42:02,386 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:42:02 wikitech-static check_icinga[7998]: 2021-11-07 08:42:02,415 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:42:05 wikitech-static check_icinga[7998]: 2021-11-07 08:42:05,272 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:42:05 wikitech-static check_icinga[7997]: 2021-11-07 08:42:05,487 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:44:01 wikitech-static CRON[8074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:44:01 wikitech-static CRON[8075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:44:02 wikitech-static check_icinga[8076]: 2021-11-07 08:44:02,631 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:44:02 wikitech-static check_icinga[8077]: 2021-11-07 08:44:02,634 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:44:05 wikitech-static check_icinga[8076]: 2021-11-07 08:44:05,480 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:44:05 wikitech-static check_icinga[8077]: 2021-11-07 08:44:05,796 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:46:01 wikitech-static CRON[8155]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:46:01 wikitech-static CRON[8156]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:46:02 wikitech-static check_icinga[8158]: 2021-11-07 08:46:02,909 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:46:02 wikitech-static check_icinga[8157]: 2021-11-07 08:46:02,939 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:46:06 wikitech-static check_icinga[8157]: 2021-11-07 08:46:06,065 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:46:06 wikitech-static check_icinga[8158]: 2021-11-07 08:46:06,170 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:48:01 wikitech-static CRON[8233]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:48:01 wikitech-static CRON[8234]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:48:02 wikitech-static check_icinga[8236]: 2021-11-07 08:48:02,463 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:48:02 wikitech-static check_icinga[8235]: 2021-11-07 08:48:02,489 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:48:05 wikitech-static check_icinga[8235]: 2021-11-07 08:48:05,466 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:48:05 wikitech-static check_icinga[8236]: 2021-11-07 08:48:05,655 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:50:01 wikitech-static CRON[8308]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:50:01 wikitech-static CRON[8310]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:50:02 wikitech-static check_icinga[8311]: 2021-11-07 08:50:02,813 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:50:02 wikitech-static check_icinga[8309]: 2021-11-07 08:50:02,822 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:50:05 wikitech-static check_icinga[8309]: 2021-11-07 08:50:05,887 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:50:05 wikitech-static check_icinga[8311]: 2021-11-07 08:50:05,929 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:52:01 wikitech-static CRON[8392]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:52:01 wikitech-static CRON[8393]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:52:02 wikitech-static check_icinga[8394]: 2021-11-07 08:52:02,123 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:52:02 wikitech-static check_icinga[8395]: 2021-11-07 08:52:02,189 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:52:05 wikitech-static check_icinga[8394]: 2021-11-07 08:52:05,214 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:52:05 wikitech-static check_icinga[8395]: 2021-11-07 08:52:05,447 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:54:01 wikitech-static CRON[8469]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:54:01 wikitech-static CRON[8470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:54:02 wikitech-static check_icinga[8472]: 2021-11-07 08:54:02,591 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:54:02 wikitech-static check_icinga[8471]: 2021-11-07 08:54:02,600 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:54:05 wikitech-static check_icinga[8471]: 2021-11-07 08:54:05,786 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:54:05 wikitech-static check_icinga[8472]: 2021-11-07 08:54:05,824 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:56:01 wikitech-static CRON[8544]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:56:01 wikitech-static CRON[8545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:56:03 wikitech-static check_icinga[8547]: 2021-11-07 08:56:03,026 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:56:03 wikitech-static check_icinga[8546]: 2021-11-07 08:56:03,029 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:56:06 wikitech-static check_icinga[8547]: 2021-11-07 08:56:06,067 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:56:06 wikitech-static check_icinga[8546]: 2021-11-07 08:56:06,179 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 08:58:01 wikitech-static CRON[8621]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 08:58:01 wikitech-static CRON[8623]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 08:58:02 wikitech-static check_icinga[8622]: 2021-11-07 08:58:02,442 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 08:58:02 wikitech-static check_icinga[8624]: 2021-11-07 08:58:02,449 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 08:58:05 wikitech-static check_icinga[8622]: 2021-11-07 08:58:05,463 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 08:58:05 wikitech-static check_icinga[8624]: 2021-11-07 08:58:05,595 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:00:01 wikitech-static CRON[8760]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:00:01 wikitech-static CRON[8761]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:00:02 wikitech-static check_icinga[8762]: 2021-11-07 09:00:02,735 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:00:02 wikitech-static check_icinga[8763]: 2021-11-07 09:00:02,761 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:00:05 wikitech-static check_icinga[8762]: 2021-11-07 09:00:05,686 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:00:05 wikitech-static check_icinga[8763]: 2021-11-07 09:00:05,861 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:02:01 wikitech-static CRON[8835]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:02:01 wikitech-static CRON[8836]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:02:02 wikitech-static check_icinga[8838]: 2021-11-07 09:02:02,960 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:02:02 wikitech-static check_icinga[8837]: 2021-11-07 09:02:02,987 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:02:05 wikitech-static check_icinga[8837]: 2021-11-07 09:02:05,954 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:02:06 wikitech-static check_icinga[8838]: 2021-11-07 09:02:06,125 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:04:01 wikitech-static CRON[8918]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:04:01 wikitech-static CRON[8919]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:04:02 wikitech-static check_icinga[8920]: 2021-11-07 09:04:02,274 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:04:02 wikitech-static check_icinga[8921]: 2021-11-07 09:04:02,282 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:04:05 wikitech-static check_icinga[8920]: 2021-11-07 09:04:05,379 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:04:05 wikitech-static check_icinga[8921]: 2021-11-07 09:04:05,514 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:06:01 wikitech-static CRON[8995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:06:01 wikitech-static CRON[8996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:06:02 wikitech-static check_icinga[8997]: 2021-11-07 09:06:02,792 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:06:02 wikitech-static check_icinga[8998]: 2021-11-07 09:06:02,794 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:06:05 wikitech-static check_icinga[8998]: 2021-11-07 09:06:05,836 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:06:05 wikitech-static check_icinga[8997]: 2021-11-07 09:06:05,987 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:08:01 wikitech-static CRON[9076]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:08:01 wikitech-static CRON[9077]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:08:02 wikitech-static check_icinga[9079]: 2021-11-07 09:08:02,103 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:08:02 wikitech-static check_icinga[9078]: 2021-11-07 09:08:02,162 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:08:05 wikitech-static check_icinga[9078]: 2021-11-07 09:08:05,257 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:08:05 wikitech-static check_icinga[9079]: 2021-11-07 09:08:05,280 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:09:01 wikitech-static CRON[9127]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 09:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 09:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 09:10:01 wikitech-static CRON[9253]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:10:01 wikitech-static CRON[9254]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:10:02 wikitech-static check_icinga[9256]: 2021-11-07 09:10:02,634 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:10:02 wikitech-static check_icinga[9255]: 2021-11-07 09:10:02,641 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:10:05 wikitech-static check_icinga[9256]: 2021-11-07 09:10:05,625 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:10:05 wikitech-static check_icinga[9255]: 2021-11-07 09:10:05,654 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:12:01 wikitech-static CRON[9333]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:12:01 wikitech-static CRON[9334]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:12:02 wikitech-static check_icinga[9336]: 2021-11-07 09:12:02,858 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:12:02 wikitech-static check_icinga[9335]: 2021-11-07 09:12:02,861 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:12:05 wikitech-static check_icinga[9336]: 2021-11-07 09:12:05,875 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:12:06 wikitech-static check_icinga[9335]: 2021-11-07 09:12:06,098 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:14:01 wikitech-static CRON[9410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:14:01 wikitech-static CRON[9411]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:14:02 wikitech-static check_icinga[9412]: 2021-11-07 09:14:02,235 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:14:02 wikitech-static check_icinga[9413]: 2021-11-07 09:14:02,264 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:14:05 wikitech-static check_icinga[9413]: 2021-11-07 09:14:05,406 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:14:05 wikitech-static check_icinga[9412]: 2021-11-07 09:14:05,452 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:16:01 wikitech-static CRON[9517]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:16:01 wikitech-static CRON[9518]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:16:02 wikitech-static check_icinga[9520]: 2021-11-07 09:16:02,664 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:16:02 wikitech-static check_icinga[9519]: 2021-11-07 09:16:02,678 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:16:05 wikitech-static check_icinga[9520]: 2021-11-07 09:16:05,687 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:16:05 wikitech-static check_icinga[9519]: 2021-11-07 09:16:05,779 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:17:01 wikitech-static CRON[9564]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 09:18:01 wikitech-static CRON[9602]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:18:01 wikitech-static CRON[9603]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:18:03 wikitech-static check_icinga[9604]: 2021-11-07 09:18:03,383 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:18:03 wikitech-static check_icinga[9605]: 2021-11-07 09:18:03,409 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:18:06 wikitech-static check_icinga[9605]: 2021-11-07 09:18:06,444 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:18:06 wikitech-static check_icinga[9604]: 2021-11-07 09:18:06,503 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:20:01 wikitech-static CRON[9677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:20:01 wikitech-static CRON[9678]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:20:02 wikitech-static check_icinga[9680]: 2021-11-07 09:20:02,724 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:20:02 wikitech-static check_icinga[9679]: 2021-11-07 09:20:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:20:05 wikitech-static check_icinga[9679]: 2021-11-07 09:20:05,895 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:20:06 wikitech-static check_icinga[9680]: 2021-11-07 09:20:06,013 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:22:01 wikitech-static CRON[9752]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:22:01 wikitech-static CRON[9753]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:22:02 wikitech-static check_icinga[9755]: 2021-11-07 09:22:02,175 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:22:02 wikitech-static check_icinga[9754]: 2021-11-07 09:22:02,181 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:22:05 wikitech-static check_icinga[9754]: 2021-11-07 09:22:05,307 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:22:05 wikitech-static check_icinga[9755]: 2021-11-07 09:22:05,319 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:24:01 wikitech-static CRON[9827]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:24:01 wikitech-static CRON[9828]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:24:02 wikitech-static check_icinga[9830]: 2021-11-07 09:24:02,544 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:24:02 wikitech-static check_icinga[9829]: 2021-11-07 09:24:02,638 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:24:05 wikitech-static check_icinga[9829]: 2021-11-07 09:24:05,667 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:24:05 wikitech-static check_icinga[9830]: 2021-11-07 09:24:05,845 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:26:01 wikitech-static CRON[9902]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:26:01 wikitech-static CRON[9903]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:26:03 wikitech-static check_icinga[9904]: 2021-11-07 09:26:03,053 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:26:03 wikitech-static check_icinga[9905]: 2021-11-07 09:26:03,151 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:26:06 wikitech-static check_icinga[9904]: 2021-11-07 09:26:06,068 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:26:06 wikitech-static check_icinga[9905]: 2021-11-07 09:26:06,382 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:28:01 wikitech-static CRON[9980]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:28:01 wikitech-static CRON[9981]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:28:02 wikitech-static check_icinga[9983]: 2021-11-07 09:28:02,531 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:28:02 wikitech-static check_icinga[9982]: 2021-11-07 09:28:02,616 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:28:05 wikitech-static check_icinga[9983]: 2021-11-07 09:28:05,595 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:28:05 wikitech-static check_icinga[9982]: 2021-11-07 09:28:05,828 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:30:01 wikitech-static CRON[10055]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:30:01 wikitech-static CRON[10057]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:30:02 wikitech-static check_icinga[10056]: 2021-11-07 09:30:02,951 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:30:02 wikitech-static check_icinga[10058]: 2021-11-07 09:30:02,965 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:30:05 wikitech-static check_icinga[10056]: 2021-11-07 09:30:05,895 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:30:06 wikitech-static check_icinga[10058]: 2021-11-07 09:30:06,247 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:32:01 wikitech-static CRON[10133]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:32:01 wikitech-static CRON[10134]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:32:02 wikitech-static check_icinga[10136]: 2021-11-07 09:32:02,502 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:32:02 wikitech-static check_icinga[10135]: 2021-11-07 09:32:02,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:32:05 wikitech-static check_icinga[10136]: 2021-11-07 09:32:05,608 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:32:05 wikitech-static check_icinga[10135]: 2021-11-07 09:32:05,806 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:34:01 wikitech-static CRON[10208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:34:01 wikitech-static CRON[10209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:34:02 wikitech-static check_icinga[10211]: 2021-11-07 09:34:02,952 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:34:02 wikitech-static check_icinga[10210]: 2021-11-07 09:34:02,959 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:34:04 wikitech-static check_icinga[10210]: 2021-11-07 09:34:04,321 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)'] Nov 7 09:34:06 wikitech-static check_icinga[10211]: 2021-11-07 09:34:06,282 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:34:14 wikitech-static check_icinga[10210]: 2021-11-07 09:34:14,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:34:17 wikitech-static check_icinga[10210]: 2021-11-07 09:34:17,180 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:36:01 wikitech-static CRON[10283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:36:01 wikitech-static CRON[10284]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:36:02 wikitech-static check_icinga[10285]: 2021-11-07 09:36:02,320 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:36:02 wikitech-static check_icinga[10286]: 2021-11-07 09:36:02,335 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:36:05 wikitech-static check_icinga[10285]: 2021-11-07 09:36:05,188 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:36:05 wikitech-static check_icinga[10286]: 2021-11-07 09:36:05,677 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:38:01 wikitech-static CRON[10361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:38:01 wikitech-static CRON[10362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:38:02 wikitech-static check_icinga[10364]: 2021-11-07 09:38:02,924 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:38:03 wikitech-static check_icinga[10363]: 2021-11-07 09:38:03,004 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:38:05 wikitech-static check_icinga[10363]: 2021-11-07 09:38:05,937 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:38:06 wikitech-static check_icinga[10364]: 2021-11-07 09:38:06,231 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:39:01 wikitech-static CRON[10408]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 09:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 09:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 09:40:01 wikitech-static CRON[10530]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:40:01 wikitech-static CRON[10531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:40:02 wikitech-static check_icinga[10532]: 2021-11-07 09:40:02,357 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:40:02 wikitech-static check_icinga[10533]: 2021-11-07 09:40:02,380 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:40:05 wikitech-static check_icinga[10532]: 2021-11-07 09:40:05,019 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:40:05 wikitech-static check_icinga[10533]: 2021-11-07 09:40:05,553 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:42:01 wikitech-static CRON[10617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:42:01 wikitech-static CRON[10618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:42:02 wikitech-static check_icinga[10620]: 2021-11-07 09:42:02,697 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:42:02 wikitech-static check_icinga[10619]: 2021-11-07 09:42:02,701 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:42:05 wikitech-static check_icinga[10619]: 2021-11-07 09:42:05,455 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:42:05 wikitech-static check_icinga[10620]: 2021-11-07 09:42:05,845 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:44:01 wikitech-static CRON[10692]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:44:01 wikitech-static CRON[10693]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:44:02 wikitech-static check_icinga[10695]: 2021-11-07 09:44:02,931 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:44:02 wikitech-static check_icinga[10694]: 2021-11-07 09:44:02,962 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:44:05 wikitech-static check_icinga[10695]: 2021-11-07 09:44:05,822 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:44:05 wikitech-static check_icinga[10694]: 2021-11-07 09:44:05,963 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:46:01 wikitech-static CRON[10767]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:46:01 wikitech-static CRON[10768]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:46:02 wikitech-static check_icinga[10769]: 2021-11-07 09:46:02,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:46:02 wikitech-static check_icinga[10770]: 2021-11-07 09:46:02,168 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:46:05 wikitech-static check_icinga[10769]: 2021-11-07 09:46:05,005 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:46:05 wikitech-static check_icinga[10770]: 2021-11-07 09:46:05,404 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:48:01 wikitech-static CRON[10842]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:48:01 wikitech-static CRON[10843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:48:02 wikitech-static check_icinga[10844]: 2021-11-07 09:48:02,538 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:48:02 wikitech-static check_icinga[10845]: 2021-11-07 09:48:02,544 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:48:05 wikitech-static check_icinga[10845]: 2021-11-07 09:48:05,576 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:48:05 wikitech-static check_icinga[10844]: 2021-11-07 09:48:05,870 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:50:01 wikitech-static CRON[10917]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:50:01 wikitech-static CRON[10918]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:50:02 wikitech-static check_icinga[10919]: 2021-11-07 09:50:02,226 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:50:02 wikitech-static check_icinga[10920]: 2021-11-07 09:50:02,294 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:50:05 wikitech-static check_icinga[10919]: 2021-11-07 09:50:05,284 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:50:05 wikitech-static check_icinga[10920]: 2021-11-07 09:50:05,574 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:52:01 wikitech-static CRON[10995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:52:01 wikitech-static CRON[10996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:52:02 wikitech-static check_icinga[10997]: 2021-11-07 09:52:02,744 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:52:02 wikitech-static check_icinga[10998]: 2021-11-07 09:52:02,810 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:52:05 wikitech-static check_icinga[10997]: 2021-11-07 09:52:05,783 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:52:05 wikitech-static check_icinga[10998]: 2021-11-07 09:52:05,961 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:54:01 wikitech-static CRON[11070]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:54:01 wikitech-static CRON[11071]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:54:02 wikitech-static check_icinga[11072]: 2021-11-07 09:54:02,401 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:54:02 wikitech-static check_icinga[11073]: 2021-11-07 09:54:02,404 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:54:05 wikitech-static check_icinga[11073]: 2021-11-07 09:54:05,500 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:54:05 wikitech-static check_icinga[11072]: 2021-11-07 09:54:05,606 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:56:01 wikitech-static CRON[11145]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:56:01 wikitech-static CRON[11146]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:56:02 wikitech-static check_icinga[11147]: 2021-11-07 09:56:02,763 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:56:02 wikitech-static check_icinga[11148]: 2021-11-07 09:56:02,768 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:56:05 wikitech-static check_icinga[11147]: 2021-11-07 09:56:05,844 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:56:05 wikitech-static check_icinga[11148]: 2021-11-07 09:56:05,953 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 09:58:01 wikitech-static CRON[11220]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 09:58:01 wikitech-static CRON[11222]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 09:58:02 wikitech-static check_icinga[11223]: 2021-11-07 09:58:02,095 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 09:58:02 wikitech-static check_icinga[11221]: 2021-11-07 09:58:02,111 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 09:58:05 wikitech-static check_icinga[11221]: 2021-11-07 09:58:05,179 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 09:58:05 wikitech-static check_icinga[11223]: 2021-11-07 09:58:05,338 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:00:01 wikitech-static CRON[11295]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:00:01 wikitech-static CRON[11296]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:00:02 wikitech-static check_icinga[11297]: 2021-11-07 10:00:02,500 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:00:02 wikitech-static check_icinga[11298]: 2021-11-07 10:00:02,514 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:00:05 wikitech-static check_icinga[11297]: 2021-11-07 10:00:05,547 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:00:05 wikitech-static check_icinga[11298]: 2021-11-07 10:00:05,700 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:02:01 wikitech-static CRON[11372]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:02:01 wikitech-static CRON[11373]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:02:02 wikitech-static check_icinga[11375]: 2021-11-07 10:02:02,933 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:02:02 wikitech-static check_icinga[11374]: 2021-11-07 10:02:02,937 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:02:05 wikitech-static check_icinga[11374]: 2021-11-07 10:02:05,895 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:02:06 wikitech-static check_icinga[11375]: 2021-11-07 10:02:06,162 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:04:01 wikitech-static CRON[11466]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:04:01 wikitech-static CRON[11467]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:04:02 wikitech-static check_icinga[11470]: 2021-11-07 10:04:02,330 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:04:02 wikitech-static check_icinga[11468]: 2021-11-07 10:04:02,333 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:04:05 wikitech-static check_icinga[11468]: 2021-11-07 10:04:05,409 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:04:05 wikitech-static check_icinga[11470]: 2021-11-07 10:04:05,476 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:06:01 wikitech-static CRON[11542]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:06:01 wikitech-static CRON[11543]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:06:02 wikitech-static check_icinga[11544]: 2021-11-07 10:06:02,648 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:06:02 wikitech-static check_icinga[11545]: 2021-11-07 10:06:02,650 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:06:05 wikitech-static check_icinga[11544]: 2021-11-07 10:06:05,761 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:06:05 wikitech-static check_icinga[11545]: 2021-11-07 10:06:05,994 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:08:01 wikitech-static CRON[11618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:08:01 wikitech-static CRON[11619]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:08:02 wikitech-static check_icinga[11620]: 2021-11-07 10:08:02,187 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:08:02 wikitech-static check_icinga[11621]: 2021-11-07 10:08:02,221 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:08:05 wikitech-static check_icinga[11621]: 2021-11-07 10:08:05,367 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:08:05 wikitech-static check_icinga[11620]: 2021-11-07 10:08:05,373 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:09:01 wikitech-static CRON[11665]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 10:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 10:09:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 10:10:01 wikitech-static CRON[11787]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:10:01 wikitech-static CRON[11788]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:10:02 wikitech-static check_icinga[11790]: 2021-11-07 10:10:02,573 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:10:02 wikitech-static check_icinga[11789]: 2021-11-07 10:10:02,599 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:10:05 wikitech-static check_icinga[11790]: 2021-11-07 10:10:05,734 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:10:06 wikitech-static check_icinga[11789]: 2021-11-07 10:10:06,034 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:11:01 wikitech-static CRON[11834]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 10:11:01 wikitech-static check_icinga_validate_config[11835]: Valid config, nothing to do. Nov 7 10:12:01 wikitech-static CRON[11867]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:12:01 wikitech-static CRON[11868]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:12:02 wikitech-static check_icinga[11870]: 2021-11-07 10:12:02,981 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:12:02 wikitech-static check_icinga[11869]: 2021-11-07 10:12:02,988 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:12:05 wikitech-static check_icinga[11870]: 2021-11-07 10:12:05,963 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:12:06 wikitech-static check_icinga[11869]: 2021-11-07 10:12:06,150 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:14:01 wikitech-static CRON[11949]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:14:01 wikitech-static CRON[11950]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:14:02 wikitech-static check_icinga[11951]: 2021-11-07 10:14:02,276 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:14:02 wikitech-static check_icinga[11952]: 2021-11-07 10:14:02,302 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:14:05 wikitech-static check_icinga[11951]: 2021-11-07 10:14:05,606 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:14:05 wikitech-static check_icinga[11952]: 2021-11-07 10:14:05,693 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:16:01 wikitech-static CRON[12028]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:16:01 wikitech-static CRON[12029]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:16:02 wikitech-static check_icinga[12031]: 2021-11-07 10:16:02,897 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:16:02 wikitech-static check_icinga[12030]: 2021-11-07 10:16:02,899 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:16:05 wikitech-static check_icinga[12030]: 2021-11-07 10:16:05,958 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:16:06 wikitech-static check_icinga[12031]: 2021-11-07 10:16:06,238 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:17:01 wikitech-static CRON[12075]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 10:18:01 wikitech-static CRON[12107]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:18:01 wikitech-static CRON[12108]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:18:02 wikitech-static check_icinga[12110]: 2021-11-07 10:18:02,399 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:18:02 wikitech-static check_icinga[12109]: 2021-11-07 10:18:02,506 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:18:05 wikitech-static check_icinga[12109]: 2021-11-07 10:18:05,451 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:18:05 wikitech-static check_icinga[12110]: 2021-11-07 10:18:05,839 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:20:01 wikitech-static CRON[12184]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:20:01 wikitech-static CRON[12185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:20:03 wikitech-static check_icinga[12187]: 2021-11-07 10:20:03,001 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:20:03 wikitech-static check_icinga[12186]: 2021-11-07 10:20:03,002 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:20:05 wikitech-static check_icinga[12186]: 2021-11-07 10:20:05,986 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:20:06 wikitech-static check_icinga[12187]: 2021-11-07 10:20:06,165 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:22:01 wikitech-static CRON[12261]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:22:01 wikitech-static CRON[12262]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:22:02 wikitech-static check_icinga[12264]: 2021-11-07 10:22:02,295 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:22:02 wikitech-static check_icinga[12263]: 2021-11-07 10:22:02,299 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:22:05 wikitech-static check_icinga[12263]: 2021-11-07 10:22:05,388 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:22:05 wikitech-static check_icinga[12264]: 2021-11-07 10:22:05,439 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:24:01 wikitech-static CRON[12340]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:24:01 wikitech-static CRON[12341]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:24:02 wikitech-static check_icinga[12343]: 2021-11-07 10:24:02,661 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:24:02 wikitech-static check_icinga[12342]: 2021-11-07 10:24:02,687 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:24:05 wikitech-static check_icinga[12343]: 2021-11-07 10:24:05,721 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:24:05 wikitech-static check_icinga[12342]: 2021-11-07 10:24:05,897 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:26:01 wikitech-static CRON[12415]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:26:01 wikitech-static CRON[12416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:26:03 wikitech-static check_icinga[12417]: 2021-11-07 10:26:03,053 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:26:03 wikitech-static check_icinga[12418]: 2021-11-07 10:26:03,056 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:26:06 wikitech-static check_icinga[12418]: 2021-11-07 10:26:06,131 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:26:06 wikitech-static check_icinga[12417]: 2021-11-07 10:26:06,380 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:28:01 wikitech-static CRON[12490]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:28:01 wikitech-static CRON[12491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:28:02 wikitech-static check_icinga[12493]: 2021-11-07 10:28:02,524 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:28:02 wikitech-static check_icinga[12492]: 2021-11-07 10:28:02,549 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:28:05 wikitech-static check_icinga[12493]: 2021-11-07 10:28:05,768 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:28:05 wikitech-static check_icinga[12492]: 2021-11-07 10:28:05,880 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:30:01 wikitech-static CRON[12567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:30:01 wikitech-static CRON[12568]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:30:02 wikitech-static check_icinga[12570]: 2021-11-07 10:30:02,985 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:30:03 wikitech-static check_icinga[12569]: 2021-11-07 10:30:03,012 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:30:05 wikitech-static check_icinga[12569]: 2021-11-07 10:30:05,928 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:30:06 wikitech-static check_icinga[12570]: 2021-11-07 10:30:06,127 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:32:01 wikitech-static CRON[12642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:32:01 wikitech-static CRON[12643]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:32:01 wikitech-static systemd[1]: Starting Certbot... Nov 7 10:32:02 wikitech-static check_icinga[12645]: 2021-11-07 10:32:02,761 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:32:02 wikitech-static check_icinga[12644]: 2021-11-07 10:32:02,794 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:32:05 wikitech-static systemd[1]: Started Certbot. Nov 7 10:32:05 wikitech-static systemd[1]: certbot.timer: Adding 5h 40min 55.850246s random time. Nov 7 10:32:05 wikitech-static systemd[1]: certbot.timer: Adding 5h 33min 32.491629s random time. Nov 7 10:32:05 wikitech-static check_icinga[12645]: 2021-11-07 10:32:05,828 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:32:05 wikitech-static check_icinga[12644]: 2021-11-07 10:32:05,982 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:34:01 wikitech-static CRON[12750]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:34:01 wikitech-static CRON[12751]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:34:02 wikitech-static check_icinga[12753]: 2021-11-07 10:34:02,429 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:34:02 wikitech-static check_icinga[12752]: 2021-11-07 10:34:02,538 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:34:03 wikitech-static check_icinga[12753]: 2021-11-07 10:34:03,808 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')"] Nov 7 10:34:05 wikitech-static check_icinga[12752]: 2021-11-07 10:34:05,690 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:34:13 wikitech-static check_icinga[12753]: 2021-11-07 10:34:13,934 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:34:16 wikitech-static check_icinga[12753]: 2021-11-07 10:34:16,586 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:36:01 wikitech-static CRON[12828]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:36:01 wikitech-static CRON[12829]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:36:02 wikitech-static check_icinga[12831]: 2021-11-07 10:36:02,716 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:36:02 wikitech-static check_icinga[12830]: 2021-11-07 10:36:02,752 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:36:05 wikitech-static check_icinga[12830]: 2021-11-07 10:36:05,503 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:36:05 wikitech-static check_icinga[12831]: 2021-11-07 10:36:05,950 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:38:01 wikitech-static CRON[12903]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:38:01 wikitech-static CRON[12904]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:38:02 wikitech-static check_icinga[12905]: 2021-11-07 10:38:02,114 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:38:02 wikitech-static check_icinga[12906]: 2021-11-07 10:38:02,120 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:38:04 wikitech-static check_icinga[12906]: 2021-11-07 10:38:04,911 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:38:05 wikitech-static check_icinga[12905]: 2021-11-07 10:38:05,422 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:39:01 wikitech-static CRON[12950]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 10:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 10:39:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 10:40:01 wikitech-static CRON[13074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:40:01 wikitech-static CRON[13075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:40:02 wikitech-static check_icinga[13077]: 2021-11-07 10:40:02,598 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:40:02 wikitech-static check_icinga[13076]: 2021-11-07 10:40:02,602 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:40:05 wikitech-static check_icinga[13076]: 2021-11-07 10:40:05,443 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:40:05 wikitech-static check_icinga[13077]: 2021-11-07 10:40:05,766 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:42:01 wikitech-static CRON[13151]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:42:01 wikitech-static CRON[13152]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:42:02 wikitech-static check_icinga[13153]: 2021-11-07 10:42:02,915 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:42:02 wikitech-static check_icinga[13154]: 2021-11-07 10:42:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:42:05 wikitech-static check_icinga[13153]: 2021-11-07 10:42:05,848 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:42:06 wikitech-static check_icinga[13154]: 2021-11-07 10:42:06,125 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:44:01 wikitech-static CRON[13226]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:44:01 wikitech-static CRON[13227]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:44:02 wikitech-static check_icinga[13228]: 2021-11-07 10:44:02,337 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:44:02 wikitech-static check_icinga[13229]: 2021-11-07 10:44:02,362 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:44:05 wikitech-static check_icinga[13228]: 2021-11-07 10:44:05,037 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:44:05 wikitech-static check_icinga[13229]: 2021-11-07 10:44:05,487 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:46:01 wikitech-static CRON[13301]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:46:01 wikitech-static CRON[13302]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:46:02 wikitech-static check_icinga[13304]: 2021-11-07 10:46:02,644 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:46:02 wikitech-static check_icinga[13303]: 2021-11-07 10:46:02,651 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:46:05 wikitech-static check_icinga[13303]: 2021-11-07 10:46:05,511 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:46:05 wikitech-static check_icinga[13304]: 2021-11-07 10:46:05,848 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:48:01 wikitech-static CRON[13377]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:48:01 wikitech-static CRON[13378]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:48:02 wikitech-static check_icinga[13380]: 2021-11-07 10:48:02,976 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:48:02 wikitech-static check_icinga[13379]: 2021-11-07 10:48:02,982 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:48:05 wikitech-static check_icinga[13380]: 2021-11-07 10:48:05,816 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:48:06 wikitech-static check_icinga[13379]: 2021-11-07 10:48:06,161 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:50:01 wikitech-static CRON[13453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:50:01 wikitech-static CRON[13455]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:50:02 wikitech-static check_icinga[13454]: 2021-11-07 10:50:02,296 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:50:02 wikitech-static check_icinga[13456]: 2021-11-07 10:50:02,320 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:50:05 wikitech-static check_icinga[13454]: 2021-11-07 10:50:05,220 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:50:05 wikitech-static check_icinga[13456]: 2021-11-07 10:50:05,535 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:52:01 wikitech-static CRON[13532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:52:01 wikitech-static CRON[13534]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:52:02 wikitech-static check_icinga[13533]: 2021-11-07 10:52:02,688 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:52:02 wikitech-static check_icinga[13535]: 2021-11-07 10:52:02,698 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:52:05 wikitech-static check_icinga[13533]: 2021-11-07 10:52:05,494 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:52:05 wikitech-static check_icinga[13535]: 2021-11-07 10:52:05,859 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:54:01 wikitech-static CRON[13612]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:54:01 wikitech-static CRON[13613]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:54:03 wikitech-static check_icinga[13614]: 2021-11-07 10:54:03,007 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:54:03 wikitech-static check_icinga[13615]: 2021-11-07 10:54:03,010 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:54:06 wikitech-static check_icinga[13615]: 2021-11-07 10:54:06,036 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:54:06 wikitech-static check_icinga[13614]: 2021-11-07 10:54:06,110 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:56:01 wikitech-static CRON[13687]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:56:01 wikitech-static CRON[13688]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:56:02 wikitech-static check_icinga[13689]: 2021-11-07 10:56:02,300 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:56:02 wikitech-static check_icinga[13690]: 2021-11-07 10:56:02,306 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:56:05 wikitech-static check_icinga[13689]: 2021-11-07 10:56:05,451 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:56:05 wikitech-static check_icinga[13690]: 2021-11-07 10:56:05,497 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 10:58:01 wikitech-static CRON[13764]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 10:58:01 wikitech-static CRON[13765]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 10:58:02 wikitech-static check_icinga[13766]: 2021-11-07 10:58:02,799 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 10:58:02 wikitech-static check_icinga[13767]: 2021-11-07 10:58:02,804 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 10:58:05 wikitech-static check_icinga[13766]: 2021-11-07 10:58:05,681 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 10:58:05 wikitech-static check_icinga[13767]: 2021-11-07 10:58:05,955 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:00:01 wikitech-static CRON[13839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:00:01 wikitech-static CRON[13840]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:00:02 wikitech-static check_icinga[13841]: 2021-11-07 11:00:02,115 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:00:02 wikitech-static check_icinga[13842]: 2021-11-07 11:00:02,151 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:00:05 wikitech-static check_icinga[13842]: 2021-11-07 11:00:05,304 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:00:05 wikitech-static check_icinga[13841]: 2021-11-07 11:00:05,359 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:02:01 wikitech-static CRON[13917]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:02:01 wikitech-static CRON[13918]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:02:02 wikitech-static check_icinga[13919]: 2021-11-07 11:02:02,519 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:02:02 wikitech-static check_icinga[13920]: 2021-11-07 11:02:02,547 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:02:05 wikitech-static check_icinga[13919]: 2021-11-07 11:02:05,637 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:02:05 wikitech-static check_icinga[13920]: 2021-11-07 11:02:05,717 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:04:01 wikitech-static CRON[13998]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:04:01 wikitech-static CRON[13999]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:04:02 wikitech-static check_icinga[14001]: 2021-11-07 11:04:02,889 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:04:02 wikitech-static check_icinga[14000]: 2021-11-07 11:04:02,959 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:04:05 wikitech-static check_icinga[14000]: 2021-11-07 11:04:05,942 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:04:06 wikitech-static check_icinga[14001]: 2021-11-07 11:04:06,100 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:06:01 wikitech-static CRON[14073]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:06:01 wikitech-static CRON[14075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:06:02 wikitech-static check_icinga[14074]: 2021-11-07 11:06:02,209 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:06:02 wikitech-static check_icinga[14076]: 2021-11-07 11:06:02,276 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:06:05 wikitech-static check_icinga[14074]: 2021-11-07 11:06:05,131 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:06:05 wikitech-static check_icinga[14076]: 2021-11-07 11:06:05,525 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:08:01 wikitech-static CRON[14148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:08:01 wikitech-static CRON[14149]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:08:02 wikitech-static check_icinga[14151]: 2021-11-07 11:08:02,656 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:08:02 wikitech-static check_icinga[14150]: 2021-11-07 11:08:02,681 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:08:05 wikitech-static check_icinga[14150]: 2021-11-07 11:08:05,895 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:08:06 wikitech-static check_icinga[14151]: 2021-11-07 11:08:06,010 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:09:01 wikitech-static CRON[14253]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 11:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 11:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 11:10:01 wikitech-static CRON[14379]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:10:01 wikitech-static CRON[14380]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:10:02 wikitech-static check_icinga[14382]: 2021-11-07 11:10:02,144 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:10:02 wikitech-static check_icinga[14381]: 2021-11-07 11:10:02,237 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:10:05 wikitech-static check_icinga[14381]: 2021-11-07 11:10:05,281 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:10:05 wikitech-static check_icinga[14382]: 2021-11-07 11:10:05,505 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:12:01 wikitech-static CRON[14457]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:12:01 wikitech-static CRON[14458]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:12:02 wikitech-static check_icinga[14459]: 2021-11-07 11:12:02,644 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:12:02 wikitech-static check_icinga[14460]: 2021-11-07 11:12:02,652 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:12:05 wikitech-static check_icinga[14459]: 2021-11-07 11:12:05,591 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:12:05 wikitech-static check_icinga[14460]: 2021-11-07 11:12:05,905 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:14:01 wikitech-static CRON[14537]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:14:01 wikitech-static CRON[14538]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:14:03 wikitech-static check_icinga[14539]: 2021-11-07 11:14:03,065 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:14:03 wikitech-static check_icinga[14540]: 2021-11-07 11:14:03,138 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:14:06 wikitech-static check_icinga[14539]: 2021-11-07 11:14:06,005 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:14:06 wikitech-static check_icinga[14540]: 2021-11-07 11:14:06,296 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:16:01 wikitech-static CRON[14616]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:16:01 wikitech-static CRON[14617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:16:02 wikitech-static check_icinga[14618]: 2021-11-07 11:16:02,478 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:16:02 wikitech-static check_icinga[14619]: 2021-11-07 11:16:02,485 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:16:05 wikitech-static check_icinga[14618]: 2021-11-07 11:16:05,500 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:16:05 wikitech-static check_icinga[14619]: 2021-11-07 11:16:05,579 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:17:01 wikitech-static CRON[14663]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 11:18:01 wikitech-static CRON[14694]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:18:01 wikitech-static CRON[14696]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:18:02 wikitech-static check_icinga[14697]: 2021-11-07 11:18:02,768 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:18:02 wikitech-static check_icinga[14695]: 2021-11-07 11:18:02,866 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:18:06 wikitech-static check_icinga[14697]: 2021-11-07 11:18:06,001 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:18:06 wikitech-static check_icinga[14695]: 2021-11-07 11:18:06,031 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:20:01 wikitech-static CRON[14772]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:20:01 wikitech-static CRON[14774]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:20:02 wikitech-static check_icinga[14773]: 2021-11-07 11:20:02,291 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:20:02 wikitech-static check_icinga[14775]: 2021-11-07 11:20:02,335 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:20:05 wikitech-static check_icinga[14773]: 2021-11-07 11:20:05,279 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:20:05 wikitech-static check_icinga[14775]: 2021-11-07 11:20:05,655 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:22:01 wikitech-static CRON[14850]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:22:01 wikitech-static CRON[14851]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:22:02 wikitech-static check_icinga[14852]: 2021-11-07 11:22:02,776 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:22:02 wikitech-static check_icinga[14853]: 2021-11-07 11:22:02,804 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:22:05 wikitech-static check_icinga[14853]: 2021-11-07 11:22:05,750 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:22:05 wikitech-static check_icinga[14852]: 2021-11-07 11:22:05,838 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:24:01 wikitech-static CRON[14925]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:24:01 wikitech-static CRON[14927]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:24:02 wikitech-static check_icinga[14928]: 2021-11-07 11:24:02,971 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:24:02 wikitech-static check_icinga[14926]: 2021-11-07 11:24:02,977 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:24:05 wikitech-static check_icinga[14926]: 2021-11-07 11:24:05,947 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:24:06 wikitech-static check_icinga[14928]: 2021-11-07 11:24:06,058 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:26:01 wikitech-static CRON[15020]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:26:01 wikitech-static CRON[15021]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:26:02 wikitech-static check_icinga[15022]: 2021-11-07 11:26:02,181 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:26:02 wikitech-static check_icinga[15023]: 2021-11-07 11:26:02,218 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:26:05 wikitech-static check_icinga[15022]: 2021-11-07 11:26:05,131 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:26:05 wikitech-static check_icinga[15023]: 2021-11-07 11:26:05,287 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:28:01 wikitech-static CRON[15101]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:28:01 wikitech-static CRON[15102]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:28:02 wikitech-static check_icinga[15103]: 2021-11-07 11:28:02,411 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:28:02 wikitech-static check_icinga[15104]: 2021-11-07 11:28:02,437 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:28:05 wikitech-static check_icinga[15103]: 2021-11-07 11:28:05,317 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:28:05 wikitech-static check_icinga[15104]: 2021-11-07 11:28:05,505 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:30:01 wikitech-static CRON[15230]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:30:01 wikitech-static CRON[15231]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:30:02 wikitech-static check_icinga[15233]: 2021-11-07 11:30:02,828 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:30:02 wikitech-static check_icinga[15232]: 2021-11-07 11:30:02,829 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:30:05 wikitech-static check_icinga[15233]: 2021-11-07 11:30:05,808 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:30:05 wikitech-static check_icinga[15232]: 2021-11-07 11:30:05,898 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:32:01 wikitech-static CRON[15313]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:32:01 wikitech-static CRON[15315]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:32:03 wikitech-static check_icinga[15314]: 2021-11-07 11:32:03,032 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:32:03 wikitech-static check_icinga[15316]: 2021-11-07 11:32:03,037 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:32:06 wikitech-static check_icinga[15316]: 2021-11-07 11:32:06,210 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:32:06 wikitech-static check_icinga[15314]: 2021-11-07 11:32:06,245 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:34:01 wikitech-static CRON[15391]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:34:01 wikitech-static CRON[15392]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:34:02 wikitech-static check_icinga[15393]: 2021-11-07 11:34:02,483 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:34:02 wikitech-static check_icinga[15394]: 2021-11-07 11:34:02,505 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:34:03 wikitech-static check_icinga[15393]: 2021-11-07 11:34:03,856 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Notifications Enabled? MISSING_KEY (expected NO)'] Nov 7 11:34:05 wikitech-static check_icinga[15394]: 2021-11-07 11:34:05,763 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:34:13 wikitech-static check_icinga[15393]: 2021-11-07 11:34:13,900 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:34:16 wikitech-static check_icinga[15393]: 2021-11-07 11:34:16,940 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:36:01 wikitech-static CRON[15470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:36:01 wikitech-static CRON[15472]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:36:02 wikitech-static check_icinga[15471]: 2021-11-07 11:36:02,065 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:36:02 wikitech-static check_icinga[15473]: 2021-11-07 11:36:02,085 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:36:04 wikitech-static check_icinga[15471]: 2021-11-07 11:36:04,781 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:36:05 wikitech-static check_icinga[15473]: 2021-11-07 11:36:05,141 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:38:01 wikitech-static CRON[15551]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:38:01 wikitech-static CRON[15552]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:38:02 wikitech-static check_icinga[15554]: 2021-11-07 11:38:02,834 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:38:02 wikitech-static check_icinga[15553]: 2021-11-07 11:38:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:38:05 wikitech-static check_icinga[15553]: 2021-11-07 11:38:05,578 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:38:05 wikitech-static check_icinga[15554]: 2021-11-07 11:38:05,974 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:39:01 wikitech-static CRON[15598]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 11:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 11:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 11:40:01 wikitech-static CRON[15720]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:40:01 wikitech-static CRON[15721]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:40:02 wikitech-static check_icinga[15723]: 2021-11-07 11:40:02,143 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:40:02 wikitech-static check_icinga[15722]: 2021-11-07 11:40:02,213 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:40:05 wikitech-static check_icinga[15722]: 2021-11-07 11:40:05,016 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:40:05 wikitech-static check_icinga[15723]: 2021-11-07 11:40:05,368 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:42:01 wikitech-static CRON[15802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:42:01 wikitech-static CRON[15803]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:42:02 wikitech-static check_icinga[15805]: 2021-11-07 11:42:02,487 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:42:02 wikitech-static check_icinga[15804]: 2021-11-07 11:42:02,516 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:42:05 wikitech-static check_icinga[15804]: 2021-11-07 11:42:05,334 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:42:05 wikitech-static check_icinga[15805]: 2021-11-07 11:42:05,725 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:44:01 wikitech-static CRON[15881]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:44:01 wikitech-static CRON[15882]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:44:02 wikitech-static check_icinga[15883]: 2021-11-07 11:44:02,844 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:44:02 wikitech-static check_icinga[15884]: 2021-11-07 11:44:02,867 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:44:05 wikitech-static check_icinga[15884]: 2021-11-07 11:44:05,658 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:44:06 wikitech-static check_icinga[15883]: 2021-11-07 11:44:06,002 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:46:01 wikitech-static CRON[15962]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:46:01 wikitech-static CRON[15963]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:46:02 wikitech-static check_icinga[15965]: 2021-11-07 11:46:02,131 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:46:02 wikitech-static check_icinga[15964]: 2021-11-07 11:46:02,165 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:46:05 wikitech-static check_icinga[15964]: 2021-11-07 11:46:05,160 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:46:05 wikitech-static check_icinga[15965]: 2021-11-07 11:46:05,249 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:48:01 wikitech-static CRON[16045]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:48:01 wikitech-static CRON[16046]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:48:02 wikitech-static check_icinga[16047]: 2021-11-07 11:48:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:48:02 wikitech-static check_icinga[16048]: 2021-11-07 11:48:02,421 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:48:05 wikitech-static check_icinga[16047]: 2021-11-07 11:48:05,534 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:48:05 wikitech-static check_icinga[16048]: 2021-11-07 11:48:05,689 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:50:01 wikitech-static CRON[16137]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:50:01 wikitech-static CRON[16138]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:50:02 wikitech-static check_icinga[16139]: 2021-11-07 11:50:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:50:02 wikitech-static check_icinga[16140]: 2021-11-07 11:50:02,849 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:50:06 wikitech-static check_icinga[16139]: 2021-11-07 11:50:06,051 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:50:06 wikitech-static check_icinga[16140]: 2021-11-07 11:50:06,115 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:52:01 wikitech-static CRON[16212]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:52:01 wikitech-static CRON[16213]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:52:02 wikitech-static check_icinga[16214]: 2021-11-07 11:52:02,254 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:52:02 wikitech-static check_icinga[16215]: 2021-11-07 11:52:02,285 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:52:05 wikitech-static check_icinga[16215]: 2021-11-07 11:52:05,379 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:52:05 wikitech-static check_icinga[16214]: 2021-11-07 11:52:05,392 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:54:01 wikitech-static CRON[16295]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:54:01 wikitech-static CRON[16296]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:54:02 wikitech-static check_icinga[16298]: 2021-11-07 11:54:02,589 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:54:02 wikitech-static check_icinga[16299]: 2021-11-07 11:54:02,624 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:54:05 wikitech-static check_icinga[16298]: 2021-11-07 11:54:05,712 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:54:05 wikitech-static check_icinga[16299]: 2021-11-07 11:54:05,830 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:56:01 wikitech-static CRON[16372]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:56:01 wikitech-static CRON[16373]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:56:02 wikitech-static check_icinga[16375]: 2021-11-07 11:56:02,970 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:56:03 wikitech-static check_icinga[16374]: 2021-11-07 11:56:03,061 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:56:06 wikitech-static check_icinga[16374]: 2021-11-07 11:56:06,033 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:56:06 wikitech-static check_icinga[16375]: 2021-11-07 11:56:06,186 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 11:58:01 wikitech-static CRON[16452]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 11:58:01 wikitech-static CRON[16453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 11:58:02 wikitech-static check_icinga[16454]: 2021-11-07 11:58:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 11:58:02 wikitech-static check_icinga[16455]: 2021-11-07 11:58:02,398 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 11:58:05 wikitech-static check_icinga[16455]: 2021-11-07 11:58:05,411 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 11:58:05 wikitech-static check_icinga[16454]: 2021-11-07 11:58:05,699 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:00:01 wikitech-static CRON[16527]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:00:01 wikitech-static CRON[16528]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:00:02 wikitech-static check_icinga[16529]: 2021-11-07 12:00:02,821 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:00:02 wikitech-static check_icinga[16530]: 2021-11-07 12:00:02,823 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:00:05 wikitech-static check_icinga[16529]: 2021-11-07 12:00:05,725 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:00:06 wikitech-static check_icinga[16530]: 2021-11-07 12:00:06,187 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:02:01 wikitech-static CRON[16603]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:02:01 wikitech-static CRON[16604]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:02:02 wikitech-static check_icinga[16605]: 2021-11-07 12:02:02,345 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:02:02 wikitech-static check_icinga[16606]: 2021-11-07 12:02:02,348 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:02:05 wikitech-static check_icinga[16605]: 2021-11-07 12:02:05,496 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:02:05 wikitech-static check_icinga[16606]: 2021-11-07 12:02:05,666 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:04:01 wikitech-static CRON[16680]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:04:01 wikitech-static CRON[16681]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:04:02 wikitech-static check_icinga[16682]: 2021-11-07 12:04:02,794 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:04:02 wikitech-static check_icinga[16683]: 2021-11-07 12:04:02,825 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:04:05 wikitech-static check_icinga[16683]: 2021-11-07 12:04:05,827 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:04:05 wikitech-static check_icinga[16682]: 2021-11-07 12:04:05,942 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:06:01 wikitech-static CRON[16755]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:06:01 wikitech-static CRON[16756]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:06:02 wikitech-static check_icinga[16757]: 2021-11-07 12:06:02,067 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:06:02 wikitech-static check_icinga[16758]: 2021-11-07 12:06:02,098 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:06:05 wikitech-static check_icinga[16757]: 2021-11-07 12:06:05,294 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:06:05 wikitech-static check_icinga[16758]: 2021-11-07 12:06:05,303 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:08:01 wikitech-static CRON[16830]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:08:01 wikitech-static CRON[16831]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:08:02 wikitech-static check_icinga[16833]: 2021-11-07 12:08:02,573 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:08:02 wikitech-static check_icinga[16832]: 2021-11-07 12:08:02,667 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:08:05 wikitech-static check_icinga[16832]: 2021-11-07 12:08:05,681 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:08:05 wikitech-static check_icinga[16833]: 2021-11-07 12:08:05,701 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:09:01 wikitech-static CRON[16877]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 12:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 12:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 12:10:01 wikitech-static CRON[17002]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:10:01 wikitech-static CRON[17004]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:10:02 wikitech-static check_icinga[17003]: 2021-11-07 12:10:02,948 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:10:02 wikitech-static check_icinga[17005]: 2021-11-07 12:10:02,953 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:10:05 wikitech-static check_icinga[17003]: 2021-11-07 12:10:05,895 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:10:06 wikitech-static check_icinga[17005]: 2021-11-07 12:10:06,010 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:11:01 wikitech-static CRON[17050]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 12:11:01 wikitech-static check_icinga_validate_config[17051]: Valid config, nothing to do. Nov 7 12:12:01 wikitech-static CRON[17083]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:12:01 wikitech-static CRON[17085]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:12:02 wikitech-static check_icinga[17084]: 2021-11-07 12:12:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:12:02 wikitech-static check_icinga[17086]: 2021-11-07 12:12:02,861 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:12:06 wikitech-static check_icinga[17086]: 2021-11-07 12:12:06,003 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:12:06 wikitech-static check_icinga[17084]: 2021-11-07 12:12:06,034 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:14:01 wikitech-static CRON[17159]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:14:01 wikitech-static CRON[17160]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:14:02 wikitech-static check_icinga[17162]: 2021-11-07 12:14:02,288 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:14:02 wikitech-static check_icinga[17161]: 2021-11-07 12:14:02,293 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:14:05 wikitech-static check_icinga[17162]: 2021-11-07 12:14:05,427 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:14:05 wikitech-static check_icinga[17161]: 2021-11-07 12:14:05,485 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:16:01 wikitech-static CRON[17238]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:16:01 wikitech-static CRON[17239]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:16:02 wikitech-static check_icinga[17241]: 2021-11-07 12:16:02,635 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:16:02 wikitech-static check_icinga[17240]: 2021-11-07 12:16:02,728 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:16:05 wikitech-static check_icinga[17240]: 2021-11-07 12:16:05,819 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:16:05 wikitech-static check_icinga[17241]: 2021-11-07 12:16:05,838 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:17:01 wikitech-static CRON[17290]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 12:18:01 wikitech-static CRON[17323]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:18:01 wikitech-static CRON[17324]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:18:02 wikitech-static check_icinga[17326]: 2021-11-07 12:18:02,179 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:18:02 wikitech-static check_icinga[17325]: 2021-11-07 12:18:02,182 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:18:05 wikitech-static check_icinga[17325]: 2021-11-07 12:18:05,245 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:18:05 wikitech-static check_icinga[17326]: 2021-11-07 12:18:05,392 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:20:01 wikitech-static CRON[17406]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:20:01 wikitech-static CRON[17407]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:20:02 wikitech-static check_icinga[17408]: 2021-11-07 12:20:02,561 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:20:02 wikitech-static check_icinga[17409]: 2021-11-07 12:20:02,585 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:20:05 wikitech-static check_icinga[17409]: 2021-11-07 12:20:05,579 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:20:05 wikitech-static check_icinga[17408]: 2021-11-07 12:20:05,807 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:22:01 wikitech-static CRON[17488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:22:01 wikitech-static CRON[17489]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:22:02 wikitech-static check_icinga[17490]: 2021-11-07 12:22:02,941 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:22:02 wikitech-static check_icinga[17491]: 2021-11-07 12:22:02,951 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:22:05 wikitech-static check_icinga[17490]: 2021-11-07 12:22:05,873 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:22:06 wikitech-static check_icinga[17491]: 2021-11-07 12:22:06,231 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:24:01 wikitech-static CRON[17567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:24:01 wikitech-static CRON[17568]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:24:02 wikitech-static check_icinga[17570]: 2021-11-07 12:24:02,373 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:24:02 wikitech-static check_icinga[17569]: 2021-11-07 12:24:02,408 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:24:05 wikitech-static check_icinga[17570]: 2021-11-07 12:24:05,375 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:24:05 wikitech-static check_icinga[17569]: 2021-11-07 12:24:05,760 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:26:01 wikitech-static CRON[17642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:26:01 wikitech-static CRON[17643]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:26:02 wikitech-static check_icinga[17644]: 2021-11-07 12:26:02,909 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:26:02 wikitech-static check_icinga[17645]: 2021-11-07 12:26:02,913 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:26:05 wikitech-static check_icinga[17645]: 2021-11-07 12:26:05,913 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:26:05 wikitech-static check_icinga[17644]: 2021-11-07 12:26:05,977 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:28:01 wikitech-static CRON[17717]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:28:01 wikitech-static CRON[17718]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:28:02 wikitech-static check_icinga[17720]: 2021-11-07 12:28:02,134 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:28:02 wikitech-static check_icinga[17719]: 2021-11-07 12:28:02,207 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:28:05 wikitech-static check_icinga[17720]: 2021-11-07 12:28:05,261 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:28:05 wikitech-static check_icinga[17719]: 2021-11-07 12:28:05,329 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:30:01 wikitech-static CRON[17792]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:30:01 wikitech-static CRON[17793]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:30:02 wikitech-static check_icinga[17794]: 2021-11-07 12:30:02,461 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:30:02 wikitech-static check_icinga[17795]: 2021-11-07 12:30:02,469 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:30:05 wikitech-static check_icinga[17794]: 2021-11-07 12:30:05,592 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:30:05 wikitech-static check_icinga[17795]: 2021-11-07 12:30:05,651 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:32:01 wikitech-static CRON[17877]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:32:01 wikitech-static CRON[17878]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:32:02 wikitech-static check_icinga[17879]: 2021-11-07 12:32:02,835 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:32:02 wikitech-static check_icinga[17880]: 2021-11-07 12:32:02,840 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:32:05 wikitech-static check_icinga[17879]: 2021-11-07 12:32:05,862 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:32:05 wikitech-static check_icinga[17880]: 2021-11-07 12:32:05,983 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:34:01 wikitech-static CRON[17952]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:34:01 wikitech-static CRON[17953]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:34:02 wikitech-static check_icinga[17955]: 2021-11-07 12:34:02,131 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:34:02 wikitech-static check_icinga[17954]: 2021-11-07 12:34:02,136 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:34:03 wikitech-static check_icinga[17955]: 2021-11-07 12:34:03,520 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)'] Nov 7 12:34:05 wikitech-static check_icinga[17954]: 2021-11-07 12:34:05,322 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:34:13 wikitech-static check_icinga[17955]: 2021-11-07 12:34:13,532 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:34:16 wikitech-static check_icinga[17955]: 2021-11-07 12:34:16,091 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:36:01 wikitech-static CRON[18027]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:36:01 wikitech-static CRON[18028]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:36:02 wikitech-static check_icinga[18030]: 2021-11-07 12:36:02,229 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:36:02 wikitech-static check_icinga[18029]: 2021-11-07 12:36:02,237 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:36:04 wikitech-static check_icinga[18029]: 2021-11-07 12:36:04,858 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:36:05 wikitech-static check_icinga[18030]: 2021-11-07 12:36:05,581 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:38:01 wikitech-static CRON[18107]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:38:01 wikitech-static CRON[18108]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:38:02 wikitech-static check_icinga[18110]: 2021-11-07 12:38:02,718 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:38:02 wikitech-static check_icinga[18109]: 2021-11-07 12:38:02,785 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:38:05 wikitech-static check_icinga[18109]: 2021-11-07 12:38:05,571 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:38:05 wikitech-static check_icinga[18110]: 2021-11-07 12:38:05,755 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:39:01 wikitech-static CRON[18154]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 12:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 12:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 12:40:01 wikitech-static CRON[18288]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:40:01 wikitech-static CRON[18289]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:40:02 wikitech-static check_icinga[18290]: 2021-11-07 12:40:02,912 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:40:02 wikitech-static check_icinga[18291]: 2021-11-07 12:40:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:40:05 wikitech-static check_icinga[18290]: 2021-11-07 12:40:05,705 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:40:06 wikitech-static check_icinga[18291]: 2021-11-07 12:40:06,173 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:42:01 wikitech-static CRON[18363]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:42:01 wikitech-static CRON[18364]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:42:02 wikitech-static check_icinga[18365]: 2021-11-07 12:42:02,346 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:42:02 wikitech-static check_icinga[18366]: 2021-11-07 12:42:02,354 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:42:05 wikitech-static check_icinga[18365]: 2021-11-07 12:42:05,165 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:42:05 wikitech-static check_icinga[18366]: 2021-11-07 12:42:05,494 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:44:01 wikitech-static CRON[18438]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:44:01 wikitech-static CRON[18440]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:44:02 wikitech-static check_icinga[18439]: 2021-11-07 12:44:02,636 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:44:02 wikitech-static check_icinga[18441]: 2021-11-07 12:44:02,644 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:44:05 wikitech-static check_icinga[18439]: 2021-11-07 12:44:05,386 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:44:05 wikitech-static check_icinga[18441]: 2021-11-07 12:44:05,874 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:46:01 wikitech-static CRON[18522]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:46:01 wikitech-static CRON[18523]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:46:03 wikitech-static check_icinga[18525]: 2021-11-07 12:46:03,004 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:46:03 wikitech-static check_icinga[18524]: 2021-11-07 12:46:03,007 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:46:06 wikitech-static check_icinga[18524]: 2021-11-07 12:46:06,070 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:46:06 wikitech-static check_icinga[18525]: 2021-11-07 12:46:06,320 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:48:01 wikitech-static CRON[18600]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:48:01 wikitech-static CRON[18601]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:48:02 wikitech-static check_icinga[18603]: 2021-11-07 12:48:02,538 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:48:02 wikitech-static check_icinga[18602]: 2021-11-07 12:48:02,564 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:48:05 wikitech-static check_icinga[18602]: 2021-11-07 12:48:05,623 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:48:05 wikitech-static check_icinga[18603]: 2021-11-07 12:48:05,778 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:50:01 wikitech-static CRON[18676]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:50:01 wikitech-static CRON[18677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:50:02 wikitech-static check_icinga[18679]: 2021-11-07 12:50:02,901 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:50:02 wikitech-static check_icinga[18678]: 2021-11-07 12:50:02,903 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:50:06 wikitech-static check_icinga[18679]: 2021-11-07 12:50:06,092 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:50:06 wikitech-static check_icinga[18678]: 2021-11-07 12:50:06,139 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:52:01 wikitech-static CRON[18754]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:52:01 wikitech-static CRON[18755]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:52:02 wikitech-static check_icinga[18756]: 2021-11-07 12:52:02,381 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:52:02 wikitech-static check_icinga[18757]: 2021-11-07 12:52:02,461 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:52:05 wikitech-static check_icinga[18756]: 2021-11-07 12:52:05,503 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:52:05 wikitech-static check_icinga[18757]: 2021-11-07 12:52:05,538 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:54:01 wikitech-static CRON[18835]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:54:01 wikitech-static CRON[18836]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:54:02 wikitech-static check_icinga[18837]: 2021-11-07 12:54:02,721 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:54:02 wikitech-static check_icinga[18838]: 2021-11-07 12:54:02,722 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:54:05 wikitech-static check_icinga[18837]: 2021-11-07 12:54:05,837 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:54:05 wikitech-static check_icinga[18838]: 2021-11-07 12:54:05,889 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:56:02 wikitech-static CRON[18922]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:56:02 wikitech-static CRON[18923]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:56:03 wikitech-static check_icinga[18924]: 2021-11-07 12:56:03,078 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:56:03 wikitech-static check_icinga[18925]: 2021-11-07 12:56:03,085 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:56:06 wikitech-static check_icinga[18924]: 2021-11-07 12:56:06,055 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:56:06 wikitech-static check_icinga[18925]: 2021-11-07 12:56:06,329 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 12:58:01 wikitech-static CRON[18997]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 12:58:01 wikitech-static CRON[18998]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 12:58:02 wikitech-static check_icinga[19000]: 2021-11-07 12:58:02,518 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 12:58:02 wikitech-static check_icinga[18999]: 2021-11-07 12:58:02,521 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 12:58:05 wikitech-static check_icinga[19000]: 2021-11-07 12:58:05,427 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 12:58:05 wikitech-static check_icinga[18999]: 2021-11-07 12:58:05,689 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:00:01 wikitech-static CRON[19074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:00:01 wikitech-static CRON[19075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:00:02 wikitech-static check_icinga[19076]: 2021-11-07 13:00:02,822 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:00:02 wikitech-static check_icinga[19077]: 2021-11-07 13:00:02,851 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:00:05 wikitech-static check_icinga[19076]: 2021-11-07 13:00:05,735 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:00:05 wikitech-static check_icinga[19077]: 2021-11-07 13:00:05,978 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:02:01 wikitech-static CRON[19208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:02:01 wikitech-static CRON[19209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:02:02 wikitech-static check_icinga[19210]: 2021-11-07 13:02:02,113 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:02:02 wikitech-static check_icinga[19211]: 2021-11-07 13:02:02,245 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:02:05 wikitech-static check_icinga[19210]: 2021-11-07 13:02:05,157 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:02:05 wikitech-static check_icinga[19211]: 2021-11-07 13:02:05,622 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:04:01 wikitech-static CRON[19288]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:04:01 wikitech-static CRON[19289]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:04:02 wikitech-static check_icinga[19291]: 2021-11-07 13:04:02,757 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:04:02 wikitech-static check_icinga[19290]: 2021-11-07 13:04:02,786 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:04:05 wikitech-static check_icinga[19291]: 2021-11-07 13:04:05,866 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:04:06 wikitech-static check_icinga[19290]: 2021-11-07 13:04:06,002 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:06:01 wikitech-static CRON[19366]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:06:01 wikitech-static CRON[19367]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:06:02 wikitech-static check_icinga[19369]: 2021-11-07 13:06:02,154 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:06:02 wikitech-static check_icinga[19368]: 2021-11-07 13:06:02,158 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:06:05 wikitech-static check_icinga[19369]: 2021-11-07 13:06:05,242 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:06:05 wikitech-static check_icinga[19368]: 2021-11-07 13:06:05,494 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:08:01 wikitech-static CRON[19446]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:08:01 wikitech-static CRON[19447]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:08:02 wikitech-static check_icinga[19448]: 2021-11-07 13:08:02,695 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:08:02 wikitech-static check_icinga[19449]: 2021-11-07 13:08:02,702 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:08:05 wikitech-static check_icinga[19448]: 2021-11-07 13:08:05,645 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:08:05 wikitech-static check_icinga[19449]: 2021-11-07 13:08:05,836 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:09:01 wikitech-static CRON[19493]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 13:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 13:09:07 wikitech-static systemd[1]: Started Clean php session files. Nov 7 13:10:01 wikitech-static CRON[19626]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:10:01 wikitech-static CRON[19627]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:10:02 wikitech-static check_icinga[19629]: 2021-11-07 13:10:02,966 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:10:02 wikitech-static check_icinga[19628]: 2021-11-07 13:10:02,992 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:10:06 wikitech-static check_icinga[19628]: 2021-11-07 13:10:06,042 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:10:06 wikitech-static check_icinga[19629]: 2021-11-07 13:10:06,148 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:12:01 wikitech-static CRON[19702]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:12:01 wikitech-static CRON[19703]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:12:02 wikitech-static check_icinga[19704]: 2021-11-07 13:12:02,295 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:12:02 wikitech-static check_icinga[19705]: 2021-11-07 13:12:02,308 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:12:05 wikitech-static check_icinga[19705]: 2021-11-07 13:12:05,296 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:12:05 wikitech-static check_icinga[19704]: 2021-11-07 13:12:05,583 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:14:01 wikitech-static CRON[19779]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:14:01 wikitech-static CRON[19780]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:14:02 wikitech-static check_icinga[19782]: 2021-11-07 13:14:02,722 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:14:02 wikitech-static check_icinga[19781]: 2021-11-07 13:14:02,730 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:14:05 wikitech-static check_icinga[19782]: 2021-11-07 13:14:05,691 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:14:05 wikitech-static check_icinga[19781]: 2021-11-07 13:14:05,970 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:16:01 wikitech-static CRON[19858]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:16:01 wikitech-static CRON[19859]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:16:02 wikitech-static check_icinga[19860]: 2021-11-07 13:16:02,095 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:16:02 wikitech-static check_icinga[19861]: 2021-11-07 13:16:02,119 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:16:05 wikitech-static check_icinga[19860]: 2021-11-07 13:16:05,199 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:16:05 wikitech-static check_icinga[19861]: 2021-11-07 13:16:05,261 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:17:01 wikitech-static CRON[19905]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 13:18:01 wikitech-static CRON[19936]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:18:01 wikitech-static CRON[19937]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:18:02 wikitech-static check_icinga[19939]: 2021-11-07 13:18:02,441 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:18:02 wikitech-static check_icinga[19938]: 2021-11-07 13:18:02,503 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:18:05 wikitech-static check_icinga[19938]: 2021-11-07 13:18:05,494 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:18:05 wikitech-static check_icinga[19939]: 2021-11-07 13:18:05,876 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:20:01 wikitech-static CRON[20030]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:20:01 wikitech-static CRON[20031]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:20:02 wikitech-static check_icinga[20033]: 2021-11-07 13:20:02,981 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:20:03 wikitech-static check_icinga[20032]: 2021-11-07 13:20:03,008 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:20:06 wikitech-static check_icinga[20032]: 2021-11-07 13:20:06,112 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:20:06 wikitech-static check_icinga[20033]: 2021-11-07 13:20:06,343 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:22:01 wikitech-static CRON[20108]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:22:01 wikitech-static CRON[20109]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:22:02 wikitech-static check_icinga[20110]: 2021-11-07 13:22:02,498 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:22:02 wikitech-static check_icinga[20111]: 2021-11-07 13:22:02,532 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:22:05 wikitech-static check_icinga[20110]: 2021-11-07 13:22:05,572 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:22:05 wikitech-static check_icinga[20111]: 2021-11-07 13:22:05,778 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:24:01 wikitech-static CRON[20185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:24:01 wikitech-static CRON[20186]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:24:02 wikitech-static check_icinga[20187]: 2021-11-07 13:24:02,926 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:24:02 wikitech-static check_icinga[20188]: 2021-11-07 13:24:02,989 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:24:05 wikitech-static check_icinga[20187]: 2021-11-07 13:24:05,806 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:24:06 wikitech-static check_icinga[20188]: 2021-11-07 13:24:06,297 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:26:01 wikitech-static CRON[20263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:26:01 wikitech-static CRON[20264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:26:02 wikitech-static check_icinga[20266]: 2021-11-07 13:26:02,502 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:26:02 wikitech-static check_icinga[20265]: 2021-11-07 13:26:02,505 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:26:05 wikitech-static check_icinga[20265]: 2021-11-07 13:26:05,439 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:26:05 wikitech-static check_icinga[20266]: 2021-11-07 13:26:05,563 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:28:01 wikitech-static CRON[20389]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:28:01 wikitech-static CRON[20390]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:28:02 wikitech-static check_icinga[20391]: 2021-11-07 13:28:02,690 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:28:02 wikitech-static check_icinga[20392]: 2021-11-07 13:28:02,717 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:28:05 wikitech-static check_icinga[20391]: 2021-11-07 13:28:05,779 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:28:05 wikitech-static check_icinga[20392]: 2021-11-07 13:28:05,954 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:30:01 wikitech-static CRON[20464]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:30:01 wikitech-static CRON[20465]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:30:02 wikitech-static check_icinga[20467]: 2021-11-07 13:30:02,093 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:30:02 wikitech-static check_icinga[20466]: 2021-11-07 13:30:02,122 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:30:05 wikitech-static check_icinga[20467]: 2021-11-07 13:30:05,073 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:30:05 wikitech-static check_icinga[20466]: 2021-11-07 13:30:05,212 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:32:01 wikitech-static CRON[20543]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:32:01 wikitech-static CRON[20545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:32:02 wikitech-static check_icinga[20544]: 2021-11-07 13:32:02,450 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:32:02 wikitech-static check_icinga[20546]: 2021-11-07 13:32:02,466 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:32:05 wikitech-static check_icinga[20544]: 2021-11-07 13:32:05,442 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:32:05 wikitech-static check_icinga[20546]: 2021-11-07 13:32:05,655 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:34:01 wikitech-static CRON[20618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:34:01 wikitech-static CRON[20619]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:34:02 wikitech-static check_icinga[20620]: 2021-11-07 13:34:02,797 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:34:02 wikitech-static check_icinga[20621]: 2021-11-07 13:34:02,803 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:34:04 wikitech-static check_icinga[20620]: 2021-11-07 13:34:04,201 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Event Handlers Enabled? MISSING_KEY (expected No)'] Nov 7 13:34:05 wikitech-static check_icinga[20621]: 2021-11-07 13:34:05,986 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:34:14 wikitech-static check_icinga[20620]: 2021-11-07 13:34:14,214 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:34:16 wikitech-static check_icinga[20620]: 2021-11-07 13:34:16,957 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:36:01 wikitech-static CRON[20697]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:36:01 wikitech-static CRON[20698]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:36:02 wikitech-static check_icinga[20700]: 2021-11-07 13:36:02,081 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:36:02 wikitech-static check_icinga[20699]: 2021-11-07 13:36:02,115 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:36:04 wikitech-static check_icinga[20699]: 2021-11-07 13:36:04,877 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:36:05 wikitech-static check_icinga[20700]: 2021-11-07 13:36:05,141 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:38:01 wikitech-static CRON[20774]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:38:01 wikitech-static CRON[20775]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:38:02 wikitech-static check_icinga[20776]: 2021-11-07 13:38:02,313 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:38:02 wikitech-static check_icinga[20777]: 2021-11-07 13:38:02,321 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:38:05 wikitech-static check_icinga[20776]: 2021-11-07 13:38:05,058 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:38:05 wikitech-static check_icinga[20777]: 2021-11-07 13:38:05,676 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:39:01 wikitech-static CRON[20821]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 13:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 13:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 13:40:01 wikitech-static CRON[20946]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:40:01 wikitech-static CRON[20947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:40:02 wikitech-static check_icinga[20948]: 2021-11-07 13:40:02,804 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:40:02 wikitech-static check_icinga[20949]: 2021-11-07 13:40:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:40:05 wikitech-static check_icinga[20948]: 2021-11-07 13:40:05,567 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:40:05 wikitech-static check_icinga[20949]: 2021-11-07 13:40:05,909 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:42:01 wikitech-static CRON[21021]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:42:01 wikitech-static CRON[21022]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:42:03 wikitech-static check_icinga[21024]: 2021-11-07 13:42:03,039 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:42:03 wikitech-static check_icinga[21023]: 2021-11-07 13:42:03,109 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:42:05 wikitech-static check_icinga[21023]: 2021-11-07 13:42:05,911 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:42:06 wikitech-static check_icinga[21024]: 2021-11-07 13:42:06,133 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:44:01 wikitech-static CRON[21096]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:44:01 wikitech-static CRON[21097]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:44:02 wikitech-static check_icinga[21099]: 2021-11-07 13:44:02,278 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:44:02 wikitech-static check_icinga[21098]: 2021-11-07 13:44:02,286 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:44:05 wikitech-static check_icinga[21098]: 2021-11-07 13:44:05,014 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:44:05 wikitech-static check_icinga[21099]: 2021-11-07 13:44:05,498 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:46:01 wikitech-static CRON[21171]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:46:01 wikitech-static CRON[21172]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:46:02 wikitech-static check_icinga[21173]: 2021-11-07 13:46:02,690 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:46:02 wikitech-static check_icinga[21174]: 2021-11-07 13:46:02,693 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:46:05 wikitech-static check_icinga[21173]: 2021-11-07 13:46:05,655 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:46:05 wikitech-static check_icinga[21174]: 2021-11-07 13:46:05,803 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:48:01 wikitech-static CRON[21250]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:48:01 wikitech-static CRON[21251]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:48:02 wikitech-static check_icinga[21252]: 2021-11-07 13:48:02,944 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:48:03 wikitech-static check_icinga[21253]: 2021-11-07 13:48:03,048 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:48:05 wikitech-static check_icinga[21252]: 2021-11-07 13:48:05,869 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:48:06 wikitech-static check_icinga[21253]: 2021-11-07 13:48:06,153 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:50:01 wikitech-static CRON[21373]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:50:01 wikitech-static CRON[21374]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:50:02 wikitech-static check_icinga[21376]: 2021-11-07 13:50:02,298 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:50:02 wikitech-static check_icinga[21375]: 2021-11-07 13:50:02,300 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:50:05 wikitech-static check_icinga[21376]: 2021-11-07 13:50:05,366 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:50:05 wikitech-static check_icinga[21375]: 2021-11-07 13:50:05,476 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:52:01 wikitech-static CRON[21453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:52:01 wikitech-static CRON[21454]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:52:02 wikitech-static check_icinga[21456]: 2021-11-07 13:52:02,649 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:52:02 wikitech-static check_icinga[21455]: 2021-11-07 13:52:02,684 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:52:05 wikitech-static check_icinga[21455]: 2021-11-07 13:52:05,739 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:52:06 wikitech-static check_icinga[21456]: 2021-11-07 13:52:06,056 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:54:01 wikitech-static CRON[21530]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:54:01 wikitech-static CRON[21532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:54:02 wikitech-static check_icinga[21533]: 2021-11-07 13:54:02,233 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:54:02 wikitech-static check_icinga[21531]: 2021-11-07 13:54:02,237 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:54:05 wikitech-static check_icinga[21531]: 2021-11-07 13:54:05,400 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:54:05 wikitech-static check_icinga[21533]: 2021-11-07 13:54:05,495 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:56:01 wikitech-static CRON[21605]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:56:01 wikitech-static CRON[21606]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:56:02 wikitech-static check_icinga[21607]: 2021-11-07 13:56:02,614 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:56:02 wikitech-static check_icinga[21608]: 2021-11-07 13:56:02,629 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:56:05 wikitech-static check_icinga[21607]: 2021-11-07 13:56:05,665 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:56:05 wikitech-static check_icinga[21608]: 2021-11-07 13:56:05,815 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 13:58:01 wikitech-static CRON[21684]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 13:58:01 wikitech-static CRON[21685]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 13:58:02 wikitech-static check_icinga[21686]: 2021-11-07 13:58:02,976 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 13:58:02 wikitech-static check_icinga[21687]: 2021-11-07 13:58:02,984 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 13:58:05 wikitech-static check_icinga[21686]: 2021-11-07 13:58:05,870 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 13:58:06 wikitech-static check_icinga[21687]: 2021-11-07 13:58:06,126 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:00:01 wikitech-static CRON[21829]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:00:01 wikitech-static CRON[21830]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:00:02 wikitech-static check_icinga[21832]: 2021-11-07 14:00:02,284 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:00:02 wikitech-static check_icinga[21831]: 2021-11-07 14:00:02,285 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:00:05 wikitech-static check_icinga[21831]: 2021-11-07 14:00:05,440 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:00:05 wikitech-static check_icinga[21832]: 2021-11-07 14:00:05,528 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:02:01 wikitech-static CRON[21907]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:02:01 wikitech-static CRON[21908]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:02:02 wikitech-static check_icinga[21910]: 2021-11-07 14:02:02,688 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:02:02 wikitech-static check_icinga[21909]: 2021-11-07 14:02:02,732 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:02:05 wikitech-static check_icinga[21909]: 2021-11-07 14:02:05,765 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:02:05 wikitech-static check_icinga[21910]: 2021-11-07 14:02:05,842 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:04:01 wikitech-static CRON[21982]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:04:01 wikitech-static CRON[21983]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:04:02 wikitech-static check_icinga[21985]: 2021-11-07 14:04:02,996 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:04:03 wikitech-static check_icinga[21984]: 2021-11-07 14:04:03,066 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:04:06 wikitech-static check_icinga[21984]: 2021-11-07 14:04:06,140 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:04:06 wikitech-static check_icinga[21985]: 2021-11-07 14:04:06,290 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:06:01 wikitech-static CRON[22060]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:06:01 wikitech-static CRON[22061]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:06:02 wikitech-static check_icinga[22063]: 2021-11-07 14:06:02,467 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:06:02 wikitech-static check_icinga[22062]: 2021-11-07 14:06:02,496 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:06:05 wikitech-static check_icinga[22062]: 2021-11-07 14:06:05,677 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:06:05 wikitech-static check_icinga[22063]: 2021-11-07 14:06:05,738 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:08:01 wikitech-static CRON[22137]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:08:01 wikitech-static CRON[22138]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:08:02 wikitech-static check_icinga[22140]: 2021-11-07 14:08:02,929 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:08:02 wikitech-static check_icinga[22139]: 2021-11-07 14:08:02,994 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:08:05 wikitech-static check_icinga[22139]: 2021-11-07 14:08:05,862 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:08:06 wikitech-static check_icinga[22140]: 2021-11-07 14:08:06,051 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:09:01 wikitech-static CRON[22184]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 14:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 14:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 14:10:01 wikitech-static CRON[22306]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:10:01 wikitech-static CRON[22307]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:10:02 wikitech-static check_icinga[22309]: 2021-11-07 14:10:02,200 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:10:02 wikitech-static check_icinga[22308]: 2021-11-07 14:10:02,269 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:10:05 wikitech-static check_icinga[22308]: 2021-11-07 14:10:05,397 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:10:05 wikitech-static check_icinga[22309]: 2021-11-07 14:10:05,438 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:11:01 wikitech-static CRON[22353]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 14:11:02 wikitech-static check_icinga_validate_config[22354]: Valid config, nothing to do. Nov 7 14:12:01 wikitech-static CRON[22386]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:12:01 wikitech-static CRON[22387]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:12:02 wikitech-static check_icinga[22388]: 2021-11-07 14:12:02,397 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:12:02 wikitech-static check_icinga[22389]: 2021-11-07 14:12:02,423 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:12:05 wikitech-static check_icinga[22388]: 2021-11-07 14:12:05,497 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:12:05 wikitech-static check_icinga[22389]: 2021-11-07 14:12:05,505 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:14:01 wikitech-static CRON[22470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:14:01 wikitech-static CRON[22471]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:14:02 wikitech-static check_icinga[22472]: 2021-11-07 14:14:02,762 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:14:02 wikitech-static check_icinga[22473]: 2021-11-07 14:14:02,766 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:14:05 wikitech-static check_icinga[22473]: 2021-11-07 14:14:05,858 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:14:06 wikitech-static check_icinga[22472]: 2021-11-07 14:14:06,059 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:16:01 wikitech-static CRON[22572]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:16:01 wikitech-static CRON[22573]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:16:02 wikitech-static check_icinga[22574]: 2021-11-07 14:16:02,225 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:16:02 wikitech-static check_icinga[22575]: 2021-11-07 14:16:02,228 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:16:05 wikitech-static check_icinga[22574]: 2021-11-07 14:16:05,256 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:16:05 wikitech-static check_icinga[22575]: 2021-11-07 14:16:05,367 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:17:01 wikitech-static CRON[22622]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 14:18:01 wikitech-static CRON[22653]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:18:01 wikitech-static CRON[22654]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:18:02 wikitech-static check_icinga[22655]: 2021-11-07 14:18:02,557 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:18:02 wikitech-static check_icinga[22656]: 2021-11-07 14:18:02,593 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:18:05 wikitech-static check_icinga[22655]: 2021-11-07 14:18:05,609 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:18:05 wikitech-static check_icinga[22656]: 2021-11-07 14:18:05,686 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:20:01 wikitech-static CRON[22731]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:20:01 wikitech-static CRON[22732]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:20:02 wikitech-static check_icinga[22733]: 2021-11-07 14:20:02,984 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:20:03 wikitech-static check_icinga[22734]: 2021-11-07 14:20:03,007 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:20:06 wikitech-static check_icinga[22733]: 2021-11-07 14:20:06,089 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:20:06 wikitech-static check_icinga[22734]: 2021-11-07 14:20:06,229 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:22:01 wikitech-static CRON[22806]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:22:01 wikitech-static CRON[22807]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:22:02 wikitech-static check_icinga[22808]: 2021-11-07 14:22:02,412 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:22:02 wikitech-static check_icinga[22809]: 2021-11-07 14:22:02,490 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:22:05 wikitech-static check_icinga[22808]: 2021-11-07 14:22:05,498 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:22:05 wikitech-static check_icinga[22809]: 2021-11-07 14:22:05,597 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:24:01 wikitech-static CRON[22881]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:24:01 wikitech-static CRON[22883]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:24:02 wikitech-static check_icinga[22882]: 2021-11-07 14:24:02,749 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:24:02 wikitech-static check_icinga[22884]: 2021-11-07 14:24:02,765 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:24:05 wikitech-static check_icinga[22882]: 2021-11-07 14:24:05,778 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:24:05 wikitech-static check_icinga[22884]: 2021-11-07 14:24:05,803 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:26:01 wikitech-static CRON[22958]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:26:01 wikitech-static CRON[22959]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:26:03 wikitech-static check_icinga[22961]: 2021-11-07 14:26:03,029 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:26:03 wikitech-static check_icinga[22960]: 2021-11-07 14:26:03,098 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:26:06 wikitech-static check_icinga[22961]: 2021-11-07 14:26:06,099 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:26:06 wikitech-static check_icinga[22960]: 2021-11-07 14:26:06,291 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:28:01 wikitech-static CRON[23033]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:28:01 wikitech-static CRON[23034]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:28:02 wikitech-static check_icinga[23036]: 2021-11-07 14:28:02,427 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:28:02 wikitech-static check_icinga[23035]: 2021-11-07 14:28:02,454 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:28:05 wikitech-static check_icinga[23035]: 2021-11-07 14:28:05,492 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:28:05 wikitech-static check_icinga[23036]: 2021-11-07 14:28:05,548 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:30:01 wikitech-static CRON[23110]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:30:01 wikitech-static CRON[23111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:30:02 wikitech-static check_icinga[23112]: 2021-11-07 14:30:02,727 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:30:02 wikitech-static check_icinga[23113]: 2021-11-07 14:30:02,748 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:30:05 wikitech-static check_icinga[23113]: 2021-11-07 14:30:05,907 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:30:05 wikitech-static check_icinga[23112]: 2021-11-07 14:30:05,945 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:32:01 wikitech-static CRON[23189]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:32:01 wikitech-static CRON[23190]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:32:02 wikitech-static check_icinga[23192]: 2021-11-07 14:32:02,144 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:32:02 wikitech-static check_icinga[23191]: 2021-11-07 14:32:02,175 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:32:05 wikitech-static check_icinga[23191]: 2021-11-07 14:32:05,293 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:32:05 wikitech-static check_icinga[23192]: 2021-11-07 14:32:05,322 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:34:01 wikitech-static CRON[23278]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:34:01 wikitech-static CRON[23279]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:34:02 wikitech-static check_icinga[23281]: 2021-11-07 14:34:02,503 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:34:02 wikitech-static check_icinga[23280]: 2021-11-07 14:34:02,509 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:34:03 wikitech-static check_icinga[23280]: 2021-11-07 14:34:03,904 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)'] Nov 7 14:34:05 wikitech-static check_icinga[23281]: 2021-11-07 14:34:05,717 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:34:13 wikitech-static check_icinga[23280]: 2021-11-07 14:34:13,918 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:34:16 wikitech-static check_icinga[23280]: 2021-11-07 14:34:16,584 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:36:01 wikitech-static CRON[23362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:36:01 wikitech-static CRON[23363]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:36:02 wikitech-static check_icinga[23364]: 2021-11-07 14:36:02,699 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:36:02 wikitech-static check_icinga[23365]: 2021-11-07 14:36:02,713 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:36:05 wikitech-static check_icinga[23364]: 2021-11-07 14:36:05,557 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:36:05 wikitech-static check_icinga[23365]: 2021-11-07 14:36:05,691 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:38:01 wikitech-static CRON[23445]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:38:01 wikitech-static CRON[23446]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:38:02 wikitech-static check_icinga[23448]: 2021-11-07 14:38:02,927 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:38:03 wikitech-static check_icinga[23447]: 2021-11-07 14:38:03,005 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:38:05 wikitech-static check_icinga[23447]: 2021-11-07 14:38:05,705 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:38:06 wikitech-static check_icinga[23448]: 2021-11-07 14:38:06,204 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:39:01 wikitech-static CRON[23492]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 14:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 14:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 14:40:01 wikitech-static CRON[23616]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:40:01 wikitech-static CRON[23618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:40:02 wikitech-static check_icinga[23619]: 2021-11-07 14:40:02,346 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:40:02 wikitech-static check_icinga[23617]: 2021-11-07 14:40:02,361 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:40:05 wikitech-static check_icinga[23617]: 2021-11-07 14:40:05,115 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:40:05 wikitech-static check_icinga[23619]: 2021-11-07 14:40:05,421 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:42:01 wikitech-static CRON[23746]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:42:01 wikitech-static CRON[23747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:42:02 wikitech-static check_icinga[23748]: 2021-11-07 14:42:02,591 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:42:02 wikitech-static check_icinga[23749]: 2021-11-07 14:42:02,655 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:42:05 wikitech-static check_icinga[23749]: 2021-11-07 14:42:05,481 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:42:05 wikitech-static check_icinga[23748]: 2021-11-07 14:42:05,847 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:44:01 wikitech-static CRON[23842]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:44:01 wikitech-static CRON[23843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:44:03 wikitech-static check_icinga[23845]: 2021-11-07 14:44:03,030 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:44:03 wikitech-static check_icinga[23844]: 2021-11-07 14:44:03,033 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:44:05 wikitech-static check_icinga[23844]: 2021-11-07 14:44:05,984 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:44:06 wikitech-static check_icinga[23845]: 2021-11-07 14:44:06,040 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:46:01 wikitech-static CRON[23932]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:46:01 wikitech-static CRON[23933]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:46:02 wikitech-static check_icinga[23935]: 2021-11-07 14:46:02,218 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:46:02 wikitech-static check_icinga[23934]: 2021-11-07 14:46:02,223 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:46:05 wikitech-static check_icinga[23934]: 2021-11-07 14:46:05,299 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:46:05 wikitech-static check_icinga[23935]: 2021-11-07 14:46:05,616 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:48:01 wikitech-static CRON[24017]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:48:01 wikitech-static CRON[24018]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:48:02 wikitech-static check_icinga[24020]: 2021-11-07 14:48:02,920 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:48:02 wikitech-static check_icinga[24019]: 2021-11-07 14:48:02,990 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:48:05 wikitech-static check_icinga[24019]: 2021-11-07 14:48:05,864 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:48:06 wikitech-static check_icinga[24020]: 2021-11-07 14:48:06,203 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:50:01 wikitech-static CRON[24093]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:50:01 wikitech-static CRON[24094]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:50:02 wikitech-static check_icinga[24095]: 2021-11-07 14:50:02,365 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:50:02 wikitech-static check_icinga[24096]: 2021-11-07 14:50:02,370 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:50:05 wikitech-static check_icinga[24095]: 2021-11-07 14:50:05,365 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:50:05 wikitech-static check_icinga[24096]: 2021-11-07 14:50:05,981 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:52:01 wikitech-static CRON[24168]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:52:01 wikitech-static CRON[24169]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:52:02 wikitech-static check_icinga[24171]: 2021-11-07 14:52:02,125 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:52:02 wikitech-static check_icinga[24170]: 2021-11-07 14:52:02,185 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:52:05 wikitech-static check_icinga[24170]: 2021-11-07 14:52:05,227 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:52:05 wikitech-static check_icinga[24171]: 2021-11-07 14:52:05,315 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:54:01 wikitech-static CRON[24245]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:54:01 wikitech-static CRON[24246]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:54:02 wikitech-static check_icinga[24248]: 2021-11-07 14:54:02,472 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:54:02 wikitech-static check_icinga[24247]: 2021-11-07 14:54:02,481 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:54:05 wikitech-static check_icinga[24247]: 2021-11-07 14:54:05,390 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:54:05 wikitech-static check_icinga[24248]: 2021-11-07 14:54:05,637 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:56:01 wikitech-static CRON[24321]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:56:01 wikitech-static CRON[24322]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:56:03 wikitech-static check_icinga[24324]: 2021-11-07 14:56:03,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:56:03 wikitech-static check_icinga[24323]: 2021-11-07 14:56:03,594 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:56:06 wikitech-static check_icinga[24324]: 2021-11-07 14:56:06,479 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 14:56:06 wikitech-static check_icinga[24323]: 2021-11-07 14:56:06,573 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:58:01 wikitech-static CRON[24399]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 14:58:01 wikitech-static CRON[24400]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 14:58:02 wikitech-static check_icinga[24401]: 2021-11-07 14:58:02,841 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 14:58:02 wikitech-static check_icinga[24402]: 2021-11-07 14:58:02,910 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 14:58:05 wikitech-static check_icinga[24401]: 2021-11-07 14:58:05,801 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 14:58:06 wikitech-static check_icinga[24402]: 2021-11-07 14:58:06,110 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:00:01 wikitech-static CRON[24485]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:00:01 wikitech-static CRON[24486]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:00:02 wikitech-static check_icinga[24488]: 2021-11-07 15:00:02,237 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:00:02 wikitech-static check_icinga[24487]: 2021-11-07 15:00:02,262 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:00:05 wikitech-static check_icinga[24487]: 2021-11-07 15:00:05,323 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:00:05 wikitech-static check_icinga[24488]: 2021-11-07 15:00:05,559 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:02:01 wikitech-static CRON[24560]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:02:01 wikitech-static CRON[24561]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:02:02 wikitech-static check_icinga[24563]: 2021-11-07 15:02:02,703 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:02:02 wikitech-static check_icinga[24562]: 2021-11-07 15:02:02,705 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:02:05 wikitech-static check_icinga[24562]: 2021-11-07 15:02:05,660 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:02:05 wikitech-static check_icinga[24563]: 2021-11-07 15:02:05,936 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:04:01 wikitech-static CRON[24635]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:04:01 wikitech-static CRON[24636]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:04:01 wikitech-static systemd[1]: Starting Daily apt download activities... Nov 7 15:04:02 wikitech-static check_icinga[24637]: 2021-11-07 15:04:02,148 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:04:02 wikitech-static check_icinga[24638]: 2021-11-07 15:04:02,165 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:04:03 wikitech-static systemd[1]: Started Daily apt download activities. Nov 7 15:04:03 wikitech-static systemd[1]: apt-daily.timer: Adding 5h 11min 43.897564s random time. Nov 7 15:04:03 wikitech-static systemd[1]: apt-daily.timer: Adding 7min 14.847413s random time. Nov 7 15:04:05 wikitech-static check_icinga[24637]: 2021-11-07 15:04:05,120 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:04:05 wikitech-static check_icinga[24638]: 2021-11-07 15:04:05,254 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:06:01 wikitech-static CRON[24756]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:06:01 wikitech-static CRON[24757]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:06:03 wikitech-static check_icinga[24758]: 2021-11-07 15:06:03,756 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:06:03 wikitech-static check_icinga[24759]: 2021-11-07 15:06:03,824 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:06:06 wikitech-static check_icinga[24758]: 2021-11-07 15:06:06,761 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:06:06 wikitech-static check_icinga[24759]: 2021-11-07 15:06:06,845 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:08:01 wikitech-static CRON[24831]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:08:01 wikitech-static CRON[24832]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:08:02 wikitech-static check_icinga[24833]: 2021-11-07 15:08:02,998 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:08:03 wikitech-static check_icinga[24834]: 2021-11-07 15:08:03,001 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:08:06 wikitech-static check_icinga[24833]: 2021-11-07 15:08:06,171 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:08:06 wikitech-static check_icinga[24834]: 2021-11-07 15:08:06,224 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:09:01 wikitech-static CRON[24878]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 15:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 15:09:11 wikitech-static systemd[1]: Started Clean php session files. Nov 7 15:10:01 wikitech-static CRON[25000]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:10:01 wikitech-static CRON[25001]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:10:03 wikitech-static check_icinga[25002]: 2021-11-07 15:10:03,268 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:10:03 wikitech-static check_icinga[25003]: 2021-11-07 15:10:03,336 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:10:06 wikitech-static check_icinga[25002]: 2021-11-07 15:10:06,164 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:10:06 wikitech-static check_icinga[25003]: 2021-11-07 15:10:06,351 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:12:01 wikitech-static CRON[25089]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:12:01 wikitech-static CRON[25090]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:12:02 wikitech-static check_icinga[25091]: 2021-11-07 15:12:02,887 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:12:02 wikitech-static check_icinga[25092]: 2021-11-07 15:12:02,888 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:12:05 wikitech-static check_icinga[25091]: 2021-11-07 15:12:05,893 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:12:06 wikitech-static check_icinga[25092]: 2021-11-07 15:12:06,249 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:14:01 wikitech-static CRON[25162]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:14:01 wikitech-static CRON[25163]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:14:02 wikitech-static check_icinga[25165]: 2021-11-07 15:14:02,446 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:14:02 wikitech-static check_icinga[25164]: 2021-11-07 15:14:02,475 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:14:05 wikitech-static check_icinga[25164]: 2021-11-07 15:14:05,498 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:14:05 wikitech-static check_icinga[25165]: 2021-11-07 15:14:05,551 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:16:01 wikitech-static CRON[25237]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:16:01 wikitech-static CRON[25238]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:16:02 wikitech-static check_icinga[25240]: 2021-11-07 15:16:02,769 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:16:02 wikitech-static check_icinga[25239]: 2021-11-07 15:16:02,773 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:16:05 wikitech-static check_icinga[25240]: 2021-11-07 15:16:05,828 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:16:05 wikitech-static check_icinga[25239]: 2021-11-07 15:16:05,885 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:17:02 wikitech-static CRON[25284]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 15:18:01 wikitech-static CRON[25315]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:18:01 wikitech-static CRON[25316]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:18:02 wikitech-static check_icinga[25317]: 2021-11-07 15:18:02,341 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:18:02 wikitech-static check_icinga[25318]: 2021-11-07 15:18:02,371 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:18:05 wikitech-static check_icinga[25317]: 2021-11-07 15:18:05,308 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:18:05 wikitech-static check_icinga[25318]: 2021-11-07 15:18:05,656 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:20:01 wikitech-static CRON[25396]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:20:01 wikitech-static CRON[25397]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:20:02 wikitech-static check_icinga[25398]: 2021-11-07 15:20:02,893 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:20:02 wikitech-static check_icinga[25399]: 2021-11-07 15:20:02,909 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:20:05 wikitech-static check_icinga[25398]: 2021-11-07 15:20:05,789 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:20:05 wikitech-static check_icinga[25399]: 2021-11-07 15:20:05,915 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:22:01 wikitech-static CRON[25471]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:22:01 wikitech-static CRON[25472]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:22:03 wikitech-static check_icinga[25473]: 2021-11-07 15:22:03,016 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:22:03 wikitech-static check_icinga[25474]: 2021-11-07 15:22:03,113 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:22:06 wikitech-static check_icinga[25474]: 2021-11-07 15:22:06,124 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:22:06 wikitech-static check_icinga[25473]: 2021-11-07 15:22:06,171 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:24:01 wikitech-static CRON[25549]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:24:01 wikitech-static CRON[25551]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:24:02 wikitech-static check_icinga[25550]: 2021-11-07 15:24:02,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:24:02 wikitech-static check_icinga[25552]: 2021-11-07 15:24:02,388 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:24:05 wikitech-static check_icinga[25550]: 2021-11-07 15:24:05,306 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:24:05 wikitech-static check_icinga[25552]: 2021-11-07 15:24:05,467 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:26:01 wikitech-static CRON[25627]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:26:01 wikitech-static CRON[25628]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:26:02 wikitech-static check_icinga[25629]: 2021-11-07 15:26:02,605 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:26:02 wikitech-static check_icinga[25630]: 2021-11-07 15:26:02,633 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:26:05 wikitech-static check_icinga[25630]: 2021-11-07 15:26:05,723 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:26:05 wikitech-static check_icinga[25629]: 2021-11-07 15:26:05,762 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:28:01 wikitech-static CRON[25710]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:28:01 wikitech-static CRON[25712]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:28:03 wikitech-static check_icinga[25713]: 2021-11-07 15:28:03,110 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:28:03 wikitech-static check_icinga[25711]: 2021-11-07 15:28:03,166 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:28:06 wikitech-static check_icinga[25711]: 2021-11-07 15:28:06,011 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:28:06 wikitech-static check_icinga[25713]: 2021-11-07 15:28:06,236 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:30:01 wikitech-static CRON[25788]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:30:01 wikitech-static CRON[25789]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:30:02 wikitech-static check_icinga[25790]: 2021-11-07 15:30:02,498 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:30:02 wikitech-static check_icinga[25791]: 2021-11-07 15:30:02,505 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:30:05 wikitech-static check_icinga[25790]: 2021-11-07 15:30:05,474 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:30:05 wikitech-static check_icinga[25791]: 2021-11-07 15:30:05,630 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:32:01 wikitech-static CRON[25864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:32:01 wikitech-static CRON[25865]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:32:02 wikitech-static check_icinga[25867]: 2021-11-07 15:32:02,755 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:32:02 wikitech-static check_icinga[25866]: 2021-11-07 15:32:02,868 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:32:05 wikitech-static check_icinga[25866]: 2021-11-07 15:32:05,818 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:32:05 wikitech-static check_icinga[25867]: 2021-11-07 15:32:05,881 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:34:01 wikitech-static CRON[25947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:34:01 wikitech-static CRON[25948]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:34:03 wikitech-static check_icinga[25950]: 2021-11-07 15:34:03,037 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:34:03 wikitech-static check_icinga[25949]: 2021-11-07 15:34:03,061 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:34:04 wikitech-static check_icinga[25950]: 2021-11-07 15:34:04,401 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)'] Nov 7 15:34:06 wikitech-static check_icinga[25949]: 2021-11-07 15:34:06,157 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:34:14 wikitech-static check_icinga[25950]: 2021-11-07 15:34:14,413 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:34:17 wikitech-static check_icinga[25950]: 2021-11-07 15:34:17,400 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:36:01 wikitech-static CRON[26068]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:36:01 wikitech-static CRON[26069]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:36:02 wikitech-static check_icinga[26070]: 2021-11-07 15:36:02,495 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:36:02 wikitech-static check_icinga[26071]: 2021-11-07 15:36:02,520 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:36:05 wikitech-static check_icinga[26070]: 2021-11-07 15:36:05,150 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:36:05 wikitech-static check_icinga[26071]: 2021-11-07 15:36:05,532 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:38:01 wikitech-static CRON[26151]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:38:01 wikitech-static CRON[26152]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:38:02 wikitech-static check_icinga[26153]: 2021-11-07 15:38:02,674 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:38:02 wikitech-static check_icinga[26154]: 2021-11-07 15:38:02,677 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:38:05 wikitech-static check_icinga[26153]: 2021-11-07 15:38:05,458 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:38:05 wikitech-static check_icinga[26154]: 2021-11-07 15:38:05,921 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:39:01 wikitech-static CRON[26201]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 15:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 15:39:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 15:40:02 wikitech-static CRON[26331]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:40:02 wikitech-static CRON[26332]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:40:03 wikitech-static check_icinga[26333]: 2021-11-07 15:40:03,170 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:40:03 wikitech-static check_icinga[26334]: 2021-11-07 15:40:03,177 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:40:06 wikitech-static check_icinga[26333]: 2021-11-07 15:40:06,033 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:40:06 wikitech-static check_icinga[26334]: 2021-11-07 15:40:06,315 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:42:01 wikitech-static CRON[26476]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:42:01 wikitech-static CRON[26477]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:42:02 wikitech-static check_icinga[26479]: 2021-11-07 15:42:02,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:42:02 wikitech-static check_icinga[26478]: 2021-11-07 15:42:02,629 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:42:05 wikitech-static check_icinga[26478]: 2021-11-07 15:42:05,461 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:42:05 wikitech-static check_icinga[26479]: 2021-11-07 15:42:05,875 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:44:01 wikitech-static CRON[26557]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:44:01 wikitech-static CRON[26559]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:44:03 wikitech-static check_icinga[26558]: 2021-11-07 15:44:03,015 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:44:03 wikitech-static check_icinga[26560]: 2021-11-07 15:44:03,099 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:44:05 wikitech-static check_icinga[26558]: 2021-11-07 15:44:05,780 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:44:06 wikitech-static check_icinga[26560]: 2021-11-07 15:44:06,235 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:46:01 wikitech-static CRON[26645]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:46:01 wikitech-static CRON[26646]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:46:02 wikitech-static check_icinga[26648]: 2021-11-07 15:46:02,378 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:46:02 wikitech-static check_icinga[26647]: 2021-11-07 15:46:02,403 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:46:05 wikitech-static check_icinga[26648]: 2021-11-07 15:46:05,182 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:46:05 wikitech-static check_icinga[26647]: 2021-11-07 15:46:05,500 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:48:01 wikitech-static CRON[26723]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:48:01 wikitech-static CRON[26724]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:48:02 wikitech-static check_icinga[26726]: 2021-11-07 15:48:02,709 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:48:02 wikitech-static check_icinga[26725]: 2021-11-07 15:48:02,714 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:48:05 wikitech-static check_icinga[26726]: 2021-11-07 15:48:05,666 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:48:05 wikitech-static check_icinga[26725]: 2021-11-07 15:48:05,828 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:50:01 wikitech-static CRON[26799]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:50:01 wikitech-static CRON[26800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:50:02 wikitech-static check_icinga[26801]: 2021-11-07 15:50:02,946 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:50:02 wikitech-static check_icinga[26802]: 2021-11-07 15:50:02,972 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:50:06 wikitech-static check_icinga[26802]: 2021-11-07 15:50:06,133 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:50:06 wikitech-static check_icinga[26801]: 2021-11-07 15:50:06,146 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:52:01 wikitech-static CRON[26875]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:52:01 wikitech-static CRON[26876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:52:02 wikitech-static check_icinga[26878]: 2021-11-07 15:52:02,463 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:52:02 wikitech-static check_icinga[26877]: 2021-11-07 15:52:02,469 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:52:05 wikitech-static check_icinga[26877]: 2021-11-07 15:52:05,585 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:52:05 wikitech-static check_icinga[26878]: 2021-11-07 15:52:05,650 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:54:01 wikitech-static CRON[26953]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:54:01 wikitech-static CRON[26954]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:54:02 wikitech-static check_icinga[26956]: 2021-11-07 15:54:02,827 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:54:02 wikitech-static check_icinga[26955]: 2021-11-07 15:54:02,840 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:54:05 wikitech-static check_icinga[26955]: 2021-11-07 15:54:05,837 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:54:06 wikitech-static check_icinga[26956]: 2021-11-07 15:54:06,082 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:56:01 wikitech-static CRON[27037]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:56:01 wikitech-static CRON[27038]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:56:02 wikitech-static check_icinga[27039]: 2021-11-07 15:56:02,213 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:56:02 wikitech-static check_icinga[27040]: 2021-11-07 15:56:02,239 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:56:05 wikitech-static check_icinga[27039]: 2021-11-07 15:56:05,348 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:56:05 wikitech-static check_icinga[27040]: 2021-11-07 15:56:05,459 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 15:58:01 wikitech-static CRON[27114]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 15:58:01 wikitech-static CRON[27115]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 15:58:02 wikitech-static check_icinga[27117]: 2021-11-07 15:58:02,673 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 15:58:02 wikitech-static check_icinga[27116]: 2021-11-07 15:58:02,677 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 15:58:05 wikitech-static check_icinga[27117]: 2021-11-07 15:58:05,853 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 15:58:05 wikitech-static check_icinga[27116]: 2021-11-07 15:58:05,928 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:00:01 wikitech-static CRON[27189]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:00:01 wikitech-static CRON[27191]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:00:02 wikitech-static check_icinga[27190]: 2021-11-07 16:00:02,043 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:00:02 wikitech-static check_icinga[27192]: 2021-11-07 16:00:02,060 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:00:05 wikitech-static check_icinga[27190]: 2021-11-07 16:00:05,045 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:00:05 wikitech-static check_icinga[27192]: 2021-11-07 16:00:05,171 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:02:01 wikitech-static CRON[27265]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:02:01 wikitech-static CRON[27266]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:02:02 wikitech-static check_icinga[27267]: 2021-11-07 16:02:02,277 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:02:02 wikitech-static check_icinga[27268]: 2021-11-07 16:02:02,299 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:02:05 wikitech-static check_icinga[27268]: 2021-11-07 16:02:05,476 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:02:05 wikitech-static check_icinga[27267]: 2021-11-07 16:02:05,621 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:04:01 wikitech-static CRON[27343]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:04:01 wikitech-static CRON[27344]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:04:02 wikitech-static check_icinga[27345]: 2021-11-07 16:04:02,767 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:04:02 wikitech-static check_icinga[27346]: 2021-11-07 16:04:02,775 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:04:05 wikitech-static check_icinga[27345]: 2021-11-07 16:04:05,950 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:04:06 wikitech-static check_icinga[27346]: 2021-11-07 16:04:06,066 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:06:01 wikitech-static CRON[27421]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:06:01 wikitech-static CRON[27422]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:06:02 wikitech-static check_icinga[27424]: 2021-11-07 16:06:02,245 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:06:02 wikitech-static check_icinga[27423]: 2021-11-07 16:06:02,243 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:06:05 wikitech-static check_icinga[27424]: 2021-11-07 16:06:05,437 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:06:05 wikitech-static check_icinga[27423]: 2021-11-07 16:06:05,513 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:08:01 wikitech-static CRON[27502]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:08:01 wikitech-static CRON[27503]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:08:02 wikitech-static check_icinga[27505]: 2021-11-07 16:08:02,678 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:08:02 wikitech-static check_icinga[27504]: 2021-11-07 16:08:02,681 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:08:05 wikitech-static check_icinga[27505]: 2021-11-07 16:08:05,777 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:08:06 wikitech-static check_icinga[27504]: 2021-11-07 16:08:06,118 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:09:00 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 16:09:00 wikitech-static systemd[1]: Started Clean php session files. Nov 7 16:09:01 wikitech-static CRON[27655]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 16:10:01 wikitech-static CRON[27687]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:10:01 wikitech-static CRON[27688]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:10:02 wikitech-static check_icinga[27689]: 2021-11-07 16:10:02,286 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:10:02 wikitech-static check_icinga[27690]: 2021-11-07 16:10:02,363 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:10:05 wikitech-static check_icinga[27689]: 2021-11-07 16:10:05,724 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:10:05 wikitech-static check_icinga[27690]: 2021-11-07 16:10:05,776 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:11:01 wikitech-static CRON[27736]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 16:11:02 wikitech-static check_icinga_validate_config[27737]: Valid config, nothing to do. Nov 7 16:12:01 wikitech-static CRON[27772]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:12:01 wikitech-static CRON[27773]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:12:02 wikitech-static check_icinga[27774]: 2021-11-07 16:12:02,778 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:12:02 wikitech-static check_icinga[27775]: 2021-11-07 16:12:02,807 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:12:06 wikitech-static check_icinga[27774]: 2021-11-07 16:12:06,081 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:12:06 wikitech-static check_icinga[27775]: 2021-11-07 16:12:06,118 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:14:01 wikitech-static CRON[27855]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:14:01 wikitech-static CRON[27856]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:14:02 wikitech-static check_icinga[27857]: 2021-11-07 16:14:02,282 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:14:02 wikitech-static check_icinga[27858]: 2021-11-07 16:14:02,308 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:14:05 wikitech-static check_icinga[27857]: 2021-11-07 16:14:05,505 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:14:05 wikitech-static check_icinga[27858]: 2021-11-07 16:14:05,548 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:16:01 wikitech-static CRON[27940]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:16:01 wikitech-static CRON[27942]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:16:02 wikitech-static check_icinga[27941]: 2021-11-07 16:16:02,818 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:16:02 wikitech-static check_icinga[27943]: 2021-11-07 16:16:02,870 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:16:06 wikitech-static check_icinga[27941]: 2021-11-07 16:16:06,146 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:16:06 wikitech-static check_icinga[27943]: 2021-11-07 16:16:06,442 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:17:01 wikitech-static CRON[27993]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 16:18:01 wikitech-static CRON[28029]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:18:01 wikitech-static CRON[28031]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:18:02 wikitech-static check_icinga[28030]: 2021-11-07 16:18:02,569 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:18:02 wikitech-static check_icinga[28032]: 2021-11-07 16:18:02,588 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:18:05 wikitech-static check_icinga[28032]: 2021-11-07 16:18:05,996 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:18:06 wikitech-static check_icinga[28030]: 2021-11-07 16:18:06,098 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:20:01 wikitech-static CRON[28105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:20:01 wikitech-static CRON[28106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:20:02 wikitech-static check_icinga[28107]: 2021-11-07 16:20:02,242 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:20:02 wikitech-static check_icinga[28108]: 2021-11-07 16:20:02,246 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:20:05 wikitech-static check_icinga[28107]: 2021-11-07 16:20:05,348 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:20:05 wikitech-static check_icinga[28108]: 2021-11-07 16:20:05,400 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:22:01 wikitech-static CRON[28183]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:22:01 wikitech-static CRON[28185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:22:02 wikitech-static check_icinga[28186]: 2021-11-07 16:22:02,585 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:22:02 wikitech-static check_icinga[28184]: 2021-11-07 16:22:02,615 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:22:05 wikitech-static check_icinga[28184]: 2021-11-07 16:22:05,764 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:22:05 wikitech-static check_icinga[28186]: 2021-11-07 16:22:05,826 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:24:01 wikitech-static CRON[28263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:24:01 wikitech-static CRON[28264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:24:02 wikitech-static check_icinga[28266]: 2021-11-07 16:24:02,981 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:24:02 wikitech-static check_icinga[28265]: 2021-11-07 16:24:02,986 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:24:06 wikitech-static check_icinga[28265]: 2021-11-07 16:24:06,189 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:24:06 wikitech-static check_icinga[28266]: 2021-11-07 16:24:06,312 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:26:01 wikitech-static CRON[28351]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:26:01 wikitech-static CRON[28352]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:26:02 wikitech-static check_icinga[28353]: 2021-11-07 16:26:02,466 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:26:02 wikitech-static check_icinga[28354]: 2021-11-07 16:26:02,473 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:26:05 wikitech-static check_icinga[28354]: 2021-11-07 16:26:05,598 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:26:05 wikitech-static check_icinga[28353]: 2021-11-07 16:26:05,756 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:28:01 wikitech-static CRON[28431]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:28:01 wikitech-static CRON[28432]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:28:02 wikitech-static check_icinga[28433]: 2021-11-07 16:28:02,886 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:28:02 wikitech-static check_icinga[28434]: 2021-11-07 16:28:02,893 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:28:06 wikitech-static check_icinga[28433]: 2021-11-07 16:28:06,101 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:28:06 wikitech-static check_icinga[28434]: 2021-11-07 16:28:06,109 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:30:01 wikitech-static CRON[28512]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:30:01 wikitech-static CRON[28513]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:30:02 wikitech-static check_icinga[28515]: 2021-11-07 16:30:02,329 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:30:02 wikitech-static check_icinga[28514]: 2021-11-07 16:30:02,327 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:30:05 wikitech-static check_icinga[28514]: 2021-11-07 16:30:05,516 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:30:05 wikitech-static check_icinga[28515]: 2021-11-07 16:30:05,556 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:32:01 wikitech-static CRON[28593]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:32:01 wikitech-static CRON[28594]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:32:02 wikitech-static check_icinga[28595]: 2021-11-07 16:32:02,868 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:32:02 wikitech-static check_icinga[28596]: 2021-11-07 16:32:02,872 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:32:05 wikitech-static check_icinga[28596]: 2021-11-07 16:32:05,893 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:32:06 wikitech-static check_icinga[28595]: 2021-11-07 16:32:06,179 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:34:01 wikitech-static CRON[28675]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:34:01 wikitech-static CRON[28676]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:34:02 wikitech-static check_icinga[28677]: 2021-11-07 16:34:02,309 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:34:02 wikitech-static check_icinga[28678]: 2021-11-07 16:34:02,313 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:34:03 wikitech-static check_icinga[28678]: 2021-11-07 16:34:03,683 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)'] Nov 7 16:34:05 wikitech-static check_icinga[28677]: 2021-11-07 16:34:05,636 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:34:13 wikitech-static check_icinga[28678]: 2021-11-07 16:34:13,696 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:34:16 wikitech-static check_icinga[28678]: 2021-11-07 16:34:16,625 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:36:01 wikitech-static CRON[28753]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:36:01 wikitech-static CRON[28754]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:36:02 wikitech-static check_icinga[28755]: 2021-11-07 16:36:02,798 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:36:02 wikitech-static check_icinga[28756]: 2021-11-07 16:36:02,843 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:36:05 wikitech-static check_icinga[28755]: 2021-11-07 16:36:05,472 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:36:06 wikitech-static check_icinga[28756]: 2021-11-07 16:36:06,168 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:38:01 wikitech-static CRON[28843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:38:01 wikitech-static CRON[28844]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:38:02 wikitech-static check_icinga[28845]: 2021-11-07 16:38:02,429 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:38:02 wikitech-static check_icinga[28846]: 2021-11-07 16:38:02,470 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:38:05 wikitech-static check_icinga[28845]: 2021-11-07 16:38:05,111 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:38:05 wikitech-static check_icinga[28846]: 2021-11-07 16:38:05,479 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:39:01 wikitech-static CRON[28890]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 16:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 16:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 16:40:01 wikitech-static CRON[29012]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:40:01 wikitech-static CRON[29013]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:40:02 wikitech-static check_icinga[29015]: 2021-11-07 16:40:02,624 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:40:02 wikitech-static check_icinga[29014]: 2021-11-07 16:40:02,638 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:40:05 wikitech-static check_icinga[29014]: 2021-11-07 16:40:05,388 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:40:05 wikitech-static check_icinga[29015]: 2021-11-07 16:40:05,834 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:42:01 wikitech-static CRON[29099]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:42:01 wikitech-static CRON[29100]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:42:02 wikitech-static check_icinga[29101]: 2021-11-07 16:42:02,938 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:42:02 wikitech-static check_icinga[29102]: 2021-11-07 16:42:02,964 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:42:05 wikitech-static check_icinga[29101]: 2021-11-07 16:42:05,808 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:42:06 wikitech-static check_icinga[29102]: 2021-11-07 16:42:06,061 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:44:01 wikitech-static CRON[29181]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:44:01 wikitech-static CRON[29182]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:44:02 wikitech-static check_icinga[29183]: 2021-11-07 16:44:02,221 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:44:02 wikitech-static check_icinga[29184]: 2021-11-07 16:44:02,289 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:44:05 wikitech-static check_icinga[29183]: 2021-11-07 16:44:05,046 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:44:05 wikitech-static check_icinga[29184]: 2021-11-07 16:44:05,659 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:46:01 wikitech-static CRON[29264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:46:01 wikitech-static CRON[29265]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:46:02 wikitech-static check_icinga[29266]: 2021-11-07 16:46:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:46:02 wikitech-static check_icinga[29267]: 2021-11-07 16:46:02,807 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:46:05 wikitech-static check_icinga[29266]: 2021-11-07 16:46:05,647 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:46:05 wikitech-static check_icinga[29267]: 2021-11-07 16:46:05,966 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:48:01 wikitech-static CRON[29342]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:48:01 wikitech-static CRON[29343]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:48:02 wikitech-static check_icinga[29345]: 2021-11-07 16:48:02,227 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:48:02 wikitech-static check_icinga[29344]: 2021-11-07 16:48:02,253 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:48:05 wikitech-static check_icinga[29344]: 2021-11-07 16:48:05,237 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:48:05 wikitech-static check_icinga[29345]: 2021-11-07 16:48:05,579 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:50:01 wikitech-static CRON[29420]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:50:01 wikitech-static CRON[29421]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:50:02 wikitech-static check_icinga[29422]: 2021-11-07 16:50:02,714 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:50:02 wikitech-static check_icinga[29423]: 2021-11-07 16:50:02,784 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:50:05 wikitech-static check_icinga[29422]: 2021-11-07 16:50:05,826 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:50:06 wikitech-static check_icinga[29423]: 2021-11-07 16:50:06,169 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:52:01 wikitech-static CRON[29500]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:52:01 wikitech-static CRON[29501]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:52:02 wikitech-static check_icinga[29502]: 2021-11-07 16:52:02,289 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:52:02 wikitech-static check_icinga[29503]: 2021-11-07 16:52:02,345 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:52:05 wikitech-static check_icinga[29502]: 2021-11-07 16:52:05,299 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:52:05 wikitech-static check_icinga[29503]: 2021-11-07 16:52:05,338 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:54:01 wikitech-static CRON[29579]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:54:01 wikitech-static CRON[29580]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:54:02 wikitech-static check_icinga[29581]: 2021-11-07 16:54:02,550 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:54:02 wikitech-static check_icinga[29582]: 2021-11-07 16:54:02,553 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:54:05 wikitech-static check_icinga[29582]: 2021-11-07 16:54:05,518 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:54:05 wikitech-static check_icinga[29581]: 2021-11-07 16:54:05,687 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:56:01 wikitech-static CRON[29721]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:56:01 wikitech-static CRON[29722]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:56:02 wikitech-static check_icinga[29724]: 2021-11-07 16:56:02,848 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:56:02 wikitech-static check_icinga[29723]: 2021-11-07 16:56:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:56:06 wikitech-static check_icinga[29723]: 2021-11-07 16:56:06,076 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 16:56:06 wikitech-static check_icinga[29724]: 2021-11-07 16:56:06,112 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:58:01 wikitech-static CRON[29804]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 16:58:01 wikitech-static CRON[29806]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 16:58:02 wikitech-static check_icinga[29805]: 2021-11-07 16:58:02,338 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 16:58:02 wikitech-static check_icinga[29807]: 2021-11-07 16:58:02,350 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 16:58:05 wikitech-static check_icinga[29805]: 2021-11-07 16:58:05,383 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 16:58:05 wikitech-static check_icinga[29807]: 2021-11-07 16:58:05,537 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:00:01 wikitech-static CRON[29889]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:00:01 wikitech-static CRON[29890]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:00:02 wikitech-static check_icinga[29891]: 2021-11-07 17:00:02,710 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:00:02 wikitech-static check_icinga[29892]: 2021-11-07 17:00:02,735 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:00:05 wikitech-static check_icinga[29891]: 2021-11-07 17:00:05,743 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:00:05 wikitech-static check_icinga[29892]: 2021-11-07 17:00:05,753 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:02:01 wikitech-static CRON[29970]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:02:01 wikitech-static CRON[29971]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:02:02 wikitech-static check_icinga[29972]: 2021-11-07 17:02:02,981 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:02:03 wikitech-static check_icinga[29973]: 2021-11-07 17:02:03,053 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:02:05 wikitech-static check_icinga[29973]: 2021-11-07 17:02:05,922 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:02:06 wikitech-static check_icinga[29972]: 2021-11-07 17:02:06,138 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:04:01 wikitech-static CRON[30045]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:04:01 wikitech-static CRON[30046]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:04:02 wikitech-static check_icinga[30048]: 2021-11-07 17:04:02,292 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:04:02 wikitech-static check_icinga[30047]: 2021-11-07 17:04:02,297 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:04:05 wikitech-static check_icinga[30047]: 2021-11-07 17:04:05,368 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:04:05 wikitech-static check_icinga[30048]: 2021-11-07 17:04:05,423 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:06:01 wikitech-static CRON[30120]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:06:01 wikitech-static CRON[30121]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:06:02 wikitech-static check_icinga[30123]: 2021-11-07 17:06:02,589 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:06:02 wikitech-static check_icinga[30122]: 2021-11-07 17:06:02,614 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:06:05 wikitech-static check_icinga[30123]: 2021-11-07 17:06:05,666 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:06:05 wikitech-static check_icinga[30122]: 2021-11-07 17:06:05,802 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:08:01 wikitech-static CRON[30200]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:08:01 wikitech-static CRON[30201]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:08:02 wikitech-static check_icinga[30202]: 2021-11-07 17:08:02,945 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:08:02 wikitech-static check_icinga[30203]: 2021-11-07 17:08:02,953 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:08:06 wikitech-static check_icinga[30202]: 2021-11-07 17:08:06,059 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:08:06 wikitech-static check_icinga[30203]: 2021-11-07 17:08:06,196 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:09:01 wikitech-static CRON[30252]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 17:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 17:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 17:10:01 wikitech-static CRON[30374]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:10:01 wikitech-static CRON[30375]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:10:02 wikitech-static check_icinga[30376]: 2021-11-07 17:10:02,357 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:10:02 wikitech-static check_icinga[30377]: 2021-11-07 17:10:02,392 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:10:05 wikitech-static check_icinga[30377]: 2021-11-07 17:10:05,305 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:10:05 wikitech-static check_icinga[30376]: 2021-11-07 17:10:05,732 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:12:01 wikitech-static CRON[30452]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:12:01 wikitech-static CRON[30453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:12:02 wikitech-static check_icinga[30454]: 2021-11-07 17:12:02,861 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:12:02 wikitech-static check_icinga[30455]: 2021-11-07 17:12:02,865 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:12:06 wikitech-static check_icinga[30454]: 2021-11-07 17:12:06,002 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:12:06 wikitech-static check_icinga[30455]: 2021-11-07 17:12:06,092 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:14:01 wikitech-static CRON[30530]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:14:01 wikitech-static CRON[30531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:14:02 wikitech-static check_icinga[30532]: 2021-11-07 17:14:02,213 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:14:02 wikitech-static check_icinga[30533]: 2021-11-07 17:14:02,221 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:14:05 wikitech-static check_icinga[30532]: 2021-11-07 17:14:05,444 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:14:05 wikitech-static check_icinga[30533]: 2021-11-07 17:14:05,453 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:16:01 wikitech-static CRON[30614]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:16:01 wikitech-static CRON[30615]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:16:02 wikitech-static check_icinga[30616]: 2021-11-07 17:16:02,660 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:16:02 wikitech-static check_icinga[30617]: 2021-11-07 17:16:02,663 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:16:05 wikitech-static check_icinga[30616]: 2021-11-07 17:16:05,766 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:16:05 wikitech-static check_icinga[30617]: 2021-11-07 17:16:05,846 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:17:01 wikitech-static CRON[30661]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 17:18:01 wikitech-static CRON[30692]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:18:01 wikitech-static CRON[30693]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:18:03 wikitech-static check_icinga[30695]: 2021-11-07 17:18:03,002 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:18:03 wikitech-static check_icinga[30694]: 2021-11-07 17:18:03,005 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:18:06 wikitech-static check_icinga[30694]: 2021-11-07 17:18:06,147 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:18:06 wikitech-static check_icinga[30695]: 2021-11-07 17:18:06,286 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:20:01 wikitech-static CRON[30774]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:20:01 wikitech-static CRON[30775]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:20:02 wikitech-static check_icinga[30777]: 2021-11-07 17:20:02,411 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:20:02 wikitech-static check_icinga[30776]: 2021-11-07 17:20:02,505 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:20:05 wikitech-static check_icinga[30776]: 2021-11-07 17:20:05,545 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:20:05 wikitech-static check_icinga[30777]: 2021-11-07 17:20:05,767 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:22:01 wikitech-static CRON[30849]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:22:01 wikitech-static CRON[30850]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:22:03 wikitech-static check_icinga[30851]: 2021-11-07 17:22:03,019 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:22:03 wikitech-static check_icinga[30852]: 2021-11-07 17:22:03,021 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:22:05 wikitech-static check_icinga[30852]: 2021-11-07 17:22:05,975 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:22:06 wikitech-static check_icinga[30851]: 2021-11-07 17:22:06,304 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:24:01 wikitech-static CRON[30924]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:24:01 wikitech-static CRON[30925]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:24:02 wikitech-static check_icinga[30927]: 2021-11-07 17:24:02,481 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:24:02 wikitech-static check_icinga[30926]: 2021-11-07 17:24:02,482 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:24:05 wikitech-static check_icinga[30926]: 2021-11-07 17:24:05,653 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:24:05 wikitech-static check_icinga[30927]: 2021-11-07 17:24:05,798 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:26:01 wikitech-static CRON[30999]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:26:01 wikitech-static CRON[31000]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:26:02 wikitech-static check_icinga[31001]: 2021-11-07 17:26:02,946 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:26:02 wikitech-static check_icinga[31002]: 2021-11-07 17:26:02,970 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:26:06 wikitech-static check_icinga[31002]: 2021-11-07 17:26:06,096 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:26:06 wikitech-static check_icinga[31001]: 2021-11-07 17:26:06,151 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:28:01 wikitech-static CRON[31074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:28:01 wikitech-static CRON[31075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:28:02 wikitech-static check_icinga[31077]: 2021-11-07 17:28:02,371 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:28:02 wikitech-static check_icinga[31076]: 2021-11-07 17:28:02,379 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:28:05 wikitech-static check_icinga[31076]: 2021-11-07 17:28:05,486 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:28:05 wikitech-static check_icinga[31077]: 2021-11-07 17:28:05,671 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:30:01 wikitech-static CRON[31153]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:30:01 wikitech-static CRON[31154]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:30:02 wikitech-static check_icinga[31155]: 2021-11-07 17:30:02,839 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:30:02 wikitech-static check_icinga[31156]: 2021-11-07 17:30:02,842 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:30:06 wikitech-static check_icinga[31156]: 2021-11-07 17:30:06,164 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:30:06 wikitech-static check_icinga[31155]: 2021-11-07 17:30:06,239 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:32:01 wikitech-static CRON[31236]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:32:01 wikitech-static CRON[31237]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:32:02 wikitech-static check_icinga[31238]: 2021-11-07 17:32:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:32:02 wikitech-static check_icinga[31239]: 2021-11-07 17:32:02,392 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:32:05 wikitech-static check_icinga[31239]: 2021-11-07 17:32:05,401 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:32:05 wikitech-static check_icinga[31238]: 2021-11-07 17:32:05,542 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:33:48 wikitech-static systemd[1]: Starting Certbot... Nov 7 17:33:50 wikitech-static systemd[1]: Started Certbot. Nov 7 17:33:50 wikitech-static systemd[1]: certbot.timer: Adding 5h 46min 4.960389s random time. Nov 7 17:33:50 wikitech-static systemd[1]: certbot.timer: Adding 1h 24min 57.362530s random time. Nov 7 17:34:01 wikitech-static CRON[31321]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:34:01 wikitech-static CRON[31322]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:34:02 wikitech-static check_icinga[31323]: 2021-11-07 17:34:02,649 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:34:02 wikitech-static check_icinga[31324]: 2021-11-07 17:34:02,708 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:34:04 wikitech-static check_icinga[31323]: 2021-11-07 17:34:04,051 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)'] Nov 7 17:34:05 wikitech-static check_icinga[31324]: 2021-11-07 17:34:05,918 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:34:14 wikitech-static check_icinga[31323]: 2021-11-07 17:34:14,057 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:34:16 wikitech-static check_icinga[31323]: 2021-11-07 17:34:16,830 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:36:01 wikitech-static CRON[31409]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:36:01 wikitech-static CRON[31410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:36:03 wikitech-static check_icinga[31411]: 2021-11-07 17:36:03,026 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:36:03 wikitech-static check_icinga[31412]: 2021-11-07 17:36:03,029 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:36:05 wikitech-static check_icinga[31411]: 2021-11-07 17:36:05,838 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:36:06 wikitech-static check_icinga[31412]: 2021-11-07 17:36:06,258 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:38:01 wikitech-static CRON[31490]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:38:01 wikitech-static CRON[31491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:38:02 wikitech-static check_icinga[31493]: 2021-11-07 17:38:02,414 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:38:02 wikitech-static check_icinga[31492]: 2021-11-07 17:38:02,439 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:38:05 wikitech-static check_icinga[31492]: 2021-11-07 17:38:05,232 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:38:05 wikitech-static check_icinga[31493]: 2021-11-07 17:38:05,798 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:39:01 wikitech-static CRON[31540]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 17:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 17:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 17:40:01 wikitech-static CRON[31689]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:40:01 wikitech-static CRON[31690]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:40:02 wikitech-static check_icinga[31692]: 2021-11-07 17:40:02,929 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:40:02 wikitech-static check_icinga[31691]: 2021-11-07 17:40:02,955 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:40:05 wikitech-static check_icinga[31691]: 2021-11-07 17:40:05,729 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:40:06 wikitech-static check_icinga[31692]: 2021-11-07 17:40:06,145 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:42:01 wikitech-static CRON[31767]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:42:01 wikitech-static CRON[31768]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:42:02 wikitech-static check_icinga[31769]: 2021-11-07 17:42:02,314 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:42:02 wikitech-static check_icinga[31770]: 2021-11-07 17:42:02,319 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:42:05 wikitech-static check_icinga[31770]: 2021-11-07 17:42:05,093 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:42:05 wikitech-static check_icinga[31769]: 2021-11-07 17:42:05,733 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:44:01 wikitech-static CRON[31846]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:44:01 wikitech-static CRON[31847]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:44:02 wikitech-static check_icinga[31849]: 2021-11-07 17:44:02,943 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:44:02 wikitech-static check_icinga[31848]: 2021-11-07 17:44:02,974 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:44:05 wikitech-static check_icinga[31849]: 2021-11-07 17:44:05,832 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:44:06 wikitech-static check_icinga[31848]: 2021-11-07 17:44:06,080 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:46:01 wikitech-static CRON[31923]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:46:01 wikitech-static CRON[31924]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:46:02 wikitech-static check_icinga[31926]: 2021-11-07 17:46:02,274 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:46:02 wikitech-static check_icinga[31925]: 2021-11-07 17:46:02,344 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:46:05 wikitech-static check_icinga[31925]: 2021-11-07 17:46:05,417 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:46:05 wikitech-static check_icinga[31926]: 2021-11-07 17:46:05,578 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:48:01 wikitech-static CRON[31998]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:48:01 wikitech-static CRON[31999]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:48:02 wikitech-static check_icinga[32000]: 2021-11-07 17:48:02,776 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:48:02 wikitech-static check_icinga[32001]: 2021-11-07 17:48:02,804 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:48:05 wikitech-static check_icinga[32000]: 2021-11-07 17:48:05,770 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:48:06 wikitech-static check_icinga[32001]: 2021-11-07 17:48:06,073 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:50:01 wikitech-static CRON[32073]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:50:01 wikitech-static CRON[32074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:50:02 wikitech-static check_icinga[32076]: 2021-11-07 17:50:02,282 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:50:02 wikitech-static check_icinga[32075]: 2021-11-07 17:50:02,303 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:50:05 wikitech-static check_icinga[32076]: 2021-11-07 17:50:05,373 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:50:05 wikitech-static check_icinga[32075]: 2021-11-07 17:50:05,640 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:52:01 wikitech-static CRON[32148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:52:01 wikitech-static CRON[32149]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:52:02 wikitech-static check_icinga[32151]: 2021-11-07 17:52:02,765 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:52:02 wikitech-static check_icinga[32150]: 2021-11-07 17:52:02,789 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:52:05 wikitech-static check_icinga[32150]: 2021-11-07 17:52:05,779 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:52:05 wikitech-static check_icinga[32151]: 2021-11-07 17:52:05,923 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:54:01 wikitech-static CRON[32228]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:54:01 wikitech-static CRON[32229]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:54:02 wikitech-static check_icinga[32230]: 2021-11-07 17:54:02,115 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:54:02 wikitech-static check_icinga[32231]: 2021-11-07 17:54:02,121 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:54:05 wikitech-static check_icinga[32230]: 2021-11-07 17:54:05,156 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:54:05 wikitech-static check_icinga[32231]: 2021-11-07 17:54:05,260 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:56:01 wikitech-static CRON[32315]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:56:01 wikitech-static CRON[32316]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:56:02 wikitech-static check_icinga[32318]: 2021-11-07 17:56:02,402 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:56:02 wikitech-static check_icinga[32317]: 2021-11-07 17:56:02,478 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:56:05 wikitech-static check_icinga[32317]: 2021-11-07 17:56:05,532 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:56:05 wikitech-static check_icinga[32318]: 2021-11-07 17:56:05,666 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 17:58:01 wikitech-static CRON[32417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 17:58:01 wikitech-static CRON[32418]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 17:58:02 wikitech-static check_icinga[32419]: 2021-11-07 17:58:02,841 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 17:58:02 wikitech-static check_icinga[32420]: 2021-11-07 17:58:02,844 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 17:58:05 wikitech-static check_icinga[32419]: 2021-11-07 17:58:05,848 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 17:58:05 wikitech-static check_icinga[32420]: 2021-11-07 17:58:05,957 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:00:01 wikitech-static CRON[32494]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:00:01 wikitech-static CRON[32495]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:00:02 wikitech-static check_icinga[32497]: 2021-11-07 18:00:02,213 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:00:02 wikitech-static check_icinga[32496]: 2021-11-07 18:00:02,234 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:00:05 wikitech-static check_icinga[32497]: 2021-11-07 18:00:05,290 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:00:05 wikitech-static check_icinga[32496]: 2021-11-07 18:00:05,342 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:02:01 wikitech-static CRON[32597]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:02:01 wikitech-static CRON[32598]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:02:02 wikitech-static check_icinga[32599]: 2021-11-07 18:02:02,583 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:02:02 wikitech-static check_icinga[32600]: 2021-11-07 18:02:02,609 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:02:05 wikitech-static check_icinga[32599]: 2021-11-07 18:02:05,592 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:02:05 wikitech-static check_icinga[32600]: 2021-11-07 18:02:05,755 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:04:01 wikitech-static CRON[32677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:04:01 wikitech-static CRON[32678]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:04:02 wikitech-static check_icinga[32680]: 2021-11-07 18:04:02,985 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:04:02 wikitech-static check_icinga[32679]: 2021-11-07 18:04:02,983 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:04:05 wikitech-static check_icinga[32679]: 2021-11-07 18:04:05,941 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:04:06 wikitech-static check_icinga[32680]: 2021-11-07 18:04:06,186 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:06:01 wikitech-static CRON[32759]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:06:01 wikitech-static CRON[32760]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:06:02 wikitech-static check_icinga[32762]: 2021-11-07 18:06:02,320 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:06:02 wikitech-static check_icinga[32761]: 2021-11-07 18:06:02,327 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:06:05 wikitech-static check_icinga[32762]: 2021-11-07 18:06:05,581 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:06:05 wikitech-static check_icinga[32761]: 2021-11-07 18:06:05,597 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:08:01 wikitech-static CRON[371]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:08:01 wikitech-static CRON[372]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:08:01 wikitech-static systemd[1]: Starting Daily apt download activities... Nov 7 18:08:03 wikitech-static check_icinga[373]: 2021-11-07 18:08:03,163 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:08:03 wikitech-static check_icinga[374]: 2021-11-07 18:08:03,165 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:08:03 wikitech-static systemd[1]: Started Daily apt download activities. Nov 7 18:08:03 wikitech-static systemd[1]: apt-daily.timer: Adding 6h 40min 9.976147s random time. Nov 7 18:08:03 wikitech-static systemd[1]: apt-daily.timer: Adding 1h 54min 27.588303s random time. Nov 7 18:08:06 wikitech-static check_icinga[373]: 2021-11-07 18:08:06,287 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:08:06 wikitech-static check_icinga[374]: 2021-11-07 18:08:06,345 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:09:01 wikitech-static CRON[465]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 18:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 18:09:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 18:10:01 wikitech-static CRON[589]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:10:01 wikitech-static CRON[590]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:10:02 wikitech-static check_icinga[591]: 2021-11-07 18:10:02,930 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:10:02 wikitech-static check_icinga[592]: 2021-11-07 18:10:02,933 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:10:06 wikitech-static check_icinga[592]: 2021-11-07 18:10:06,119 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:10:06 wikitech-static check_icinga[591]: 2021-11-07 18:10:06,237 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:11:01 wikitech-static CRON[646]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 18:11:02 wikitech-static check_icinga_validate_config[647]: Valid config, nothing to do. Nov 7 18:12:01 wikitech-static CRON[730]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:12:01 wikitech-static CRON[732]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:12:02 wikitech-static check_icinga[731]: 2021-11-07 18:12:02,081 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:12:02 wikitech-static check_icinga[733]: 2021-11-07 18:12:02,141 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:12:05 wikitech-static check_icinga[733]: 2021-11-07 18:12:05,268 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:12:05 wikitech-static check_icinga[731]: 2021-11-07 18:12:05,341 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:14:01 wikitech-static CRON[819]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:14:01 wikitech-static CRON[821]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:14:02 wikitech-static check_icinga[820]: 2021-11-07 18:14:02,509 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:14:02 wikitech-static check_icinga[822]: 2021-11-07 18:14:02,552 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:14:05 wikitech-static check_icinga[820]: 2021-11-07 18:14:05,510 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:14:05 wikitech-static check_icinga[822]: 2021-11-07 18:14:05,714 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:16:01 wikitech-static CRON[897]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:16:01 wikitech-static CRON[898]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:16:02 wikitech-static check_icinga[900]: 2021-11-07 18:16:02,873 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:16:02 wikitech-static check_icinga[899]: 2021-11-07 18:16:02,875 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:16:06 wikitech-static check_icinga[899]: 2021-11-07 18:16:06,084 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:16:06 wikitech-static check_icinga[900]: 2021-11-07 18:16:06,166 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:17:01 wikitech-static CRON[946]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 18:18:01 wikitech-static CRON[1009]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:18:01 wikitech-static CRON[1010]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:18:02 wikitech-static check_icinga[1011]: 2021-11-07 18:18:02,351 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:18:02 wikitech-static check_icinga[1012]: 2021-11-07 18:18:02,356 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:18:05 wikitech-static check_icinga[1011]: 2021-11-07 18:18:05,434 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:18:05 wikitech-static check_icinga[1012]: 2021-11-07 18:18:05,732 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:20:01 wikitech-static CRON[1104]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:20:01 wikitech-static CRON[1105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:20:02 wikitech-static check_icinga[1107]: 2021-11-07 18:20:02,887 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:20:02 wikitech-static check_icinga[1106]: 2021-11-07 18:20:02,888 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:20:05 wikitech-static check_icinga[1106]: 2021-11-07 18:20:05,866 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:20:06 wikitech-static check_icinga[1107]: 2021-11-07 18:20:06,135 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:22:01 wikitech-static CRON[1199]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:22:01 wikitech-static CRON[1200]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:22:02 wikitech-static check_icinga[1202]: 2021-11-07 18:22:02,286 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:22:02 wikitech-static check_icinga[1201]: 2021-11-07 18:22:02,353 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:22:05 wikitech-static check_icinga[1201]: 2021-11-07 18:22:05,361 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:22:05 wikitech-static check_icinga[1202]: 2021-11-07 18:22:05,599 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:24:01 wikitech-static CRON[1304]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:24:01 wikitech-static CRON[1305]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:24:02 wikitech-static check_icinga[1306]: 2021-11-07 18:24:02,873 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:24:02 wikitech-static check_icinga[1307]: 2021-11-07 18:24:02,967 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:24:05 wikitech-static check_icinga[1306]: 2021-11-07 18:24:05,915 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:24:06 wikitech-static check_icinga[1307]: 2021-11-07 18:24:06,304 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:26:01 wikitech-static CRON[1383]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:26:01 wikitech-static CRON[1384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:26:02 wikitech-static check_icinga[1385]: 2021-11-07 18:26:02,620 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:26:02 wikitech-static check_icinga[1386]: 2021-11-07 18:26:02,646 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:26:05 wikitech-static check_icinga[1385]: 2021-11-07 18:26:05,787 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:26:05 wikitech-static check_icinga[1386]: 2021-11-07 18:26:05,912 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:28:01 wikitech-static CRON[1473]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:28:01 wikitech-static CRON[1474]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:28:03 wikitech-static check_icinga[1475]: 2021-11-07 18:28:03,125 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:28:03 wikitech-static check_icinga[1476]: 2021-11-07 18:28:03,129 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:28:06 wikitech-static check_icinga[1476]: 2021-11-07 18:28:06,203 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:28:06 wikitech-static check_icinga[1475]: 2021-11-07 18:28:06,210 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:30:01 wikitech-static CRON[1625]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:30:01 wikitech-static CRON[1626]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:30:02 wikitech-static check_icinga[1628]: 2021-11-07 18:30:02,504 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:30:02 wikitech-static check_icinga[1627]: 2021-11-07 18:30:02,529 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:30:05 wikitech-static check_icinga[1628]: 2021-11-07 18:30:05,541 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:30:05 wikitech-static check_icinga[1627]: 2021-11-07 18:30:05,684 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:32:01 wikitech-static CRON[1704]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:32:01 wikitech-static CRON[1705]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:32:02 wikitech-static check_icinga[1707]: 2021-11-07 18:32:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:32:02 wikitech-static check_icinga[1706]: 2021-11-07 18:32:02,849 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:32:05 wikitech-static check_icinga[1707]: 2021-11-07 18:32:05,726 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:32:05 wikitech-static check_icinga[1706]: 2021-11-07 18:32:05,965 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:34:01 wikitech-static CRON[1786]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:34:01 wikitech-static CRON[1787]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:34:02 wikitech-static check_icinga[1789]: 2021-11-07 18:34:02,116 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:34:02 wikitech-static check_icinga[1788]: 2021-11-07 18:34:02,185 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:34:03 wikitech-static check_icinga[1788]: 2021-11-07 18:34:03,572 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)'] Nov 7 18:34:05 wikitech-static check_icinga[1789]: 2021-11-07 18:34:05,397 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:34:13 wikitech-static check_icinga[1788]: 2021-11-07 18:34:13,610 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:34:16 wikitech-static check_icinga[1788]: 2021-11-07 18:34:16,447 [ERROR] Check for host alert2001.wikimedia.org (2/3) failed: ["Last External Command Check: N/A (expected failed to calculate expected value: time data 'N/A' does not match format '%Y-%m-%d %H:%M:%S')"] Nov 7 18:34:26 wikitech-static check_icinga[1788]: 2021-11-07 18:34:26,460 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:34:29 wikitech-static check_icinga[1788]: 2021-11-07 18:34:29,185 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:36:01 wikitech-static CRON[1864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:36:01 wikitech-static CRON[1865]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:36:02 wikitech-static check_icinga[1866]: 2021-11-07 18:36:02,337 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:36:02 wikitech-static check_icinga[1867]: 2021-11-07 18:36:02,335 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:36:04 wikitech-static check_icinga[1867]: 2021-11-07 18:36:04,994 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:36:05 wikitech-static check_icinga[1866]: 2021-11-07 18:36:05,378 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:38:01 wikitech-static CRON[1943]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:38:01 wikitech-static CRON[1944]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:38:02 wikitech-static check_icinga[1946]: 2021-11-07 18:38:02,517 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:38:02 wikitech-static check_icinga[1945]: 2021-11-07 18:38:02,549 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:38:05 wikitech-static check_icinga[1945]: 2021-11-07 18:38:05,330 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:38:05 wikitech-static check_icinga[1946]: 2021-11-07 18:38:05,597 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:39:01 wikitech-static CRON[1990]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 18:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 18:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 18:40:01 wikitech-static CRON[2112]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:40:01 wikitech-static CRON[2113]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:40:02 wikitech-static check_icinga[2114]: 2021-11-07 18:40:02,771 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:40:02 wikitech-static check_icinga[2115]: 2021-11-07 18:40:02,792 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:40:05 wikitech-static check_icinga[2114]: 2021-11-07 18:40:05,695 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:40:05 wikitech-static check_icinga[2115]: 2021-11-07 18:40:05,972 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:42:01 wikitech-static CRON[2187]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:42:01 wikitech-static CRON[2189]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:42:02 wikitech-static check_icinga[2188]: 2021-11-07 18:42:02,229 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:42:02 wikitech-static check_icinga[2190]: 2021-11-07 18:42:02,233 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:42:05 wikitech-static check_icinga[2188]: 2021-11-07 18:42:05,068 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:42:05 wikitech-static check_icinga[2190]: 2021-11-07 18:42:05,492 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:44:01 wikitech-static CRON[2263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:44:01 wikitech-static CRON[2264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:44:02 wikitech-static check_icinga[2266]: 2021-11-07 18:44:02,667 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:44:02 wikitech-static check_icinga[2265]: 2021-11-07 18:44:02,696 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:44:05 wikitech-static check_icinga[2265]: 2021-11-07 18:44:05,551 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:44:05 wikitech-static check_icinga[2266]: 2021-11-07 18:44:05,929 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:46:02 wikitech-static CRON[2338]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:46:02 wikitech-static CRON[2339]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:46:03 wikitech-static check_icinga[2341]: 2021-11-07 18:46:03,036 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:46:03 wikitech-static check_icinga[2340]: 2021-11-07 18:46:03,061 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:46:06 wikitech-static check_icinga[2340]: 2021-11-07 18:46:06,026 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:46:06 wikitech-static check_icinga[2341]: 2021-11-07 18:46:06,152 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:48:01 wikitech-static CRON[2416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:48:01 wikitech-static CRON[2417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:48:02 wikitech-static check_icinga[2419]: 2021-11-07 18:48:02,285 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:48:02 wikitech-static check_icinga[2418]: 2021-11-07 18:48:02,292 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:48:05 wikitech-static check_icinga[2418]: 2021-11-07 18:48:05,408 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:48:05 wikitech-static check_icinga[2419]: 2021-11-07 18:48:05,573 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:50:01 wikitech-static CRON[2501]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:50:01 wikitech-static CRON[2502]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:50:02 wikitech-static check_icinga[2504]: 2021-11-07 18:50:02,728 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:50:02 wikitech-static check_icinga[2503]: 2021-11-07 18:50:02,730 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:50:05 wikitech-static check_icinga[2504]: 2021-11-07 18:50:05,874 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:50:05 wikitech-static check_icinga[2503]: 2021-11-07 18:50:05,961 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:52:01 wikitech-static CRON[2576]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:52:01 wikitech-static CRON[2577]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:52:02 wikitech-static check_icinga[2579]: 2021-11-07 18:52:02,179 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:52:02 wikitech-static check_icinga[2578]: 2021-11-07 18:52:02,202 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:52:05 wikitech-static check_icinga[2578]: 2021-11-07 18:52:05,341 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:52:05 wikitech-static check_icinga[2579]: 2021-11-07 18:52:05,571 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:54:01 wikitech-static CRON[2657]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:54:01 wikitech-static CRON[2658]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:54:02 wikitech-static check_icinga[2660]: 2021-11-07 18:54:02,769 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:54:02 wikitech-static check_icinga[2659]: 2021-11-07 18:54:02,790 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:54:05 wikitech-static check_icinga[2660]: 2021-11-07 18:54:05,863 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:54:06 wikitech-static check_icinga[2659]: 2021-11-07 18:54:06,044 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:56:01 wikitech-static CRON[2792]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:56:01 wikitech-static CRON[2793]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:56:02 wikitech-static check_icinga[2794]: 2021-11-07 18:56:02,294 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:56:02 wikitech-static check_icinga[2795]: 2021-11-07 18:56:02,298 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:56:05 wikitech-static check_icinga[2794]: 2021-11-07 18:56:05,484 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:56:05 wikitech-static check_icinga[2795]: 2021-11-07 18:56:05,676 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 18:58:01 wikitech-static CRON[2891]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 18:58:01 wikitech-static CRON[2892]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 18:58:02 wikitech-static check_icinga[2894]: 2021-11-07 18:58:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 18:58:02 wikitech-static check_icinga[2893]: 2021-11-07 18:58:02,858 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 18:58:05 wikitech-static check_icinga[2893]: 2021-11-07 18:58:05,897 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 18:58:06 wikitech-static check_icinga[2894]: 2021-11-07 18:58:06,218 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:00:01 wikitech-static CRON[2967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:00:01 wikitech-static CRON[2968]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:00:02 wikitech-static check_icinga[2970]: 2021-11-07 19:00:02,333 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:00:02 wikitech-static check_icinga[2969]: 2021-11-07 19:00:02,361 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:00:05 wikitech-static check_icinga[2969]: 2021-11-07 19:00:05,448 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:00:05 wikitech-static check_icinga[2970]: 2021-11-07 19:00:05,876 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:02:01 wikitech-static CRON[3042]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:02:01 wikitech-static CRON[3043]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:02:03 wikitech-static check_icinga[3045]: 2021-11-07 19:02:03,011 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:02:03 wikitech-static check_icinga[3044]: 2021-11-07 19:02:03,080 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:02:06 wikitech-static check_icinga[3044]: 2021-11-07 19:02:06,107 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:02:06 wikitech-static check_icinga[3045]: 2021-11-07 19:02:06,192 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:04:01 wikitech-static CRON[3117]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:04:01 wikitech-static CRON[3118]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:04:02 wikitech-static check_icinga[3119]: 2021-11-07 19:04:02,340 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:04:02 wikitech-static check_icinga[3120]: 2021-11-07 19:04:02,345 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:04:05 wikitech-static check_icinga[3120]: 2021-11-07 19:04:05,356 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:04:05 wikitech-static check_icinga[3119]: 2021-11-07 19:04:05,585 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:06:01 wikitech-static CRON[3192]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:06:01 wikitech-static CRON[3193]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:06:02 wikitech-static check_icinga[3194]: 2021-11-07 19:06:02,731 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:06:02 wikitech-static check_icinga[3195]: 2021-11-07 19:06:02,747 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:06:05 wikitech-static check_icinga[3195]: 2021-11-07 19:06:05,767 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:06:05 wikitech-static check_icinga[3194]: 2021-11-07 19:06:05,950 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:08:01 wikitech-static CRON[3267]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:08:01 wikitech-static CRON[3268]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:08:02 wikitech-static check_icinga[3269]: 2021-11-07 19:08:02,077 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:08:02 wikitech-static check_icinga[3270]: 2021-11-07 19:08:02,103 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:08:05 wikitech-static check_icinga[3270]: 2021-11-07 19:08:05,244 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:08:05 wikitech-static check_icinga[3269]: 2021-11-07 19:08:05,315 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:09:01 wikitech-static CRON[3340]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 19:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 19:09:07 wikitech-static systemd[1]: Started Clean php session files. Nov 7 19:10:01 wikitech-static CRON[3462]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:10:01 wikitech-static CRON[3463]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:10:02 wikitech-static check_icinga[3465]: 2021-11-07 19:10:02,747 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:10:02 wikitech-static check_icinga[3464]: 2021-11-07 19:10:02,750 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:10:06 wikitech-static check_icinga[3464]: 2021-11-07 19:10:06,043 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:10:06 wikitech-static check_icinga[3465]: 2021-11-07 19:10:06,136 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:12:01 wikitech-static CRON[3539]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:12:01 wikitech-static CRON[3540]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:12:02 wikitech-static check_icinga[3542]: 2021-11-07 19:12:02,394 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:12:02 wikitech-static check_icinga[3541]: 2021-11-07 19:12:02,433 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:12:05 wikitech-static check_icinga[3541]: 2021-11-07 19:12:05,588 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:12:05 wikitech-static check_icinga[3542]: 2021-11-07 19:12:05,733 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:14:01 wikitech-static CRON[3614]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:14:01 wikitech-static CRON[3615]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:14:02 wikitech-static check_icinga[3617]: 2021-11-07 19:14:02,856 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:14:02 wikitech-static check_icinga[3616]: 2021-11-07 19:14:02,863 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:14:05 wikitech-static check_icinga[3617]: 2021-11-07 19:14:05,962 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:14:05 wikitech-static check_icinga[3616]: 2021-11-07 19:14:05,992 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:16:01 wikitech-static CRON[3710]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:16:01 wikitech-static CRON[3711]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:16:02 wikitech-static check_icinga[3712]: 2021-11-07 19:16:02,206 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:16:02 wikitech-static check_icinga[3713]: 2021-11-07 19:16:02,231 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:16:05 wikitech-static check_icinga[3712]: 2021-11-07 19:16:05,258 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:16:05 wikitech-static check_icinga[3713]: 2021-11-07 19:16:05,530 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:17:01 wikitech-static CRON[3757]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 19:18:01 wikitech-static CRON[3788]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:18:01 wikitech-static CRON[3789]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:18:02 wikitech-static check_icinga[3790]: 2021-11-07 19:18:02,762 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:18:02 wikitech-static check_icinga[3791]: 2021-11-07 19:18:02,769 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:18:05 wikitech-static check_icinga[3790]: 2021-11-07 19:18:05,867 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:18:05 wikitech-static check_icinga[3791]: 2021-11-07 19:18:05,948 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:20:01 wikitech-static CRON[3863]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:20:01 wikitech-static CRON[3864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:20:02 wikitech-static check_icinga[3866]: 2021-11-07 19:20:02,087 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:20:02 wikitech-static check_icinga[3865]: 2021-11-07 19:20:02,090 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:20:05 wikitech-static check_icinga[3866]: 2021-11-07 19:20:05,221 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:20:05 wikitech-static check_icinga[3865]: 2021-11-07 19:20:05,311 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:22:01 wikitech-static CRON[3988]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:22:01 wikitech-static CRON[3989]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:22:02 wikitech-static check_icinga[3990]: 2021-11-07 19:22:02,510 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:22:02 wikitech-static check_icinga[3991]: 2021-11-07 19:22:02,522 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:22:05 wikitech-static check_icinga[3990]: 2021-11-07 19:22:05,752 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:22:05 wikitech-static check_icinga[3991]: 2021-11-07 19:22:05,790 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:24:01 wikitech-static CRON[4066]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:24:01 wikitech-static CRON[4067]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:24:02 wikitech-static check_icinga[4068]: 2021-11-07 19:24:02,961 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:24:02 wikitech-static check_icinga[4069]: 2021-11-07 19:24:02,964 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:24:06 wikitech-static check_icinga[4069]: 2021-11-07 19:24:06,233 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:24:06 wikitech-static check_icinga[4068]: 2021-11-07 19:24:06,240 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:26:01 wikitech-static CRON[4147]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:26:01 wikitech-static CRON[4148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:26:02 wikitech-static check_icinga[4150]: 2021-11-07 19:26:02,509 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:26:02 wikitech-static check_icinga[4149]: 2021-11-07 19:26:02,578 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:26:05 wikitech-static check_icinga[4149]: 2021-11-07 19:26:05,745 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:26:05 wikitech-static check_icinga[4150]: 2021-11-07 19:26:05,830 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:28:01 wikitech-static CRON[4222]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:28:01 wikitech-static CRON[4223]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:28:03 wikitech-static check_icinga[4224]: 2021-11-07 19:28:03,023 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:28:03 wikitech-static check_icinga[4225]: 2021-11-07 19:28:03,027 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:28:06 wikitech-static check_icinga[4224]: 2021-11-07 19:28:06,226 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:28:06 wikitech-static check_icinga[4225]: 2021-11-07 19:28:06,318 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:30:01 wikitech-static CRON[4299]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:30:01 wikitech-static CRON[4300]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:30:02 wikitech-static check_icinga[4302]: 2021-11-07 19:30:02,471 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:30:02 wikitech-static check_icinga[4301]: 2021-11-07 19:30:02,477 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:30:05 wikitech-static check_icinga[4301]: 2021-11-07 19:30:05,575 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:30:05 wikitech-static check_icinga[4302]: 2021-11-07 19:30:05,579 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:32:01 wikitech-static CRON[4384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:32:01 wikitech-static CRON[4385]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:32:02 wikitech-static check_icinga[4387]: 2021-11-07 19:32:02,780 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:32:02 wikitech-static check_icinga[4388]: 2021-11-07 19:32:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:32:06 wikitech-static check_icinga[4387]: 2021-11-07 19:32:06,001 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:32:06 wikitech-static check_icinga[4388]: 2021-11-07 19:32:06,010 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:34:01 wikitech-static CRON[4466]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:34:01 wikitech-static CRON[4467]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:34:02 wikitech-static check_icinga[4468]: 2021-11-07 19:34:02,254 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:34:02 wikitech-static check_icinga[4469]: 2021-11-07 19:34:02,257 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:34:03 wikitech-static check_icinga[4469]: 2021-11-07 19:34:03,626 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)'] Nov 7 19:34:05 wikitech-static check_icinga[4468]: 2021-11-07 19:34:05,516 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:34:13 wikitech-static check_icinga[4469]: 2021-11-07 19:34:13,640 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:34:16 wikitech-static check_icinga[4469]: 2021-11-07 19:34:16,329 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:36:01 wikitech-static CRON[4545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:36:01 wikitech-static CRON[4546]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:36:02 wikitech-static check_icinga[4548]: 2021-11-07 19:36:02,509 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:36:02 wikitech-static check_icinga[4547]: 2021-11-07 19:36:02,514 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:36:05 wikitech-static check_icinga[4547]: 2021-11-07 19:36:05,317 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:36:05 wikitech-static check_icinga[4548]: 2021-11-07 19:36:05,767 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:38:01 wikitech-static CRON[4630]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:38:01 wikitech-static CRON[4631]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:38:02 wikitech-static check_icinga[4632]: 2021-11-07 19:38:02,916 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:38:02 wikitech-static check_icinga[4633]: 2021-11-07 19:38:02,918 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:38:05 wikitech-static check_icinga[4632]: 2021-11-07 19:38:05,667 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:38:06 wikitech-static check_icinga[4633]: 2021-11-07 19:38:06,207 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:39:01 wikitech-static CRON[4677]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 19:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 19:39:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 19:40:01 wikitech-static CRON[4800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:40:01 wikitech-static CRON[4801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:40:02 wikitech-static check_icinga[4803]: 2021-11-07 19:40:02,772 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:40:02 wikitech-static check_icinga[4802]: 2021-11-07 19:40:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:40:05 wikitech-static check_icinga[4802]: 2021-11-07 19:40:05,662 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:40:05 wikitech-static check_icinga[4803]: 2021-11-07 19:40:05,980 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:42:01 wikitech-static CRON[4875]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:42:01 wikitech-static CRON[4876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:42:02 wikitech-static check_icinga[4878]: 2021-11-07 19:42:02,139 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:42:02 wikitech-static check_icinga[4877]: 2021-11-07 19:42:02,210 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:42:04 wikitech-static check_icinga[4877]: 2021-11-07 19:42:04,970 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:42:05 wikitech-static check_icinga[4878]: 2021-11-07 19:42:05,393 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:44:01 wikitech-static CRON[4977]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:44:01 wikitech-static CRON[4978]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:44:02 wikitech-static check_icinga[4979]: 2021-11-07 19:44:02,601 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:44:02 wikitech-static check_icinga[4980]: 2021-11-07 19:44:02,604 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:44:05 wikitech-static check_icinga[4980]: 2021-11-07 19:44:05,439 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:44:05 wikitech-static check_icinga[4979]: 2021-11-07 19:44:05,836 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:46:01 wikitech-static CRON[5056]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:46:01 wikitech-static CRON[5057]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:46:03 wikitech-static check_icinga[5059]: 2021-11-07 19:46:03,071 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:46:03 wikitech-static check_icinga[5058]: 2021-11-07 19:46:03,074 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:46:06 wikitech-static check_icinga[5059]: 2021-11-07 19:46:06,153 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:46:06 wikitech-static check_icinga[5058]: 2021-11-07 19:46:06,162 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:48:01 wikitech-static CRON[5248]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:48:01 wikitech-static CRON[5249]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:48:02 wikitech-static check_icinga[5250]: 2021-11-07 19:48:02,408 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:48:02 wikitech-static check_icinga[5251]: 2021-11-07 19:48:02,435 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:48:05 wikitech-static check_icinga[5250]: 2021-11-07 19:48:05,470 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:48:05 wikitech-static check_icinga[5251]: 2021-11-07 19:48:05,567 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:50:01 wikitech-static CRON[5341]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:50:01 wikitech-static CRON[5342]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:50:02 wikitech-static check_icinga[5343]: 2021-11-07 19:50:02,714 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:50:02 wikitech-static check_icinga[5344]: 2021-11-07 19:50:02,724 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:50:05 wikitech-static check_icinga[5343]: 2021-11-07 19:50:05,706 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:50:05 wikitech-static check_icinga[5344]: 2021-11-07 19:50:05,939 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:52:01 wikitech-static CRON[5416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:52:01 wikitech-static CRON[5417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:52:02 wikitech-static check_icinga[5418]: 2021-11-07 19:52:02,117 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:52:02 wikitech-static check_icinga[5419]: 2021-11-07 19:52:02,121 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:52:05 wikitech-static check_icinga[5418]: 2021-11-07 19:52:05,119 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:52:05 wikitech-static check_icinga[5419]: 2021-11-07 19:52:05,367 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:54:01 wikitech-static CRON[5494]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:54:01 wikitech-static CRON[5495]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:54:02 wikitech-static check_icinga[5496]: 2021-11-07 19:54:02,498 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:54:02 wikitech-static check_icinga[5497]: 2021-11-07 19:54:02,502 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:54:05 wikitech-static check_icinga[5496]: 2021-11-07 19:54:05,583 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:54:05 wikitech-static check_icinga[5497]: 2021-11-07 19:54:05,646 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:56:01 wikitech-static CRON[5573]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:56:01 wikitech-static CRON[5574]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:56:02 wikitech-static check_icinga[5576]: 2021-11-07 19:56:02,808 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:56:02 wikitech-static check_icinga[5575]: 2021-11-07 19:56:02,813 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:56:05 wikitech-static check_icinga[5575]: 2021-11-07 19:56:05,886 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:56:05 wikitech-static check_icinga[5576]: 2021-11-07 19:56:05,982 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 19:58:01 wikitech-static CRON[5652]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 19:58:01 wikitech-static CRON[5653]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 19:58:02 wikitech-static check_icinga[5655]: 2021-11-07 19:58:02,138 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 19:58:02 wikitech-static check_icinga[5654]: 2021-11-07 19:58:02,156 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 19:58:05 wikitech-static check_icinga[5654]: 2021-11-07 19:58:05,200 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 19:58:05 wikitech-static check_icinga[5655]: 2021-11-07 19:58:05,373 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:00:01 wikitech-static CRON[5730]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:00:01 wikitech-static CRON[5731]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:00:02 wikitech-static check_icinga[5732]: 2021-11-07 20:00:02,509 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:00:02 wikitech-static check_icinga[5733]: 2021-11-07 20:00:02,513 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:00:05 wikitech-static check_icinga[5732]: 2021-11-07 20:00:05,611 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:00:05 wikitech-static check_icinga[5733]: 2021-11-07 20:00:05,687 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:02:01 wikitech-static CRON[5807]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:02:01 wikitech-static CRON[5808]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:02:03 wikitech-static check_icinga[5809]: 2021-11-07 20:02:03,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:02:03 wikitech-static check_icinga[5810]: 2021-11-07 20:02:03,232 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:02:06 wikitech-static check_icinga[5809]: 2021-11-07 20:02:06,129 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:02:06 wikitech-static check_icinga[5810]: 2021-11-07 20:02:06,213 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:04:01 wikitech-static CRON[5883]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:04:01 wikitech-static CRON[5884]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:04:02 wikitech-static check_icinga[5886]: 2021-11-07 20:04:02,494 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:04:02 wikitech-static check_icinga[5885]: 2021-11-07 20:04:02,556 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:04:05 wikitech-static check_icinga[5885]: 2021-11-07 20:04:05,614 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:04:05 wikitech-static check_icinga[5886]: 2021-11-07 20:04:05,746 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:06:01 wikitech-static CRON[5967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:06:01 wikitech-static CRON[5968]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:06:02 wikitech-static check_icinga[5970]: 2021-11-07 20:06:02,994 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:06:03 wikitech-static check_icinga[5969]: 2021-11-07 20:06:03,001 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:06:05 wikitech-static check_icinga[5969]: 2021-11-07 20:06:05,993 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:06:06 wikitech-static check_icinga[5970]: 2021-11-07 20:06:06,047 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:08:01 wikitech-static CRON[6059]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:08:01 wikitech-static CRON[6060]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:08:02 wikitech-static check_icinga[6062]: 2021-11-07 20:08:02,215 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:08:02 wikitech-static check_icinga[6061]: 2021-11-07 20:08:02,246 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:08:05 wikitech-static check_icinga[6062]: 2021-11-07 20:08:05,206 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:08:05 wikitech-static check_icinga[6061]: 2021-11-07 20:08:05,437 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:09:01 wikitech-static CRON[6106]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 20:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 20:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 20:10:01 wikitech-static CRON[6228]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:10:01 wikitech-static CRON[6229]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:10:02 wikitech-static check_icinga[6231]: 2021-11-07 20:10:02,590 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:10:02 wikitech-static check_icinga[6230]: 2021-11-07 20:10:02,616 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:10:05 wikitech-static check_icinga[6230]: 2021-11-07 20:10:05,664 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:10:05 wikitech-static check_icinga[6231]: 2021-11-07 20:10:05,994 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:11:01 wikitech-static CRON[6275]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 20:11:01 wikitech-static check_icinga_validate_config[6276]: Valid config, nothing to do. Nov 7 20:12:01 wikitech-static CRON[6308]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:12:01 wikitech-static CRON[6309]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:12:02 wikitech-static check_icinga[6310]: 2021-11-07 20:12:02,934 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:12:02 wikitech-static check_icinga[6311]: 2021-11-07 20:12:02,937 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:12:06 wikitech-static check_icinga[6311]: 2021-11-07 20:12:06,065 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:12:06 wikitech-static check_icinga[6310]: 2021-11-07 20:12:06,229 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:14:01 wikitech-static CRON[6386]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:14:01 wikitech-static CRON[6387]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:14:02 wikitech-static check_icinga[6388]: 2021-11-07 20:14:02,418 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:14:02 wikitech-static check_icinga[6389]: 2021-11-07 20:14:02,421 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:14:05 wikitech-static check_icinga[6388]: 2021-11-07 20:14:05,416 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:14:05 wikitech-static check_icinga[6389]: 2021-11-07 20:14:05,641 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:16:01 wikitech-static CRON[6463]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:16:01 wikitech-static CRON[6464]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:16:02 wikitech-static check_icinga[6466]: 2021-11-07 20:16:02,761 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:16:02 wikitech-static check_icinga[6465]: 2021-11-07 20:16:02,779 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:16:05 wikitech-static check_icinga[6465]: 2021-11-07 20:16:05,829 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:16:06 wikitech-static check_icinga[6466]: 2021-11-07 20:16:06,185 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:17:01 wikitech-static CRON[6515]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 20:18:01 wikitech-static CRON[6548]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:18:01 wikitech-static CRON[6549]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:18:02 wikitech-static check_icinga[6550]: 2021-11-07 20:18:02,339 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:18:02 wikitech-static check_icinga[6551]: 2021-11-07 20:18:02,346 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:18:05 wikitech-static check_icinga[6550]: 2021-11-07 20:18:05,291 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:18:05 wikitech-static check_icinga[6551]: 2021-11-07 20:18:05,424 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:19:05 wikitech-static systemd[1]: Started Session 1082582 of user root. Nov 7 20:19:06 wikitech-static systemd[1]: Started Session 1082583 of user root. Nov 7 20:20:01 wikitech-static CRON[6649]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:20:01 wikitech-static CRON[6650]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:20:02 wikitech-static check_icinga[6651]: 2021-11-07 20:20:02,625 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:20:02 wikitech-static check_icinga[6652]: 2021-11-07 20:20:02,631 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:20:05 wikitech-static check_icinga[6652]: 2021-11-07 20:20:05,686 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:20:06 wikitech-static check_icinga[6651]: 2021-11-07 20:20:06,180 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:22:01 wikitech-static CRON[6724]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:22:01 wikitech-static CRON[6725]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:22:02 wikitech-static check_icinga[6726]: 2021-11-07 20:22:02,322 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:22:02 wikitech-static check_icinga[6727]: 2021-11-07 20:22:02,347 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:22:05 wikitech-static check_icinga[6727]: 2021-11-07 20:22:05,460 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:22:05 wikitech-static check_icinga[6726]: 2021-11-07 20:22:05,539 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:24:01 wikitech-static CRON[6801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:24:01 wikitech-static CRON[6803]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:24:02 wikitech-static check_icinga[6802]: 2021-11-07 20:24:02,679 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:24:02 wikitech-static check_icinga[6804]: 2021-11-07 20:24:02,704 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:24:05 wikitech-static check_icinga[6802]: 2021-11-07 20:24:05,618 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:24:05 wikitech-static check_icinga[6804]: 2021-11-07 20:24:05,708 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:26:01 wikitech-static CRON[6887]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:26:01 wikitech-static CRON[6888]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:26:02 wikitech-static check_icinga[6890]: 2021-11-07 20:26:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:26:02 wikitech-static check_icinga[6889]: 2021-11-07 20:26:02,837 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:26:05 wikitech-static check_icinga[6889]: 2021-11-07 20:26:05,918 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:26:06 wikitech-static check_icinga[6890]: 2021-11-07 20:26:06,039 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:28:01 wikitech-static CRON[6963]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:28:01 wikitech-static CRON[6965]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:28:02 wikitech-static check_icinga[6964]: 2021-11-07 20:28:02,198 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:28:02 wikitech-static check_icinga[6966]: 2021-11-07 20:28:02,210 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:28:05 wikitech-static check_icinga[6964]: 2021-11-07 20:28:05,171 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:28:05 wikitech-static check_icinga[6966]: 2021-11-07 20:28:05,449 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:30:01 wikitech-static CRON[7044]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:30:01 wikitech-static CRON[7045]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:30:02 wikitech-static check_icinga[7047]: 2021-11-07 20:30:02,562 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:30:02 wikitech-static check_icinga[7046]: 2021-11-07 20:30:02,588 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:30:05 wikitech-static check_icinga[7047]: 2021-11-07 20:30:05,713 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:30:05 wikitech-static check_icinga[7046]: 2021-11-07 20:30:05,758 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:32:01 wikitech-static CRON[7122]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:32:01 wikitech-static CRON[7123]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:32:02 wikitech-static check_icinga[7124]: 2021-11-07 20:32:02,937 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:32:02 wikitech-static check_icinga[7125]: 2021-11-07 20:32:02,940 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:32:05 wikitech-static check_icinga[7124]: 2021-11-07 20:32:05,827 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:32:06 wikitech-static check_icinga[7125]: 2021-11-07 20:32:06,249 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:34:01 wikitech-static CRON[7197]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:34:01 wikitech-static CRON[7198]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:34:02 wikitech-static check_icinga[7199]: 2021-11-07 20:34:02,397 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:34:02 wikitech-static check_icinga[7200]: 2021-11-07 20:34:02,401 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:34:03 wikitech-static check_icinga[7200]: 2021-11-07 20:34:03,763 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)'] Nov 7 20:34:05 wikitech-static check_icinga[7199]: 2021-11-07 20:34:05,482 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:34:13 wikitech-static check_icinga[7200]: 2021-11-07 20:34:13,802 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:34:16 wikitech-static check_icinga[7200]: 2021-11-07 20:34:16,571 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:36:01 wikitech-static CRON[7274]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:36:01 wikitech-static CRON[7275]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:36:02 wikitech-static check_icinga[7276]: 2021-11-07 20:36:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:36:02 wikitech-static check_icinga[7277]: 2021-11-07 20:36:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:36:05 wikitech-static check_icinga[7276]: 2021-11-07 20:36:05,588 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:36:06 wikitech-static check_icinga[7277]: 2021-11-07 20:36:06,029 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:38:01 wikitech-static CRON[7349]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:38:01 wikitech-static CRON[7350]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:38:02 wikitech-static check_icinga[7352]: 2021-11-07 20:38:02,157 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:38:02 wikitech-static check_icinga[7351]: 2021-11-07 20:38:02,183 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:38:04 wikitech-static check_icinga[7351]: 2021-11-07 20:38:04,906 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:38:05 wikitech-static check_icinga[7352]: 2021-11-07 20:38:05,515 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:39:01 wikitech-static CRON[7396]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 20:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 20:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 20:40:01 wikitech-static CRON[7520]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:40:01 wikitech-static CRON[7521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:40:02 wikitech-static check_icinga[7522]: 2021-11-07 20:40:02,719 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:40:02 wikitech-static check_icinga[7523]: 2021-11-07 20:40:02,723 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:40:05 wikitech-static check_icinga[7522]: 2021-11-07 20:40:05,579 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:40:05 wikitech-static check_icinga[7523]: 2021-11-07 20:40:05,894 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:42:01 wikitech-static CRON[7595]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:42:01 wikitech-static CRON[7596]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:42:03 wikitech-static check_icinga[7597]: 2021-11-07 20:42:03,024 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:42:03 wikitech-static check_icinga[7598]: 2021-11-07 20:42:03,026 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:42:05 wikitech-static check_icinga[7597]: 2021-11-07 20:42:05,821 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:42:06 wikitech-static check_icinga[7598]: 2021-11-07 20:42:06,088 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:44:01 wikitech-static CRON[7673]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:44:01 wikitech-static CRON[7674]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:44:02 wikitech-static check_icinga[7675]: 2021-11-07 20:44:02,240 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:44:02 wikitech-static check_icinga[7676]: 2021-11-07 20:44:02,242 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:44:05 wikitech-static check_icinga[7676]: 2021-11-07 20:44:05,033 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:44:05 wikitech-static check_icinga[7675]: 2021-11-07 20:44:05,467 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:46:01 wikitech-static CRON[7748]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:46:01 wikitech-static CRON[7749]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:46:02 wikitech-static check_icinga[7750]: 2021-11-07 20:46:02,629 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:46:02 wikitech-static check_icinga[7751]: 2021-11-07 20:46:02,659 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:46:05 wikitech-static check_icinga[7750]: 2021-11-07 20:46:05,375 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:46:05 wikitech-static check_icinga[7751]: 2021-11-07 20:46:05,805 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:48:01 wikitech-static CRON[7824]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:48:01 wikitech-static CRON[7825]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:48:02 wikitech-static check_icinga[7826]: 2021-11-07 20:48:02,946 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:48:02 wikitech-static check_icinga[7827]: 2021-11-07 20:48:02,950 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:48:05 wikitech-static check_icinga[7827]: 2021-11-07 20:48:05,967 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:48:06 wikitech-static check_icinga[7826]: 2021-11-07 20:48:06,121 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:50:01 wikitech-static CRON[7899]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:50:01 wikitech-static CRON[7900]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:50:02 wikitech-static check_icinga[7902]: 2021-11-07 20:50:02,268 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:50:02 wikitech-static check_icinga[7901]: 2021-11-07 20:50:02,271 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:50:05 wikitech-static check_icinga[7901]: 2021-11-07 20:50:05,697 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:50:05 wikitech-static check_icinga[7902]: 2021-11-07 20:50:05,699 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:52:01 wikitech-static CRON[7979]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:52:01 wikitech-static CRON[7980]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:52:02 wikitech-static check_icinga[7982]: 2021-11-07 20:52:02,970 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:52:02 wikitech-static check_icinga[7981]: 2021-11-07 20:52:02,989 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:52:05 wikitech-static check_icinga[7981]: 2021-11-07 20:52:05,939 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:52:06 wikitech-static check_icinga[7982]: 2021-11-07 20:52:06,097 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:54:01 wikitech-static CRON[8099]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:54:01 wikitech-static CRON[8100]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:54:02 wikitech-static check_icinga[8101]: 2021-11-07 20:54:02,277 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:54:02 wikitech-static check_icinga[8102]: 2021-11-07 20:54:02,279 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:54:05 wikitech-static check_icinga[8101]: 2021-11-07 20:54:05,336 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:54:05 wikitech-static check_icinga[8102]: 2021-11-07 20:54:05,391 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:56:01 wikitech-static CRON[8178]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:56:01 wikitech-static CRON[8179]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:56:02 wikitech-static check_icinga[8180]: 2021-11-07 20:56:02,590 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:56:02 wikitech-static check_icinga[8181]: 2021-11-07 20:56:02,591 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:56:05 wikitech-static check_icinga[8180]: 2021-11-07 20:56:05,573 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:56:05 wikitech-static check_icinga[8181]: 2021-11-07 20:56:05,780 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 20:58:01 wikitech-static CRON[8253]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 20:58:01 wikitech-static CRON[8254]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 20:58:02 wikitech-static check_icinga[8255]: 2021-11-07 20:58:02,893 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 20:58:02 wikitech-static check_icinga[8256]: 2021-11-07 20:58:02,923 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 20:58:05 wikitech-static check_icinga[8255]: 2021-11-07 20:58:05,964 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 20:58:06 wikitech-static check_icinga[8256]: 2021-11-07 20:58:06,120 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:00:01 wikitech-static CRON[8335]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:00:01 wikitech-static CRON[8336]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:00:02 wikitech-static check_icinga[8338]: 2021-11-07 21:00:02,251 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:00:02 wikitech-static check_icinga[8337]: 2021-11-07 21:00:02,255 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:00:05 wikitech-static check_icinga[8337]: 2021-11-07 21:00:05,261 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:00:05 wikitech-static check_icinga[8338]: 2021-11-07 21:00:05,608 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:02:01 wikitech-static CRON[8410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:02:01 wikitech-static CRON[8411]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:02:02 wikitech-static check_icinga[8412]: 2021-11-07 21:02:02,725 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:02:02 wikitech-static check_icinga[8413]: 2021-11-07 21:02:02,760 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:02:05 wikitech-static check_icinga[8413]: 2021-11-07 21:02:05,805 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:02:05 wikitech-static check_icinga[8412]: 2021-11-07 21:02:05,877 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:04:01 wikitech-static CRON[8488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:04:01 wikitech-static CRON[8489]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:04:03 wikitech-static check_icinga[8490]: 2021-11-07 21:04:03,009 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:04:03 wikitech-static check_icinga[8491]: 2021-11-07 21:04:03,035 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:04:06 wikitech-static check_icinga[8491]: 2021-11-07 21:04:06,018 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:04:06 wikitech-static check_icinga[8490]: 2021-11-07 21:04:06,186 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:06:01 wikitech-static CRON[8563]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:06:01 wikitech-static CRON[8564]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:06:02 wikitech-static check_icinga[8566]: 2021-11-07 21:06:02,336 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:06:02 wikitech-static check_icinga[8565]: 2021-11-07 21:06:02,350 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:06:05 wikitech-static check_icinga[8566]: 2021-11-07 21:06:05,334 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:06:05 wikitech-static check_icinga[8565]: 2021-11-07 21:06:05,527 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:08:01 wikitech-static CRON[8641]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:08:01 wikitech-static CRON[8642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:08:02 wikitech-static check_icinga[8644]: 2021-11-07 21:08:02,667 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:08:02 wikitech-static check_icinga[8643]: 2021-11-07 21:08:02,673 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:08:05 wikitech-static check_icinga[8643]: 2021-11-07 21:08:05,782 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:08:05 wikitech-static check_icinga[8644]: 2021-11-07 21:08:05,874 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:09:01 wikitech-static CRON[8692]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 21:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 21:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 21:10:01 wikitech-static CRON[8814]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:10:01 wikitech-static CRON[8815]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:10:03 wikitech-static check_icinga[8816]: 2021-11-07 21:10:03,148 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:10:03 wikitech-static check_icinga[8817]: 2021-11-07 21:10:03,204 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:10:06 wikitech-static check_icinga[8817]: 2021-11-07 21:10:06,207 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:10:06 wikitech-static check_icinga[8816]: 2021-11-07 21:10:06,583 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:12:01 wikitech-static CRON[8895]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:12:01 wikitech-static CRON[8896]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:12:02 wikitech-static check_icinga[8898]: 2021-11-07 21:12:02,717 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:12:02 wikitech-static check_icinga[8897]: 2021-11-07 21:12:02,745 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:12:05 wikitech-static check_icinga[8897]: 2021-11-07 21:12:05,652 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:12:05 wikitech-static check_icinga[8898]: 2021-11-07 21:12:05,854 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:14:01 wikitech-static CRON[8973]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:14:01 wikitech-static CRON[8974]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:14:02 wikitech-static check_icinga[8976]: 2021-11-07 21:14:02,995 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:14:03 wikitech-static check_icinga[8975]: 2021-11-07 21:14:03,059 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:14:06 wikitech-static check_icinga[8976]: 2021-11-07 21:14:06,089 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:14:06 wikitech-static check_icinga[8975]: 2021-11-07 21:14:06,170 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:16:01 wikitech-static CRON[9049]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:16:01 wikitech-static CRON[9050]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:16:02 wikitech-static check_icinga[9051]: 2021-11-07 21:16:02,389 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:16:02 wikitech-static check_icinga[9052]: 2021-11-07 21:16:02,397 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:16:05 wikitech-static check_icinga[9051]: 2021-11-07 21:16:05,586 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:16:05 wikitech-static check_icinga[9052]: 2021-11-07 21:16:05,652 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:17:01 wikitech-static CRON[9117]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 21:18:01 wikitech-static CRON[9148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:18:01 wikitech-static CRON[9149]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:18:02 wikitech-static check_icinga[9150]: 2021-11-07 21:18:02,842 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:18:02 wikitech-static check_icinga[9151]: 2021-11-07 21:18:02,846 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:18:05 wikitech-static check_icinga[9150]: 2021-11-07 21:18:05,929 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:18:05 wikitech-static check_icinga[9151]: 2021-11-07 21:18:05,977 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:20:01 wikitech-static CRON[9227]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:20:01 wikitech-static CRON[9228]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:20:02 wikitech-static check_icinga[9229]: 2021-11-07 21:20:02,156 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:20:02 wikitech-static check_icinga[9230]: 2021-11-07 21:20:02,160 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:20:05 wikitech-static check_icinga[9229]: 2021-11-07 21:20:05,228 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:20:05 wikitech-static check_icinga[9230]: 2021-11-07 21:20:05,391 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:22:01 wikitech-static CRON[9306]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:22:01 wikitech-static CRON[9307]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:22:02 wikitech-static check_icinga[9309]: 2021-11-07 21:22:02,545 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:22:02 wikitech-static check_icinga[9308]: 2021-11-07 21:22:02,552 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:22:05 wikitech-static check_icinga[9309]: 2021-11-07 21:22:05,740 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:22:05 wikitech-static check_icinga[9308]: 2021-11-07 21:22:05,878 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:24:01 wikitech-static CRON[9386]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:24:01 wikitech-static CRON[9387]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:24:03 wikitech-static check_icinga[9389]: 2021-11-07 21:24:03,186 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:24:03 wikitech-static check_icinga[9388]: 2021-11-07 21:24:03,187 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:24:06 wikitech-static check_icinga[9388]: 2021-11-07 21:24:06,056 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:24:06 wikitech-static check_icinga[9389]: 2021-11-07 21:24:06,370 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:26:01 wikitech-static CRON[9467]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:26:01 wikitech-static CRON[9468]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:26:02 wikitech-static check_icinga[9469]: 2021-11-07 21:26:02,547 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:26:02 wikitech-static check_icinga[9470]: 2021-11-07 21:26:02,567 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:26:05 wikitech-static check_icinga[9469]: 2021-11-07 21:26:05,500 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:26:06 wikitech-static check_icinga[9470]: 2021-11-07 21:26:06,014 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:28:01 wikitech-static CRON[9544]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:28:01 wikitech-static CRON[9545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:28:02 wikitech-static check_icinga[9547]: 2021-11-07 21:28:02,161 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:28:02 wikitech-static check_icinga[9546]: 2021-11-07 21:28:02,164 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:28:05 wikitech-static check_icinga[9546]: 2021-11-07 21:28:05,189 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:28:05 wikitech-static check_icinga[9547]: 2021-11-07 21:28:05,277 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:30:01 wikitech-static CRON[9625]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:30:01 wikitech-static CRON[9626]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:30:02 wikitech-static check_icinga[9627]: 2021-11-07 21:30:02,467 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:30:02 wikitech-static check_icinga[9628]: 2021-11-07 21:30:02,469 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:30:05 wikitech-static check_icinga[9627]: 2021-11-07 21:30:05,533 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:30:05 wikitech-static check_icinga[9628]: 2021-11-07 21:30:05,955 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:32:01 wikitech-static CRON[9704]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:32:01 wikitech-static CRON[9705]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:32:02 wikitech-static check_icinga[9706]: 2021-11-07 21:32:02,131 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:32:02 wikitech-static check_icinga[9707]: 2021-11-07 21:32:02,135 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:32:05 wikitech-static check_icinga[9706]: 2021-11-07 21:32:05,138 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:32:05 wikitech-static check_icinga[9707]: 2021-11-07 21:32:05,299 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:34:01 wikitech-static CRON[9779]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:34:01 wikitech-static CRON[9780]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:34:02 wikitech-static check_icinga[9781]: 2021-11-07 21:34:02,413 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:34:02 wikitech-static check_icinga[9782]: 2021-11-07 21:34:02,435 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:34:03 wikitech-static check_icinga[9782]: 2021-11-07 21:34:03,809 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)'] Nov 7 21:34:05 wikitech-static check_icinga[9781]: 2021-11-07 21:34:05,591 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:34:13 wikitech-static check_icinga[9782]: 2021-11-07 21:34:13,823 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:34:16 wikitech-static check_icinga[9782]: 2021-11-07 21:34:16,502 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:36:01 wikitech-static CRON[9856]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:36:01 wikitech-static CRON[9857]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:36:02 wikitech-static check_icinga[9859]: 2021-11-07 21:36:02,656 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:36:02 wikitech-static check_icinga[9858]: 2021-11-07 21:36:02,664 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:36:05 wikitech-static check_icinga[9858]: 2021-11-07 21:36:05,457 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:36:05 wikitech-static check_icinga[9859]: 2021-11-07 21:36:05,713 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:38:01 wikitech-static CRON[9931]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:38:01 wikitech-static CRON[9932]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:38:02 wikitech-static check_icinga[9934]: 2021-11-07 21:38:02,852 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:38:02 wikitech-static check_icinga[9933]: 2021-11-07 21:38:02,853 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:38:05 wikitech-static check_icinga[9933]: 2021-11-07 21:38:05,564 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:38:06 wikitech-static check_icinga[9934]: 2021-11-07 21:38:06,242 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:39:01 wikitech-static CRON[9982]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 21:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 21:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 21:40:01 wikitech-static CRON[10106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:40:01 wikitech-static CRON[10107]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:40:02 wikitech-static check_icinga[10108]: 2021-11-07 21:40:02,408 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:40:02 wikitech-static check_icinga[10109]: 2021-11-07 21:40:02,415 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:40:05 wikitech-static check_icinga[10108]: 2021-11-07 21:40:05,279 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:40:05 wikitech-static check_icinga[10109]: 2021-11-07 21:40:05,634 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:42:01 wikitech-static CRON[10183]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:42:01 wikitech-static CRON[10185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:42:02 wikitech-static check_icinga[10184]: 2021-11-07 21:42:02,776 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:42:02 wikitech-static check_icinga[10186]: 2021-11-07 21:42:02,789 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:42:05 wikitech-static check_icinga[10184]: 2021-11-07 21:42:05,535 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:42:05 wikitech-static check_icinga[10186]: 2021-11-07 21:42:05,974 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:44:01 wikitech-static CRON[10260]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:44:01 wikitech-static CRON[10261]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:44:02 wikitech-static check_icinga[10263]: 2021-11-07 21:44:02,212 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:44:02 wikitech-static check_icinga[10262]: 2021-11-07 21:44:02,219 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:44:05 wikitech-static check_icinga[10263]: 2021-11-07 21:44:05,214 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:44:05 wikitech-static check_icinga[10262]: 2021-11-07 21:44:05,365 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:46:01 wikitech-static CRON[10337]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:46:01 wikitech-static CRON[10338]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:46:02 wikitech-static check_icinga[10339]: 2021-11-07 21:46:02,649 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:46:02 wikitech-static check_icinga[10340]: 2021-11-07 21:46:02,715 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:46:05 wikitech-static check_icinga[10339]: 2021-11-07 21:46:05,529 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:46:05 wikitech-static check_icinga[10340]: 2021-11-07 21:46:05,822 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:48:01 wikitech-static CRON[10418]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:48:01 wikitech-static CRON[10419]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:48:02 wikitech-static check_icinga[10420]: 2021-11-07 21:48:02,939 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:48:02 wikitech-static check_icinga[10421]: 2021-11-07 21:48:02,963 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:48:05 wikitech-static check_icinga[10420]: 2021-11-07 21:48:05,825 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:48:06 wikitech-static check_icinga[10421]: 2021-11-07 21:48:06,276 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:50:01 wikitech-static CRON[10497]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:50:01 wikitech-static CRON[10498]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:50:02 wikitech-static check_icinga[10499]: 2021-11-07 21:50:02,378 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:50:02 wikitech-static check_icinga[10500]: 2021-11-07 21:50:02,404 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:50:05 wikitech-static check_icinga[10500]: 2021-11-07 21:50:05,335 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:50:05 wikitech-static check_icinga[10499]: 2021-11-07 21:50:05,805 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:52:01 wikitech-static CRON[10572]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:52:01 wikitech-static CRON[10573]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:52:02 wikitech-static check_icinga[10574]: 2021-11-07 21:52:02,905 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:52:03 wikitech-static check_icinga[10575]: 2021-11-07 21:52:03,002 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:52:06 wikitech-static check_icinga[10574]: 2021-11-07 21:52:06,083 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:52:06 wikitech-static check_icinga[10575]: 2021-11-07 21:52:06,292 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:54:01 wikitech-static CRON[10647]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:54:01 wikitech-static CRON[10648]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:54:02 wikitech-static check_icinga[10650]: 2021-11-07 21:54:02,479 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:54:02 wikitech-static check_icinga[10649]: 2021-11-07 21:54:02,543 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:54:05 wikitech-static check_icinga[10649]: 2021-11-07 21:54:05,536 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:54:05 wikitech-static check_icinga[10650]: 2021-11-07 21:54:05,541 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:56:01 wikitech-static CRON[10725]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:56:01 wikitech-static CRON[10726]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:56:02 wikitech-static check_icinga[10727]: 2021-11-07 21:56:02,766 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:56:02 wikitech-static check_icinga[10728]: 2021-11-07 21:56:02,795 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:56:05 wikitech-static check_icinga[10727]: 2021-11-07 21:56:05,553 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:56:05 wikitech-static check_icinga[10728]: 2021-11-07 21:56:05,820 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 21:58:01 wikitech-static CRON[10800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 21:58:01 wikitech-static CRON[10801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 21:58:02 wikitech-static check_icinga[10802]: 2021-11-07 21:58:02,932 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 21:58:02 wikitech-static check_icinga[10803]: 2021-11-07 21:58:02,937 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 21:58:05 wikitech-static check_icinga[10802]: 2021-11-07 21:58:05,797 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 21:58:06 wikitech-static check_icinga[10803]: 2021-11-07 21:58:06,124 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:00:01 wikitech-static CRON[10886]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:00:01 wikitech-static CRON[10887]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:00:02 wikitech-static check_icinga[10889]: 2021-11-07 22:00:02,270 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:00:02 wikitech-static check_icinga[10888]: 2021-11-07 22:00:02,273 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:00:05 wikitech-static check_icinga[10888]: 2021-11-07 22:00:05,475 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:00:05 wikitech-static check_icinga[10889]: 2021-11-07 22:00:05,511 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:02:01 wikitech-static CRON[10966]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:02:01 wikitech-static CRON[10967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:02:02 wikitech-static check_icinga[10969]: 2021-11-07 22:02:02,730 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:02:02 wikitech-static check_icinga[10968]: 2021-11-07 22:02:02,737 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:02:05 wikitech-static check_icinga[10968]: 2021-11-07 22:02:05,570 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:02:05 wikitech-static check_icinga[10969]: 2021-11-07 22:02:05,807 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:04:01 wikitech-static CRON[11043]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:04:01 wikitech-static CRON[11044]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:04:02 wikitech-static check_icinga[11046]: 2021-11-07 22:04:02,917 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:04:02 wikitech-static check_icinga[11045]: 2021-11-07 22:04:02,963 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:04:05 wikitech-static check_icinga[11046]: 2021-11-07 22:04:05,752 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:04:06 wikitech-static check_icinga[11045]: 2021-11-07 22:04:06,199 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:06:01 wikitech-static CRON[11131]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:06:01 wikitech-static CRON[11132]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:06:02 wikitech-static check_icinga[11133]: 2021-11-07 22:06:02,312 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:06:02 wikitech-static check_icinga[11134]: 2021-11-07 22:06:02,342 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:06:05 wikitech-static check_icinga[11134]: 2021-11-07 22:06:05,266 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:06:05 wikitech-static check_icinga[11133]: 2021-11-07 22:06:05,517 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:08:01 wikitech-static CRON[11208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:08:01 wikitech-static CRON[11209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:08:02 wikitech-static check_icinga[11210]: 2021-11-07 22:08:02,649 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:08:02 wikitech-static check_icinga[11211]: 2021-11-07 22:08:02,680 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:08:05 wikitech-static check_icinga[11210]: 2021-11-07 22:08:05,487 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:08:05 wikitech-static check_icinga[11211]: 2021-11-07 22:08:05,917 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:09:01 wikitech-static CRON[11262]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 22:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 22:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 22:10:02 wikitech-static CRON[11400]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:10:02 wikitech-static CRON[11401]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:10:03 wikitech-static check_icinga[11402]: 2021-11-07 22:10:03,079 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:10:03 wikitech-static check_icinga[11403]: 2021-11-07 22:10:03,152 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:10:05 wikitech-static check_icinga[11402]: 2021-11-07 22:10:05,942 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:10:06 wikitech-static check_icinga[11403]: 2021-11-07 22:10:06,468 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:11:01 wikitech-static CRON[11447]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 7 22:11:02 wikitech-static check_icinga_validate_config[11448]: Valid config, nothing to do. Nov 7 22:12:01 wikitech-static CRON[11487]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:12:01 wikitech-static CRON[11488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:12:02 wikitech-static check_icinga[11489]: 2021-11-07 22:12:02,158 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:12:02 wikitech-static check_icinga[11490]: 2021-11-07 22:12:02,194 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:12:05 wikitech-static check_icinga[11489]: 2021-11-07 22:12:05,125 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:12:05 wikitech-static check_icinga[11490]: 2021-11-07 22:12:05,214 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:14:01 wikitech-static CRON[11569]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:14:01 wikitech-static CRON[11570]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:14:02 wikitech-static check_icinga[11572]: 2021-11-07 22:14:02,337 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:14:02 wikitech-static check_icinga[11571]: 2021-11-07 22:14:02,363 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:14:05 wikitech-static check_icinga[11571]: 2021-11-07 22:14:05,455 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:14:05 wikitech-static check_icinga[11572]: 2021-11-07 22:14:05,468 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:16:01 wikitech-static CRON[11647]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:16:01 wikitech-static CRON[11648]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:16:02 wikitech-static check_icinga[11650]: 2021-11-07 22:16:02,726 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:16:02 wikitech-static check_icinga[11649]: 2021-11-07 22:16:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:16:05 wikitech-static check_icinga[11649]: 2021-11-07 22:16:05,655 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:16:05 wikitech-static check_icinga[11650]: 2021-11-07 22:16:05,865 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:17:01 wikitech-static CRON[11701]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 22:18:01 wikitech-static CRON[11734]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:18:01 wikitech-static CRON[11735]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:18:03 wikitech-static check_icinga[11737]: 2021-11-07 22:18:03,017 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:18:03 wikitech-static check_icinga[11736]: 2021-11-07 22:18:03,018 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:18:06 wikitech-static check_icinga[11737]: 2021-11-07 22:18:06,151 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:18:06 wikitech-static check_icinga[11736]: 2021-11-07 22:18:06,217 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:20:01 wikitech-static CRON[11838]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:20:01 wikitech-static CRON[11839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:20:02 wikitech-static check_icinga[11841]: 2021-11-07 22:20:02,391 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:20:02 wikitech-static check_icinga[11840]: 2021-11-07 22:20:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:20:05 wikitech-static check_icinga[11840]: 2021-11-07 22:20:05,362 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:20:05 wikitech-static check_icinga[11841]: 2021-11-07 22:20:05,466 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:22:01 wikitech-static CRON[11934]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:22:01 wikitech-static CRON[11935]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:22:02 wikitech-static check_icinga[11937]: 2021-11-07 22:22:02,636 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:22:02 wikitech-static check_icinga[11936]: 2021-11-07 22:22:02,641 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:22:05 wikitech-static check_icinga[11936]: 2021-11-07 22:22:05,566 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:22:06 wikitech-static check_icinga[11937]: 2021-11-07 22:22:06,056 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:24:01 wikitech-static CRON[12015]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:24:01 wikitech-static CRON[12016]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:24:02 wikitech-static check_icinga[12017]: 2021-11-07 22:24:02,207 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:24:02 wikitech-static check_icinga[12018]: 2021-11-07 22:24:02,277 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:24:05 wikitech-static check_icinga[12017]: 2021-11-07 22:24:05,243 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:24:05 wikitech-static check_icinga[12018]: 2021-11-07 22:24:05,372 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:26:01 wikitech-static CRON[12091]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:26:01 wikitech-static CRON[12092]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:26:02 wikitech-static check_icinga[12093]: 2021-11-07 22:26:02,530 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:26:02 wikitech-static check_icinga[12094]: 2021-11-07 22:26:02,604 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:26:05 wikitech-static check_icinga[12093]: 2021-11-07 22:26:05,347 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:26:05 wikitech-static check_icinga[12094]: 2021-11-07 22:26:05,950 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:28:01 wikitech-static CRON[12218]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:28:01 wikitech-static CRON[12219]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:28:02 wikitech-static check_icinga[12221]: 2021-11-07 22:28:02,106 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:28:02 wikitech-static check_icinga[12220]: 2021-11-07 22:28:02,173 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:28:05 wikitech-static check_icinga[12220]: 2021-11-07 22:28:05,049 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:28:05 wikitech-static check_icinga[12221]: 2021-11-07 22:28:05,352 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:30:01 wikitech-static CRON[12297]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:30:01 wikitech-static CRON[12298]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:30:02 wikitech-static check_icinga[12300]: 2021-11-07 22:30:02,526 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:30:02 wikitech-static check_icinga[12299]: 2021-11-07 22:30:02,527 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:30:05 wikitech-static check_icinga[12299]: 2021-11-07 22:30:05,460 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:30:05 wikitech-static check_icinga[12300]: 2021-11-07 22:30:05,610 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:32:01 wikitech-static CRON[12376]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:32:01 wikitech-static CRON[12377]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:32:02 wikitech-static check_icinga[12378]: 2021-11-07 22:32:02,701 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:32:02 wikitech-static check_icinga[12379]: 2021-11-07 22:32:02,752 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:32:05 wikitech-static check_icinga[12378]: 2021-11-07 22:32:05,676 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:32:05 wikitech-static check_icinga[12379]: 2021-11-07 22:32:05,756 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:34:01 wikitech-static CRON[12451]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:34:01 wikitech-static CRON[12452]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:34:02 wikitech-static check_icinga[12453]: 2021-11-07 22:34:02,921 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:34:02 wikitech-static check_icinga[12454]: 2021-11-07 22:34:02,926 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:34:04 wikitech-static check_icinga[12453]: 2021-11-07 22:34:04,312 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)'] Nov 7 22:34:06 wikitech-static check_icinga[12454]: 2021-11-07 22:34:06,132 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:34:14 wikitech-static check_icinga[12453]: 2021-11-07 22:34:14,322 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:34:17 wikitech-static check_icinga[12453]: 2021-11-07 22:34:17,043 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:36:01 wikitech-static CRON[12531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:36:01 wikitech-static CRON[12532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:36:02 wikitech-static check_icinga[12534]: 2021-11-07 22:36:02,204 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:36:02 wikitech-static check_icinga[12533]: 2021-11-07 22:36:02,209 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:36:05 wikitech-static check_icinga[12533]: 2021-11-07 22:36:05,027 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:36:05 wikitech-static check_icinga[12534]: 2021-11-07 22:36:05,530 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:38:01 wikitech-static CRON[12613]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:38:01 wikitech-static CRON[12614]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:38:02 wikitech-static check_icinga[12616]: 2021-11-07 22:38:02,639 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:38:02 wikitech-static check_icinga[12615]: 2021-11-07 22:38:02,666 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:38:05 wikitech-static check_icinga[12615]: 2021-11-07 22:38:05,454 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:38:05 wikitech-static check_icinga[12616]: 2021-11-07 22:38:05,679 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:39:01 wikitech-static CRON[12695]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 22:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 22:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 22:40:01 wikitech-static CRON[12820]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:40:01 wikitech-static CRON[12821]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:40:02 wikitech-static check_icinga[12823]: 2021-11-07 22:40:02,897 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:40:02 wikitech-static check_icinga[12822]: 2021-11-07 22:40:02,898 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:40:05 wikitech-static check_icinga[12822]: 2021-11-07 22:40:05,745 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:40:06 wikitech-static check_icinga[12823]: 2021-11-07 22:40:06,191 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:42:01 wikitech-static CRON[12898]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:42:01 wikitech-static CRON[12899]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:42:02 wikitech-static check_icinga[12900]: 2021-11-07 22:42:02,357 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:42:02 wikitech-static check_icinga[12901]: 2021-11-07 22:42:02,367 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:42:05 wikitech-static check_icinga[12900]: 2021-11-07 22:42:05,138 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:42:05 wikitech-static check_icinga[12901]: 2021-11-07 22:42:05,548 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:44:01 wikitech-static CRON[12973]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:44:01 wikitech-static CRON[12974]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:44:02 wikitech-static check_icinga[12975]: 2021-11-07 22:44:02,678 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:44:02 wikitech-static check_icinga[12976]: 2021-11-07 22:44:02,682 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:44:05 wikitech-static check_icinga[12975]: 2021-11-07 22:44:05,426 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:44:05 wikitech-static check_icinga[12976]: 2021-11-07 22:44:05,801 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:46:01 wikitech-static CRON[13051]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:46:01 wikitech-static CRON[13052]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:46:02 wikitech-static check_icinga[13053]: 2021-11-07 22:46:02,957 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:46:02 wikitech-static check_icinga[13054]: 2021-11-07 22:46:02,972 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:46:05 wikitech-static check_icinga[13053]: 2021-11-07 22:46:05,934 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:46:06 wikitech-static check_icinga[13054]: 2021-11-07 22:46:06,259 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:48:01 wikitech-static CRON[13129]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:48:01 wikitech-static CRON[13130]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:48:02 wikitech-static check_icinga[13131]: 2021-11-07 22:48:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:48:02 wikitech-static check_icinga[13132]: 2021-11-07 22:48:02,417 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:48:05 wikitech-static check_icinga[13131]: 2021-11-07 22:48:05,326 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:48:05 wikitech-static check_icinga[13132]: 2021-11-07 22:48:05,746 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:50:01 wikitech-static CRON[13207]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:50:01 wikitech-static CRON[13208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:50:02 wikitech-static check_icinga[13210]: 2021-11-07 22:50:02,886 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:50:02 wikitech-static check_icinga[13209]: 2021-11-07 22:50:02,956 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:50:05 wikitech-static check_icinga[13210]: 2021-11-07 22:50:05,898 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:50:06 wikitech-static check_icinga[13209]: 2021-11-07 22:50:06,159 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:52:01 wikitech-static CRON[13283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:52:01 wikitech-static CRON[13284]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:52:02 wikitech-static check_icinga[13286]: 2021-11-07 22:52:02,288 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:52:02 wikitech-static check_icinga[13285]: 2021-11-07 22:52:02,314 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:52:05 wikitech-static check_icinga[13286]: 2021-11-07 22:52:05,384 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:52:05 wikitech-static check_icinga[13285]: 2021-11-07 22:52:05,405 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:54:01 wikitech-static CRON[13361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:54:01 wikitech-static CRON[13362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:54:02 wikitech-static check_icinga[13364]: 2021-11-07 22:54:02,641 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:54:02 wikitech-static check_icinga[13363]: 2021-11-07 22:54:02,720 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:54:05 wikitech-static check_icinga[13364]: 2021-11-07 22:54:05,827 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:54:05 wikitech-static check_icinga[13363]: 2021-11-07 22:54:05,839 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:56:01 wikitech-static CRON[13436]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:56:01 wikitech-static CRON[13437]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:56:03 wikitech-static check_icinga[13438]: 2021-11-07 22:56:03,041 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:56:03 wikitech-static check_icinga[13439]: 2021-11-07 22:56:03,048 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:56:06 wikitech-static check_icinga[13439]: 2021-11-07 22:56:06,218 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 22:56:06 wikitech-static check_icinga[13438]: 2021-11-07 22:56:06,248 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:58:01 wikitech-static CRON[13532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 22:58:01 wikitech-static CRON[13533]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 22:58:02 wikitech-static check_icinga[13534]: 2021-11-07 22:58:02,456 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 22:58:02 wikitech-static check_icinga[13535]: 2021-11-07 22:58:02,487 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 22:58:05 wikitech-static check_icinga[13534]: 2021-11-07 22:58:05,484 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 22:58:05 wikitech-static check_icinga[13535]: 2021-11-07 22:58:05,653 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:00:01 wikitech-static CRON[13620]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:00:01 wikitech-static CRON[13621]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:00:02 wikitech-static check_icinga[13622]: 2021-11-07 23:00:02,822 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:00:02 wikitech-static check_icinga[13623]: 2021-11-07 23:00:02,894 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:00:05 wikitech-static check_icinga[13622]: 2021-11-07 23:00:05,765 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:00:06 wikitech-static check_icinga[13623]: 2021-11-07 23:00:06,150 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:02:01 wikitech-static CRON[13721]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:02:01 wikitech-static CRON[13722]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:02:02 wikitech-static check_icinga[13723]: 2021-11-07 23:02:02,378 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:02:02 wikitech-static check_icinga[13724]: 2021-11-07 23:02:02,386 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:02:05 wikitech-static check_icinga[13724]: 2021-11-07 23:02:05,390 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:02:05 wikitech-static check_icinga[13723]: 2021-11-07 23:02:05,688 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:04:01 wikitech-static CRON[13799]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:04:01 wikitech-static CRON[13800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:04:02 wikitech-static check_icinga[13801]: 2021-11-07 23:04:02,824 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:04:02 wikitech-static check_icinga[13802]: 2021-11-07 23:04:02,825 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:04:05 wikitech-static check_icinga[13801]: 2021-11-07 23:04:05,825 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:04:05 wikitech-static check_icinga[13802]: 2021-11-07 23:04:05,853 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:06:02 wikitech-static CRON[13877]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:06:02 wikitech-static CRON[13878]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:06:03 wikitech-static check_icinga[13879]: 2021-11-07 23:06:03,142 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:06:03 wikitech-static check_icinga[13880]: 2021-11-07 23:06:03,170 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:06:06 wikitech-static check_icinga[13879]: 2021-11-07 23:06:06,292 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:06:06 wikitech-static check_icinga[13880]: 2021-11-07 23:06:06,484 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:08:01 wikitech-static CRON[13956]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:08:01 wikitech-static CRON[13957]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:08:02 wikitech-static check_icinga[13958]: 2021-11-07 23:08:02,609 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:08:02 wikitech-static check_icinga[13959]: 2021-11-07 23:08:02,612 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:08:05 wikitech-static check_icinga[13958]: 2021-11-07 23:08:05,666 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:08:05 wikitech-static check_icinga[13959]: 2021-11-07 23:08:05,796 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:09:01 wikitech-static CRON[14003]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 23:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 23:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 7 23:10:01 wikitech-static CRON[14157]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:10:01 wikitech-static CRON[14158]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:10:02 wikitech-static check_icinga[14159]: 2021-11-07 23:10:02,966 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:10:02 wikitech-static check_icinga[14160]: 2021-11-07 23:10:02,969 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:10:06 wikitech-static check_icinga[14159]: 2021-11-07 23:10:06,094 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:10:06 wikitech-static check_icinga[14160]: 2021-11-07 23:10:06,179 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:12:01 wikitech-static CRON[14238]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:12:01 wikitech-static CRON[14239]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:12:02 wikitech-static check_icinga[14241]: 2021-11-07 23:12:02,341 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:12:02 wikitech-static check_icinga[14240]: 2021-11-07 23:12:02,345 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:12:05 wikitech-static check_icinga[14240]: 2021-11-07 23:12:05,598 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:12:05 wikitech-static check_icinga[14241]: 2021-11-07 23:12:05,657 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:14:01 wikitech-static CRON[14313]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:14:01 wikitech-static CRON[14314]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:14:02 wikitech-static check_icinga[14315]: 2021-11-07 23:14:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:14:02 wikitech-static check_icinga[14316]: 2021-11-07 23:14:02,801 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:14:05 wikitech-static check_icinga[14316]: 2021-11-07 23:14:05,972 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:14:06 wikitech-static check_icinga[14315]: 2021-11-07 23:14:06,069 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:16:01 wikitech-static CRON[14388]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:16:01 wikitech-static CRON[14389]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:16:02 wikitech-static check_icinga[14391]: 2021-11-07 23:16:02,945 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:16:02 wikitech-static check_icinga[14390]: 2021-11-07 23:16:02,966 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:16:06 wikitech-static check_icinga[14390]: 2021-11-07 23:16:06,133 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:16:06 wikitech-static check_icinga[14391]: 2021-11-07 23:16:06,183 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:17:01 wikitech-static CRON[14466]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 7 23:18:01 wikitech-static CRON[14497]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:18:01 wikitech-static CRON[14498]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:18:02 wikitech-static check_icinga[14499]: 2021-11-07 23:18:02,850 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:18:02 wikitech-static check_icinga[14500]: 2021-11-07 23:18:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:18:06 wikitech-static check_icinga[14499]: 2021-11-07 23:18:06,041 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:18:06 wikitech-static check_icinga[14500]: 2021-11-07 23:18:06,140 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:20:01 wikitech-static CRON[14584]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:20:01 wikitech-static CRON[14585]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:20:02 wikitech-static check_icinga[14587]: 2021-11-07 23:20:02,290 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:20:02 wikitech-static check_icinga[14586]: 2021-11-07 23:20:02,296 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:20:05 wikitech-static check_icinga[14586]: 2021-11-07 23:20:05,418 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:20:05 wikitech-static check_icinga[14587]: 2021-11-07 23:20:05,498 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:22:01 wikitech-static CRON[14683]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:22:01 wikitech-static CRON[14684]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:22:02 wikitech-static check_icinga[14685]: 2021-11-07 23:22:02,621 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:22:02 wikitech-static check_icinga[14686]: 2021-11-07 23:22:02,648 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:22:05 wikitech-static check_icinga[14685]: 2021-11-07 23:22:05,639 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:22:05 wikitech-static check_icinga[14686]: 2021-11-07 23:22:05,733 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:24:01 wikitech-static CRON[14763]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:24:01 wikitech-static CRON[14764]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:24:02 wikitech-static check_icinga[14766]: 2021-11-07 23:24:02,886 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:24:02 wikitech-static check_icinga[14765]: 2021-11-07 23:24:02,894 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:24:06 wikitech-static check_icinga[14766]: 2021-11-07 23:24:06,013 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:24:06 wikitech-static check_icinga[14765]: 2021-11-07 23:24:06,223 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:26:01 wikitech-static CRON[14856]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:26:01 wikitech-static CRON[14857]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:26:02 wikitech-static check_icinga[14858]: 2021-11-07 23:26:02,367 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:26:02 wikitech-static check_icinga[14859]: 2021-11-07 23:26:02,373 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:26:05 wikitech-static check_icinga[14858]: 2021-11-07 23:26:05,587 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:26:05 wikitech-static check_icinga[14859]: 2021-11-07 23:26:05,674 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:28:01 wikitech-static CRON[14954]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:28:01 wikitech-static CRON[14955]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:28:02 wikitech-static check_icinga[14956]: 2021-11-07 23:28:02,817 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:28:02 wikitech-static check_icinga[14957]: 2021-11-07 23:28:02,820 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:28:05 wikitech-static check_icinga[14956]: 2021-11-07 23:28:05,884 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:28:06 wikitech-static check_icinga[14957]: 2021-11-07 23:28:06,160 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:30:01 wikitech-static CRON[15029]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:30:01 wikitech-static CRON[15030]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:30:02 wikitech-static check_icinga[15032]: 2021-11-07 23:30:02,320 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:30:02 wikitech-static check_icinga[15031]: 2021-11-07 23:30:02,324 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:30:05 wikitech-static check_icinga[15031]: 2021-11-07 23:30:05,396 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:30:05 wikitech-static check_icinga[15032]: 2021-11-07 23:30:05,610 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:32:01 wikitech-static CRON[15105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:32:01 wikitech-static CRON[15106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:32:02 wikitech-static check_icinga[15108]: 2021-11-07 23:32:02,729 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:32:02 wikitech-static check_icinga[15107]: 2021-11-07 23:32:02,764 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:32:05 wikitech-static check_icinga[15107]: 2021-11-07 23:32:05,684 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:32:05 wikitech-static check_icinga[15108]: 2021-11-07 23:32:05,930 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:34:01 wikitech-static CRON[15181]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:34:01 wikitech-static CRON[15182]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:34:02 wikitech-static check_icinga[15183]: 2021-11-07 23:34:02,095 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:34:02 wikitech-static check_icinga[15184]: 2021-11-07 23:34:02,168 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:34:03 wikitech-static check_icinga[15183]: 2021-11-07 23:34:03,484 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)'] Nov 7 23:34:05 wikitech-static check_icinga[15184]: 2021-11-07 23:34:05,323 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:34:13 wikitech-static check_icinga[15183]: 2021-11-07 23:34:13,595 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:34:16 wikitech-static check_icinga[15183]: 2021-11-07 23:34:16,144 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:36:01 wikitech-static CRON[15258]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:36:01 wikitech-static CRON[15259]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:36:02 wikitech-static check_icinga[15261]: 2021-11-07 23:36:02,282 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:36:02 wikitech-static check_icinga[15260]: 2021-11-07 23:36:02,285 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:36:04 wikitech-static check_icinga[15260]: 2021-11-07 23:36:04,975 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:36:05 wikitech-static check_icinga[15261]: 2021-11-07 23:36:05,668 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:38:01 wikitech-static CRON[15333]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:38:01 wikitech-static CRON[15334]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:38:02 wikitech-static check_icinga[15335]: 2021-11-07 23:38:02,949 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:38:02 wikitech-static check_icinga[15336]: 2021-11-07 23:38:02,953 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:38:05 wikitech-static check_icinga[15335]: 2021-11-07 23:38:05,781 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:38:06 wikitech-static check_icinga[15336]: 2021-11-07 23:38:06,201 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:39:01 wikitech-static CRON[15380]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 7 23:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 7 23:39:06 wikitech-static systemd[1]: Started Clean php session files. Nov 7 23:40:01 wikitech-static CRON[15521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:40:01 wikitech-static CRON[15522]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:40:02 wikitech-static check_icinga[15524]: 2021-11-07 23:40:02,626 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:40:02 wikitech-static check_icinga[15523]: 2021-11-07 23:40:02,697 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:40:05 wikitech-static check_icinga[15523]: 2021-11-07 23:40:05,470 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:40:05 wikitech-static check_icinga[15524]: 2021-11-07 23:40:05,912 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:42:01 wikitech-static CRON[15596]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:42:01 wikitech-static CRON[15597]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:42:03 wikitech-static check_icinga[15599]: 2021-11-07 23:42:03,021 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:42:03 wikitech-static check_icinga[15598]: 2021-11-07 23:42:03,118 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:42:05 wikitech-static check_icinga[15598]: 2021-11-07 23:42:05,906 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:42:06 wikitech-static check_icinga[15599]: 2021-11-07 23:42:06,278 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:44:01 wikitech-static CRON[15677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:44:01 wikitech-static CRON[15678]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:44:02 wikitech-static check_icinga[15680]: 2021-11-07 23:44:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:44:02 wikitech-static check_icinga[15679]: 2021-11-07 23:44:02,428 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:44:05 wikitech-static check_icinga[15679]: 2021-11-07 23:44:05,286 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:44:05 wikitech-static check_icinga[15680]: 2021-11-07 23:44:05,564 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:46:01 wikitech-static CRON[15801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:46:01 wikitech-static CRON[15802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:46:03 wikitech-static check_icinga[15804]: 2021-11-07 23:46:03,192 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:46:03 wikitech-static check_icinga[15803]: 2021-11-07 23:46:03,194 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:46:06 wikitech-static check_icinga[15803]: 2021-11-07 23:46:06,162 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:46:06 wikitech-static check_icinga[15804]: 2021-11-07 23:46:06,326 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:48:01 wikitech-static CRON[15893]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:48:01 wikitech-static CRON[15894]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:48:02 wikitech-static check_icinga[15896]: 2021-11-07 23:48:02,460 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:48:02 wikitech-static check_icinga[15895]: 2021-11-07 23:48:02,469 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:48:05 wikitech-static check_icinga[15895]: 2021-11-07 23:48:05,369 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:48:05 wikitech-static check_icinga[15896]: 2021-11-07 23:48:05,682 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:50:01 wikitech-static CRON[15972]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:50:01 wikitech-static CRON[15973]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:50:02 wikitech-static check_icinga[15974]: 2021-11-07 23:50:02,821 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:50:02 wikitech-static check_icinga[15975]: 2021-11-07 23:50:02,828 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:50:05 wikitech-static check_icinga[15974]: 2021-11-07 23:50:05,747 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:50:05 wikitech-static check_icinga[15975]: 2021-11-07 23:50:05,875 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:52:01 wikitech-static CRON[16054]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:52:01 wikitech-static CRON[16055]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:52:03 wikitech-static check_icinga[16057]: 2021-11-07 23:52:03,102 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:52:03 wikitech-static check_icinga[16056]: 2021-11-07 23:52:03,105 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:52:05 wikitech-static check_icinga[16056]: 2021-11-07 23:52:05,975 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:52:06 wikitech-static check_icinga[16057]: 2021-11-07 23:52:06,332 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:54:01 wikitech-static CRON[16136]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:54:01 wikitech-static CRON[16137]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:54:02 wikitech-static check_icinga[16138]: 2021-11-07 23:54:02,478 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:54:02 wikitech-static check_icinga[16139]: 2021-11-07 23:54:02,508 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:54:05 wikitech-static check_icinga[16138]: 2021-11-07 23:54:05,270 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:54:05 wikitech-static check_icinga[16139]: 2021-11-07 23:54:05,657 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:56:01 wikitech-static CRON[16213]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:56:01 wikitech-static CRON[16214]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:56:02 wikitech-static check_icinga[16215]: 2021-11-07 23:56:02,808 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:56:02 wikitech-static check_icinga[16216]: 2021-11-07 23:56:02,839 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:56:05 wikitech-static check_icinga[16215]: 2021-11-07 23:56:05,852 [INFO] Check for host alert2001.wikimedia.org: OK Nov 7 23:56:05 wikitech-static check_icinga[16216]: 2021-11-07 23:56:05,952 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:58:01 wikitech-static CRON[16294]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 7 23:58:01 wikitech-static CRON[16295]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 7 23:58:02 wikitech-static check_icinga[16296]: 2021-11-07 23:58:02,114 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 7 23:58:02 wikitech-static check_icinga[16297]: 2021-11-07 23:58:02,117 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 7 23:58:05 wikitech-static check_icinga[16297]: 2021-11-07 23:58:05,364 [INFO] Check for host alert1001.wikimedia.org: OK Nov 7 23:58:05 wikitech-static check_icinga[16296]: 2021-11-07 23:58:05,427 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:00:01 wikitech-static CRON[16377]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:00:01 wikitech-static CRON[16378]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:00:02 wikitech-static check_icinga[16380]: 2021-11-08 00:00:02,597 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:00:02 wikitech-static check_icinga[16379]: 2021-11-08 00:00:02,627 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:00:05 wikitech-static check_icinga[16379]: 2021-11-08 00:00:05,409 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:00:05 wikitech-static check_icinga[16380]: 2021-11-08 00:00:05,725 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:02:01 wikitech-static CRON[16456]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:02:01 wikitech-static CRON[16457]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:02:02 wikitech-static check_icinga[16459]: 2021-11-08 00:02:02,837 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:02:02 wikitech-static check_icinga[16458]: 2021-11-08 00:02:02,840 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:02:05 wikitech-static check_icinga[16458]: 2021-11-08 00:02:05,679 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:02:06 wikitech-static check_icinga[16459]: 2021-11-08 00:02:06,162 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:04:01 wikitech-static CRON[16541]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:04:01 wikitech-static CRON[16542]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:04:02 wikitech-static check_icinga[16544]: 2021-11-08 00:04:02,291 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:04:02 wikitech-static check_icinga[16543]: 2021-11-08 00:04:02,377 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:04:05 wikitech-static check_icinga[16544]: 2021-11-08 00:04:05,293 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:04:05 wikitech-static check_icinga[16543]: 2021-11-08 00:04:05,378 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:06:01 wikitech-static CRON[16620]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:06:01 wikitech-static CRON[16621]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:06:02 wikitech-static check_icinga[16622]: 2021-11-08 00:06:02,530 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:06:02 wikitech-static check_icinga[16623]: 2021-11-08 00:06:02,552 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:06:05 wikitech-static check_icinga[16622]: 2021-11-08 00:06:05,626 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:06:05 wikitech-static check_icinga[16623]: 2021-11-08 00:06:05,768 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:08:01 wikitech-static CRON[16698]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:08:01 wikitech-static CRON[16699]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:08:02 wikitech-static check_icinga[16700]: 2021-11-08 00:08:02,881 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:08:02 wikitech-static check_icinga[16701]: 2021-11-08 00:08:02,982 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:08:05 wikitech-static check_icinga[16700]: 2021-11-08 00:08:05,837 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:08:06 wikitech-static check_icinga[16701]: 2021-11-08 00:08:06,207 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:09:01 wikitech-static CRON[16748]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 00:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 00:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 8 00:10:01 wikitech-static CRON[16870]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:10:01 wikitech-static CRON[16871]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:10:02 wikitech-static check_icinga[16872]: 2021-11-08 00:10:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:10:02 wikitech-static check_icinga[16873]: 2021-11-08 00:10:02,418 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:10:05 wikitech-static check_icinga[16872]: 2021-11-08 00:10:05,346 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:10:05 wikitech-static check_icinga[16873]: 2021-11-08 00:10:05,474 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:11:01 wikitech-static CRON[16934]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 8 00:11:02 wikitech-static check_icinga_validate_config[16935]: Valid config, nothing to do. Nov 8 00:12:01 wikitech-static CRON[16967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:12:01 wikitech-static CRON[16968]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:12:02 wikitech-static check_icinga[16969]: 2021-11-08 00:12:02,335 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:12:02 wikitech-static check_icinga[16970]: 2021-11-08 00:12:02,338 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:12:05 wikitech-static check_icinga[16969]: 2021-11-08 00:12:05,437 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:12:05 wikitech-static check_icinga[16970]: 2021-11-08 00:12:05,547 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:14:01 wikitech-static CRON[17043]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:14:01 wikitech-static CRON[17044]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:14:02 wikitech-static check_icinga[17046]: 2021-11-08 00:14:02,669 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:14:02 wikitech-static check_icinga[17045]: 2021-11-08 00:14:02,671 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:14:05 wikitech-static check_icinga[17045]: 2021-11-08 00:14:05,674 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:14:05 wikitech-static check_icinga[17046]: 2021-11-08 00:14:05,895 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:16:01 wikitech-static CRON[17118]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:16:01 wikitech-static CRON[17119]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:16:03 wikitech-static check_icinga[17120]: 2021-11-08 00:16:03,039 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:16:03 wikitech-static check_icinga[17121]: 2021-11-08 00:16:03,071 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:16:06 wikitech-static check_icinga[17120]: 2021-11-08 00:16:06,021 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:16:06 wikitech-static check_icinga[17121]: 2021-11-08 00:16:06,343 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:17:01 wikitech-static CRON[17172]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 8 00:18:01 wikitech-static CRON[17205]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:18:01 wikitech-static CRON[17206]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:18:02 wikitech-static check_icinga[17207]: 2021-11-08 00:18:02,482 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:18:02 wikitech-static check_icinga[17208]: 2021-11-08 00:18:02,505 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:18:05 wikitech-static check_icinga[17207]: 2021-11-08 00:18:05,367 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:18:05 wikitech-static check_icinga[17208]: 2021-11-08 00:18:05,479 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:20:01 wikitech-static CRON[17286]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:20:01 wikitech-static CRON[17287]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:20:02 wikitech-static check_icinga[17288]: 2021-11-08 00:20:02,610 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:20:02 wikitech-static check_icinga[17289]: 2021-11-08 00:20:02,613 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:20:05 wikitech-static check_icinga[17289]: 2021-11-08 00:20:05,718 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:20:05 wikitech-static check_icinga[17288]: 2021-11-08 00:20:05,975 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:22:01 wikitech-static CRON[17361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:22:01 wikitech-static CRON[17362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:22:02 wikitech-static check_icinga[17364]: 2021-11-08 00:22:02,117 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:22:02 wikitech-static check_icinga[17363]: 2021-11-08 00:22:02,143 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:22:05 wikitech-static check_icinga[17363]: 2021-11-08 00:22:05,176 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:22:05 wikitech-static check_icinga[17364]: 2021-11-08 00:22:05,273 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:24:01 wikitech-static CRON[17436]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:24:01 wikitech-static CRON[17437]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:24:02 wikitech-static check_icinga[17438]: 2021-11-08 00:24:02,404 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:24:02 wikitech-static check_icinga[17439]: 2021-11-08 00:24:02,409 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:24:05 wikitech-static check_icinga[17438]: 2021-11-08 00:24:05,462 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:24:05 wikitech-static check_icinga[17439]: 2021-11-08 00:24:05,577 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:26:01 wikitech-static CRON[17514]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:26:01 wikitech-static CRON[17515]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:26:02 wikitech-static check_icinga[17516]: 2021-11-08 00:26:02,716 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:26:02 wikitech-static check_icinga[17517]: 2021-11-08 00:26:02,729 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:26:05 wikitech-static check_icinga[17516]: 2021-11-08 00:26:05,833 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:26:05 wikitech-static check_icinga[17517]: 2021-11-08 00:26:05,888 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:28:02 wikitech-static CRON[17592]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:28:02 wikitech-static CRON[17593]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:28:03 wikitech-static check_icinga[17594]: 2021-11-08 00:28:03,093 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:28:03 wikitech-static check_icinga[17595]: 2021-11-08 00:28:03,118 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:28:06 wikitech-static check_icinga[17594]: 2021-11-08 00:28:06,154 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:28:06 wikitech-static check_icinga[17595]: 2021-11-08 00:28:06,257 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:30:01 wikitech-static CRON[17669]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:30:01 wikitech-static CRON[17670]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:30:02 wikitech-static check_icinga[17671]: 2021-11-08 00:30:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:30:02 wikitech-static check_icinga[17672]: 2021-11-08 00:30:02,397 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:30:05 wikitech-static check_icinga[17671]: 2021-11-08 00:30:05,415 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:30:05 wikitech-static check_icinga[17672]: 2021-11-08 00:30:05,502 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:32:01 wikitech-static CRON[17744]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:32:01 wikitech-static CRON[17745]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:32:02 wikitech-static check_icinga[17747]: 2021-11-08 00:32:02,593 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:32:02 wikitech-static check_icinga[17746]: 2021-11-08 00:32:02,619 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:32:05 wikitech-static check_icinga[17747]: 2021-11-08 00:32:05,731 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:32:05 wikitech-static check_icinga[17746]: 2021-11-08 00:32:05,801 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:34:01 wikitech-static CRON[17839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:34:01 wikitech-static CRON[17840]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:34:03 wikitech-static check_icinga[17842]: 2021-11-08 00:34:03,017 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:34:03 wikitech-static check_icinga[17841]: 2021-11-08 00:34:03,025 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:34:04 wikitech-static check_icinga[17841]: 2021-11-08 00:34:04,424 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)'] Nov 8 00:34:06 wikitech-static check_icinga[17842]: 2021-11-08 00:34:06,162 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:34:14 wikitech-static check_icinga[17841]: 2021-11-08 00:34:14,463 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:34:17 wikitech-static check_icinga[17841]: 2021-11-08 00:34:17,328 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:36:01 wikitech-static CRON[17934]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:36:01 wikitech-static CRON[17935]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:36:02 wikitech-static check_icinga[17936]: 2021-11-08 00:36:02,433 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:36:02 wikitech-static check_icinga[17937]: 2021-11-08 00:36:02,431 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:36:05 wikitech-static check_icinga[17936]: 2021-11-08 00:36:05,179 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:36:05 wikitech-static check_icinga[17937]: 2021-11-08 00:36:05,609 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:38:01 wikitech-static CRON[18010]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:38:01 wikitech-static CRON[18011]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:38:02 wikitech-static check_icinga[18012]: 2021-11-08 00:38:02,750 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:38:02 wikitech-static check_icinga[18013]: 2021-11-08 00:38:02,753 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:38:05 wikitech-static check_icinga[18012]: 2021-11-08 00:38:05,501 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:38:05 wikitech-static check_icinga[18013]: 2021-11-08 00:38:05,966 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:39:01 wikitech-static CRON[18057]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 00:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 00:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 8 00:40:01 wikitech-static CRON[18179]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:40:01 wikitech-static CRON[18180]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:40:02 wikitech-static check_icinga[18181]: 2021-11-08 00:40:02,132 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:40:02 wikitech-static check_icinga[18182]: 2021-11-08 00:40:02,153 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:40:04 wikitech-static check_icinga[18181]: 2021-11-08 00:40:04,803 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:40:05 wikitech-static check_icinga[18182]: 2021-11-08 00:40:05,521 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:42:01 wikitech-static CRON[18254]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:42:01 wikitech-static CRON[18255]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:42:02 wikitech-static check_icinga[18256]: 2021-11-08 00:42:02,653 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:42:02 wikitech-static check_icinga[18257]: 2021-11-08 00:42:02,657 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:42:05 wikitech-static check_icinga[18256]: 2021-11-08 00:42:05,339 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:42:05 wikitech-static check_icinga[18257]: 2021-11-08 00:42:05,920 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:44:01 wikitech-static CRON[18334]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:44:01 wikitech-static CRON[18335]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:44:03 wikitech-static check_icinga[18337]: 2021-11-08 00:44:03,079 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:44:03 wikitech-static check_icinga[18336]: 2021-11-08 00:44:03,085 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:44:05 wikitech-static check_icinga[18336]: 2021-11-08 00:44:05,836 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:44:06 wikitech-static check_icinga[18337]: 2021-11-08 00:44:06,215 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:46:01 wikitech-static CRON[18409]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:46:01 wikitech-static CRON[18410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:46:02 wikitech-static check_icinga[18412]: 2021-11-08 00:46:02,661 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:46:02 wikitech-static check_icinga[18411]: 2021-11-08 00:46:02,753 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:46:05 wikitech-static check_icinga[18412]: 2021-11-08 00:46:05,599 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:46:06 wikitech-static check_icinga[18411]: 2021-11-08 00:46:06,195 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:48:01 wikitech-static CRON[18488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:48:01 wikitech-static CRON[18489]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:48:02 wikitech-static check_icinga[18491]: 2021-11-08 00:48:02,347 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:48:02 wikitech-static check_icinga[18490]: 2021-11-08 00:48:02,422 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:48:05 wikitech-static check_icinga[18490]: 2021-11-08 00:48:05,438 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:48:05 wikitech-static check_icinga[18491]: 2021-11-08 00:48:05,571 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:50:01 wikitech-static CRON[18563]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:50:01 wikitech-static CRON[18564]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:50:02 wikitech-static check_icinga[18566]: 2021-11-08 00:50:02,694 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:50:02 wikitech-static check_icinga[18565]: 2021-11-08 00:50:02,723 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:50:05 wikitech-static check_icinga[18565]: 2021-11-08 00:50:05,920 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:50:06 wikitech-static check_icinga[18566]: 2021-11-08 00:50:06,035 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:52:01 wikitech-static CRON[18643]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:52:01 wikitech-static CRON[18645]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:52:02 wikitech-static check_icinga[18644]: 2021-11-08 00:52:02,167 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:52:02 wikitech-static check_icinga[18646]: 2021-11-08 00:52:02,212 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:52:05 wikitech-static check_icinga[18644]: 2021-11-08 00:52:05,291 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:52:05 wikitech-static check_icinga[18646]: 2021-11-08 00:52:05,552 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:54:01 wikitech-static CRON[18722]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:54:01 wikitech-static CRON[18723]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:54:02 wikitech-static check_icinga[18724]: 2021-11-08 00:54:02,667 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:54:02 wikitech-static check_icinga[18725]: 2021-11-08 00:54:02,669 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:54:05 wikitech-static check_icinga[18724]: 2021-11-08 00:54:05,686 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:54:05 wikitech-static check_icinga[18725]: 2021-11-08 00:54:05,771 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:56:01 wikitech-static CRON[18801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:56:01 wikitech-static CRON[18802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:56:02 wikitech-static check_icinga[18804]: 2021-11-08 00:56:02,910 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:56:02 wikitech-static check_icinga[18803]: 2021-11-08 00:56:02,916 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:56:05 wikitech-static check_icinga[18803]: 2021-11-08 00:56:05,892 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 00:56:05 wikitech-static check_icinga[18804]: 2021-11-08 00:56:05,939 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:58:01 wikitech-static CRON[18876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 00:58:01 wikitech-static CRON[18877]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 00:58:02 wikitech-static check_icinga[18878]: 2021-11-08 00:58:02,150 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 00:58:02 wikitech-static check_icinga[18879]: 2021-11-08 00:58:02,154 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 00:58:05 wikitech-static check_icinga[18878]: 2021-11-08 00:58:05,205 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 00:58:05 wikitech-static check_icinga[18879]: 2021-11-08 00:58:05,336 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:00:01 wikitech-static CRON[18954]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:00:01 wikitech-static CRON[18955]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:00:02 wikitech-static check_icinga[18956]: 2021-11-08 01:00:02,454 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:00:02 wikitech-static check_icinga[18957]: 2021-11-08 01:00:02,464 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:00:05 wikitech-static check_icinga[18956]: 2021-11-08 01:00:05,576 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:00:05 wikitech-static check_icinga[18957]: 2021-11-08 01:00:05,663 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:02:01 wikitech-static CRON[19110]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:02:01 wikitech-static CRON[19111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:02:03 wikitech-static check_icinga[19112]: 2021-11-08 01:02:03,285 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:02:03 wikitech-static check_icinga[19113]: 2021-11-08 01:02:03,308 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:02:06 wikitech-static check_icinga[19113]: 2021-11-08 01:02:06,278 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:02:06 wikitech-static check_icinga[19112]: 2021-11-08 01:02:06,488 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:04:01 wikitech-static CRON[19204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:04:01 wikitech-static CRON[19205]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:04:02 wikitech-static check_icinga[19207]: 2021-11-08 01:04:02,881 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:04:02 wikitech-static check_icinga[19206]: 2021-11-08 01:04:02,882 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:04:05 wikitech-static check_icinga[19207]: 2021-11-08 01:04:05,912 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:04:05 wikitech-static check_icinga[19206]: 2021-11-08 01:04:05,972 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:06:01 wikitech-static CRON[19282]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:06:01 wikitech-static CRON[19283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:06:02 wikitech-static check_icinga[19284]: 2021-11-08 01:06:02,164 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:06:02 wikitech-static check_icinga[19285]: 2021-11-08 01:06:02,169 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:06:05 wikitech-static check_icinga[19285]: 2021-11-08 01:06:05,276 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:06:05 wikitech-static check_icinga[19284]: 2021-11-08 01:06:05,500 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:08:01 wikitech-static CRON[19361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:08:01 wikitech-static CRON[19362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:08:02 wikitech-static check_icinga[19363]: 2021-11-08 01:08:02,658 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:08:02 wikitech-static check_icinga[19364]: 2021-11-08 01:08:02,660 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:08:05 wikitech-static check_icinga[19364]: 2021-11-08 01:08:05,765 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:08:05 wikitech-static check_icinga[19363]: 2021-11-08 01:08:05,770 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:09:01 wikitech-static CRON[19408]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 01:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 01:09:07 wikitech-static systemd[1]: Started Clean php session files. Nov 8 01:10:01 wikitech-static CRON[19531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:10:01 wikitech-static CRON[19532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:10:02 wikitech-static check_icinga[19534]: 2021-11-08 01:10:02,993 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:10:03 wikitech-static check_icinga[19533]: 2021-11-08 01:10:03,090 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:10:06 wikitech-static check_icinga[19533]: 2021-11-08 01:10:06,180 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:10:06 wikitech-static check_icinga[19534]: 2021-11-08 01:10:06,252 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:12:01 wikitech-static CRON[19606]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:12:01 wikitech-static CRON[19607]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:12:02 wikitech-static check_icinga[19608]: 2021-11-08 01:12:02,403 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:12:02 wikitech-static check_icinga[19609]: 2021-11-08 01:12:02,407 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:12:05 wikitech-static check_icinga[19608]: 2021-11-08 01:12:05,420 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:12:05 wikitech-static check_icinga[19609]: 2021-11-08 01:12:05,700 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:14:01 wikitech-static CRON[19681]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:14:01 wikitech-static CRON[19682]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:14:02 wikitech-static check_icinga[19683]: 2021-11-08 01:14:02,829 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:14:02 wikitech-static check_icinga[19684]: 2021-11-08 01:14:02,846 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:14:05 wikitech-static check_icinga[19683]: 2021-11-08 01:14:05,807 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:14:05 wikitech-static check_icinga[19684]: 2021-11-08 01:14:05,964 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:16:01 wikitech-static CRON[19756]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:16:01 wikitech-static CRON[19757]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:16:02 wikitech-static check_icinga[19758]: 2021-11-08 01:16:02,113 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:16:02 wikitech-static check_icinga[19759]: 2021-11-08 01:16:02,178 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:16:05 wikitech-static check_icinga[19759]: 2021-11-08 01:16:05,283 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:16:05 wikitech-static check_icinga[19758]: 2021-11-08 01:16:05,357 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:17:01 wikitech-static CRON[19803]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 8 01:18:01 wikitech-static CRON[19837]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:18:01 wikitech-static CRON[19838]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:18:02 wikitech-static check_icinga[19840]: 2021-11-08 01:18:02,563 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:18:02 wikitech-static check_icinga[19839]: 2021-11-08 01:18:02,624 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:18:05 wikitech-static check_icinga[19839]: 2021-11-08 01:18:05,697 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:18:05 wikitech-static check_icinga[19840]: 2021-11-08 01:18:05,730 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:20:01 wikitech-static CRON[19915]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:20:01 wikitech-static CRON[19916]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:20:02 wikitech-static check_icinga[19917]: 2021-11-08 01:20:02,922 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:20:02 wikitech-static check_icinga[19918]: 2021-11-08 01:20:02,924 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:20:05 wikitech-static check_icinga[19917]: 2021-11-08 01:20:05,930 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:20:06 wikitech-static check_icinga[19918]: 2021-11-08 01:20:06,241 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:22:01 wikitech-static CRON[19990]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:22:01 wikitech-static CRON[19991]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:22:02 wikitech-static check_icinga[19992]: 2021-11-08 01:22:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:22:02 wikitech-static check_icinga[19993]: 2021-11-08 01:22:02,419 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:22:05 wikitech-static check_icinga[19992]: 2021-11-08 01:22:05,560 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:22:05 wikitech-static check_icinga[19993]: 2021-11-08 01:22:05,609 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:24:01 wikitech-static CRON[20069]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:24:01 wikitech-static CRON[20070]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:24:02 wikitech-static check_icinga[20071]: 2021-11-08 01:24:02,794 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:24:02 wikitech-static check_icinga[20072]: 2021-11-08 01:24:02,798 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:24:05 wikitech-static check_icinga[20071]: 2021-11-08 01:24:05,757 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:24:06 wikitech-static check_icinga[20072]: 2021-11-08 01:24:06,037 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:25:05 wikitech-static systemd[1]: Starting Certbot... Nov 8 01:25:08 wikitech-static systemd[1]: Started Certbot. Nov 8 01:25:08 wikitech-static systemd[1]: certbot.timer: Adding 11h 22min 36.158011s random time. Nov 8 01:25:08 wikitech-static systemd[1]: certbot.timer: Adding 9h 34min 27.917606s random time. Nov 8 01:26:01 wikitech-static CRON[20159]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:26:01 wikitech-static CRON[20160]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:26:02 wikitech-static check_icinga[20162]: 2021-11-08 01:26:02,205 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:26:02 wikitech-static check_icinga[20161]: 2021-11-08 01:26:02,208 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:26:05 wikitech-static check_icinga[20161]: 2021-11-08 01:26:05,339 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:26:05 wikitech-static check_icinga[20162]: 2021-11-08 01:26:05,391 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:28:01 wikitech-static CRON[20234]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:28:01 wikitech-static CRON[20235]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:28:02 wikitech-static check_icinga[20237]: 2021-11-08 01:28:02,581 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:28:02 wikitech-static check_icinga[20236]: 2021-11-08 01:28:02,611 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:28:05 wikitech-static check_icinga[20236]: 2021-11-08 01:28:05,705 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:28:05 wikitech-static check_icinga[20237]: 2021-11-08 01:28:05,776 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:30:01 wikitech-static CRON[20392]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:30:01 wikitech-static CRON[20393]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:30:02 wikitech-static check_icinga[20394]: 2021-11-08 01:30:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:30:02 wikitech-static check_icinga[20395]: 2021-11-08 01:30:02,925 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:30:05 wikitech-static check_icinga[20395]: 2021-11-08 01:30:05,915 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:30:06 wikitech-static check_icinga[20394]: 2021-11-08 01:30:06,165 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:32:01 wikitech-static CRON[20470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:32:01 wikitech-static CRON[20471]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:32:02 wikitech-static check_icinga[20473]: 2021-11-08 01:32:02,287 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:32:02 wikitech-static check_icinga[20472]: 2021-11-08 01:32:02,314 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:32:05 wikitech-static check_icinga[20473]: 2021-11-08 01:32:05,365 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:32:05 wikitech-static check_icinga[20472]: 2021-11-08 01:32:05,433 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:34:01 wikitech-static CRON[20545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:34:01 wikitech-static CRON[20546]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:34:02 wikitech-static check_icinga[20548]: 2021-11-08 01:34:02,557 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:34:02 wikitech-static check_icinga[20547]: 2021-11-08 01:34:02,583 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:34:03 wikitech-static check_icinga[20547]: 2021-11-08 01:34:03,966 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)'] Nov 8 01:34:05 wikitech-static check_icinga[20548]: 2021-11-08 01:34:05,705 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:34:14 wikitech-static check_icinga[20547]: 2021-11-08 01:34:14,005 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:34:16 wikitech-static check_icinga[20547]: 2021-11-08 01:34:16,987 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:36:01 wikitech-static CRON[20623]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:36:01 wikitech-static CRON[20624]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:36:02 wikitech-static check_icinga[20625]: 2021-11-08 01:36:02,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:36:02 wikitech-static check_icinga[20626]: 2021-11-08 01:36:02,149 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:36:04 wikitech-static check_icinga[20625]: 2021-11-08 01:36:04,816 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:36:05 wikitech-static check_icinga[20626]: 2021-11-08 01:36:05,346 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:38:01 wikitech-static CRON[20726]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:38:01 wikitech-static CRON[20727]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:38:02 wikitech-static check_icinga[20729]: 2021-11-08 01:38:02,463 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:38:02 wikitech-static check_icinga[20728]: 2021-11-08 01:38:02,490 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:38:05 wikitech-static check_icinga[20729]: 2021-11-08 01:38:05,287 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:38:05 wikitech-static check_icinga[20728]: 2021-11-08 01:38:05,653 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:39:01 wikitech-static CRON[20773]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 01:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 01:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 8 01:40:01 wikitech-static CRON[20898]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:40:01 wikitech-static CRON[20899]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:40:02 wikitech-static check_icinga[20900]: 2021-11-08 01:40:02,776 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:40:02 wikitech-static check_icinga[20901]: 2021-11-08 01:40:02,800 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:40:05 wikitech-static check_icinga[20900]: 2021-11-08 01:40:05,645 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:40:05 wikitech-static check_icinga[20901]: 2021-11-08 01:40:05,850 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:42:01 wikitech-static CRON[20975]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:42:01 wikitech-static CRON[20976]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:42:03 wikitech-static check_icinga[20978]: 2021-11-08 01:42:03,070 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:42:03 wikitech-static check_icinga[20977]: 2021-11-08 01:42:03,075 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:42:05 wikitech-static check_icinga[20977]: 2021-11-08 01:42:05,963 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:42:06 wikitech-static check_icinga[20978]: 2021-11-08 01:42:06,295 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:44:01 wikitech-static CRON[21050]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:44:01 wikitech-static CRON[21051]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:44:02 wikitech-static check_icinga[21052]: 2021-11-08 01:44:02,454 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:44:02 wikitech-static check_icinga[21053]: 2021-11-08 01:44:02,520 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:44:05 wikitech-static check_icinga[21052]: 2021-11-08 01:44:05,336 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:44:05 wikitech-static check_icinga[21053]: 2021-11-08 01:44:05,658 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:46:01 wikitech-static CRON[21128]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:46:01 wikitech-static CRON[21129]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:46:02 wikitech-static check_icinga[21131]: 2021-11-08 01:46:02,802 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:46:02 wikitech-static check_icinga[21130]: 2021-11-08 01:46:02,806 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:46:05 wikitech-static check_icinga[21130]: 2021-11-08 01:46:05,764 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:46:05 wikitech-static check_icinga[21131]: 2021-11-08 01:46:05,966 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:48:01 wikitech-static CRON[21211]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:48:01 wikitech-static CRON[21212]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:48:02 wikitech-static check_icinga[21214]: 2021-11-08 01:48:02,157 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:48:02 wikitech-static check_icinga[21213]: 2021-11-08 01:48:02,187 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:48:05 wikitech-static check_icinga[21213]: 2021-11-08 01:48:05,307 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:48:05 wikitech-static check_icinga[21214]: 2021-11-08 01:48:05,362 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:50:01 wikitech-static CRON[21286]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:50:01 wikitech-static CRON[21287]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:50:02 wikitech-static check_icinga[21289]: 2021-11-08 01:50:02,536 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:50:02 wikitech-static check_icinga[21288]: 2021-11-08 01:50:02,566 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:50:05 wikitech-static check_icinga[21288]: 2021-11-08 01:50:05,593 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:50:05 wikitech-static check_icinga[21289]: 2021-11-08 01:50:05,738 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:52:01 wikitech-static CRON[21364]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:52:01 wikitech-static CRON[21365]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:52:02 wikitech-static check_icinga[21367]: 2021-11-08 01:52:02,854 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:52:02 wikitech-static check_icinga[21366]: 2021-11-08 01:52:02,953 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:52:06 wikitech-static check_icinga[21367]: 2021-11-08 01:52:06,014 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:52:06 wikitech-static check_icinga[21366]: 2021-11-08 01:52:06,104 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:54:01 wikitech-static CRON[21439]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:54:01 wikitech-static CRON[21440]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:54:02 wikitech-static check_icinga[21442]: 2021-11-08 01:54:02,267 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:54:02 wikitech-static check_icinga[21441]: 2021-11-08 01:54:02,270 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:54:05 wikitech-static check_icinga[21442]: 2021-11-08 01:54:05,471 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:54:05 wikitech-static check_icinga[21441]: 2021-11-08 01:54:05,486 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:56:01 wikitech-static CRON[21518]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:56:01 wikitech-static CRON[21519]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:56:02 wikitech-static check_icinga[21520]: 2021-11-08 01:56:02,681 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:56:02 wikitech-static check_icinga[21521]: 2021-11-08 01:56:02,796 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:56:06 wikitech-static check_icinga[21521]: 2021-11-08 01:56:06,006 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:56:06 wikitech-static check_icinga[21520]: 2021-11-08 01:56:06,105 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 01:58:01 wikitech-static CRON[21597]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 01:58:01 wikitech-static CRON[21598]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 01:58:02 wikitech-static check_icinga[21599]: 2021-11-08 01:58:02,269 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 01:58:02 wikitech-static check_icinga[21600]: 2021-11-08 01:58:02,370 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 01:58:05 wikitech-static check_icinga[21599]: 2021-11-08 01:58:05,493 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 01:58:05 wikitech-static check_icinga[21600]: 2021-11-08 01:58:05,720 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:00:01 wikitech-static CRON[21672]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:00:01 wikitech-static CRON[21673]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:00:02 wikitech-static check_icinga[21675]: 2021-11-08 02:00:02,878 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:00:02 wikitech-static check_icinga[21674]: 2021-11-08 02:00:02,901 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:00:06 wikitech-static check_icinga[21674]: 2021-11-08 02:00:06,147 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:00:06 wikitech-static check_icinga[21675]: 2021-11-08 02:00:06,230 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:02:01 wikitech-static CRON[21747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:02:01 wikitech-static CRON[21748]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:02:02 wikitech-static check_icinga[21749]: 2021-11-08 02:02:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:02:02 wikitech-static check_icinga[21750]: 2021-11-08 02:02:02,394 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:02:05 wikitech-static check_icinga[21749]: 2021-11-08 02:02:05,504 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:02:05 wikitech-static check_icinga[21750]: 2021-11-08 02:02:05,587 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:04:01 wikitech-static CRON[21830]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:04:01 wikitech-static CRON[21832]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:04:02 wikitech-static check_icinga[21831]: 2021-11-08 02:04:02,704 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:04:02 wikitech-static check_icinga[21833]: 2021-11-08 02:04:02,719 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:04:06 wikitech-static check_icinga[21831]: 2021-11-08 02:04:06,008 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:04:06 wikitech-static check_icinga[21833]: 2021-11-08 02:04:06,062 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:04:06 wikitech-static systemd[1]: Starting Cleanup of Temporary Directories... Nov 8 02:04:06 wikitech-static systemd[1]: Started Cleanup of Temporary Directories. Nov 8 02:06:01 wikitech-static CRON[21908]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:06:01 wikitech-static CRON[21909]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:06:02 wikitech-static check_icinga[21910]: 2021-11-08 02:06:02,216 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:06:02 wikitech-static check_icinga[21911]: 2021-11-08 02:06:02,247 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:06:05 wikitech-static check_icinga[21910]: 2021-11-08 02:06:05,452 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:06:05 wikitech-static check_icinga[21911]: 2021-11-08 02:06:05,458 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:08:01 wikitech-static CRON[21995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:08:01 wikitech-static CRON[21996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:08:02 wikitech-static check_icinga[21997]: 2021-11-08 02:08:02,716 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:08:02 wikitech-static check_icinga[21998]: 2021-11-08 02:08:02,724 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:08:05 wikitech-static check_icinga[21997]: 2021-11-08 02:08:05,808 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:08:05 wikitech-static check_icinga[21998]: 2021-11-08 02:08:05,937 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:09:01 wikitech-static CRON[22050]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 02:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 02:09:06 wikitech-static systemd[1]: Started Clean php session files. Nov 8 02:10:01 wikitech-static CRON[22172]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:10:01 wikitech-static CRON[22173]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:10:02 wikitech-static check_icinga[22174]: 2021-11-08 02:10:02,646 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:10:02 wikitech-static check_icinga[22175]: 2021-11-08 02:10:02,652 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:10:05 wikitech-static check_icinga[22174]: 2021-11-08 02:10:05,832 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:10:05 wikitech-static check_icinga[22175]: 2021-11-08 02:10:05,890 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:11:01 wikitech-static CRON[22223]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 8 02:11:02 wikitech-static check_icinga_validate_config[22224]: Valid config, nothing to do. Nov 8 02:12:01 wikitech-static CRON[22279]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:12:01 wikitech-static CRON[22280]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:12:02 wikitech-static check_icinga[22281]: 2021-11-08 02:12:02,778 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:12:02 wikitech-static check_icinga[22282]: 2021-11-08 02:12:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:12:06 wikitech-static check_icinga[22282]: 2021-11-08 02:12:06,095 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:12:06 wikitech-static check_icinga[22281]: 2021-11-08 02:12:06,132 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:14:01 wikitech-static CRON[22369]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:14:01 wikitech-static CRON[22370]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:14:02 wikitech-static check_icinga[22371]: 2021-11-08 02:14:02,311 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:14:02 wikitech-static check_icinga[22372]: 2021-11-08 02:14:02,408 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:14:05 wikitech-static check_icinga[22371]: 2021-11-08 02:14:05,393 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:14:05 wikitech-static check_icinga[22372]: 2021-11-08 02:14:05,698 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:16:01 wikitech-static CRON[22453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:16:01 wikitech-static CRON[22454]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:16:02 wikitech-static check_icinga[22456]: 2021-11-08 02:16:02,869 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:16:02 wikitech-static check_icinga[22455]: 2021-11-08 02:16:02,898 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:16:06 wikitech-static check_icinga[22455]: 2021-11-08 02:16:06,128 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:16:06 wikitech-static check_icinga[22456]: 2021-11-08 02:16:06,247 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:17:01 wikitech-static CRON[22500]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 8 02:18:01 wikitech-static CRON[22534]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:18:01 wikitech-static CRON[22535]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:18:02 wikitech-static check_icinga[22537]: 2021-11-08 02:18:02,652 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:18:02 wikitech-static check_icinga[22536]: 2021-11-08 02:18:02,655 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:18:05 wikitech-static check_icinga[22536]: 2021-11-08 02:18:05,764 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:18:05 wikitech-static check_icinga[22537]: 2021-11-08 02:18:05,968 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:20:01 wikitech-static CRON[22609]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:20:01 wikitech-static CRON[22610]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:20:02 wikitech-static check_icinga[22611]: 2021-11-08 02:20:02,116 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:20:02 wikitech-static check_icinga[22612]: 2021-11-08 02:20:02,121 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:20:05 wikitech-static check_icinga[22612]: 2021-11-08 02:20:05,355 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:20:05 wikitech-static check_icinga[22611]: 2021-11-08 02:20:05,487 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:22:01 wikitech-static CRON[22684]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:22:01 wikitech-static CRON[22685]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:22:02 wikitech-static check_icinga[22687]: 2021-11-08 02:22:02,649 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:22:02 wikitech-static check_icinga[22686]: 2021-11-08 02:22:02,654 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:22:05 wikitech-static check_icinga[22686]: 2021-11-08 02:22:05,684 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:22:05 wikitech-static check_icinga[22687]: 2021-11-08 02:22:05,811 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:24:01 wikitech-static CRON[22763]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:24:01 wikitech-static CRON[22764]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:24:02 wikitech-static check_icinga[22766]: 2021-11-08 02:24:02,954 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:24:02 wikitech-static check_icinga[22765]: 2021-11-08 02:24:02,957 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:24:06 wikitech-static check_icinga[22766]: 2021-11-08 02:24:06,075 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:24:06 wikitech-static check_icinga[22765]: 2021-11-08 02:24:06,082 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:26:01 wikitech-static CRON[22838]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:26:01 wikitech-static CRON[22839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:26:02 wikitech-static check_icinga[22841]: 2021-11-08 02:26:02,310 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:26:02 wikitech-static check_icinga[22840]: 2021-11-08 02:26:02,315 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:26:05 wikitech-static check_icinga[22841]: 2021-11-08 02:26:05,284 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:26:05 wikitech-static check_icinga[22840]: 2021-11-08 02:26:05,553 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:28:01 wikitech-static CRON[22913]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:28:01 wikitech-static CRON[22914]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:28:02 wikitech-static check_icinga[22916]: 2021-11-08 02:28:02,712 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:28:02 wikitech-static check_icinga[22915]: 2021-11-08 02:28:02,717 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:28:05 wikitech-static check_icinga[22916]: 2021-11-08 02:28:05,820 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:28:05 wikitech-static check_icinga[22915]: 2021-11-08 02:28:05,999 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:30:01 wikitech-static CRON[22989]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:30:01 wikitech-static CRON[22990]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:30:02 wikitech-static check_icinga[22991]: 2021-11-08 02:30:02,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:30:02 wikitech-static check_icinga[22992]: 2021-11-08 02:30:02,149 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:30:05 wikitech-static check_icinga[22992]: 2021-11-08 02:30:05,257 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:30:05 wikitech-static check_icinga[22991]: 2021-11-08 02:30:05,306 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:32:01 wikitech-static CRON[23066]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:32:01 wikitech-static CRON[23068]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:32:02 wikitech-static check_icinga[23067]: 2021-11-08 02:32:02,485 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:32:02 wikitech-static check_icinga[23069]: 2021-11-08 02:32:02,596 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:32:05 wikitech-static check_icinga[23067]: 2021-11-08 02:32:05,621 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:32:05 wikitech-static check_icinga[23069]: 2021-11-08 02:32:05,843 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:34:01 wikitech-static CRON[23233]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:34:01 wikitech-static CRON[23234]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:34:02 wikitech-static check_icinga[23235]: 2021-11-08 02:34:02,963 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:34:02 wikitech-static check_icinga[23236]: 2021-11-08 02:34:02,965 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:34:04 wikitech-static check_icinga[23235]: 2021-11-08 02:34:04,365 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')"] Nov 8 02:34:06 wikitech-static check_icinga[23236]: 2021-11-08 02:34:06,263 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:34:14 wikitech-static check_icinga[23235]: 2021-11-08 02:34:14,378 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:34:17 wikitech-static check_icinga[23235]: 2021-11-08 02:34:17,093 [ERROR] Check for host alert2001.wikimedia.org (2/3) failed: ["Last External Command Check: N/A (expected failed to calculate expected value: time data 'N/A' does not match format '%Y-%m-%d %H:%M:%S')"] Nov 8 02:34:27 wikitech-static check_icinga[23235]: 2021-11-08 02:34:27,132 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:34:30 wikitech-static check_icinga[23235]: 2021-11-08 02:34:30,060 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:36:01 wikitech-static CRON[23308]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:36:01 wikitech-static CRON[23309]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:36:02 wikitech-static check_icinga[23310]: 2021-11-08 02:36:02,188 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:36:02 wikitech-static check_icinga[23311]: 2021-11-08 02:36:02,212 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:36:04 wikitech-static check_icinga[23310]: 2021-11-08 02:36:04,876 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:36:05 wikitech-static check_icinga[23311]: 2021-11-08 02:36:05,355 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:38:01 wikitech-static CRON[23383]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:38:01 wikitech-static CRON[23384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:38:02 wikitech-static check_icinga[23386]: 2021-11-08 02:38:02,535 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:38:02 wikitech-static check_icinga[23385]: 2021-11-08 02:38:02,540 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:38:05 wikitech-static check_icinga[23385]: 2021-11-08 02:38:05,269 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:38:05 wikitech-static check_icinga[23386]: 2021-11-08 02:38:05,883 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:39:01 wikitech-static CRON[23430]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 02:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 02:39:05 wikitech-static systemd[1]: Started Clean php session files. Nov 8 02:40:01 wikitech-static CRON[23552]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:40:01 wikitech-static CRON[23553]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:40:03 wikitech-static check_icinga[23554]: 2021-11-08 02:40:03,001 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:40:03 wikitech-static check_icinga[23555]: 2021-11-08 02:40:03,004 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:40:05 wikitech-static check_icinga[23554]: 2021-11-08 02:40:05,896 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:40:06 wikitech-static check_icinga[23555]: 2021-11-08 02:40:06,220 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:42:01 wikitech-static CRON[23630]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:42:01 wikitech-static CRON[23631]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:42:02 wikitech-static check_icinga[23632]: 2021-11-08 02:42:02,382 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:42:02 wikitech-static check_icinga[23633]: 2021-11-08 02:42:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:42:05 wikitech-static check_icinga[23632]: 2021-11-08 02:42:05,135 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:42:05 wikitech-static check_icinga[23633]: 2021-11-08 02:42:05,656 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:44:01 wikitech-static CRON[23705]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:44:01 wikitech-static CRON[23706]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:44:02 wikitech-static check_icinga[23707]: 2021-11-08 02:44:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:44:02 wikitech-static check_icinga[23708]: 2021-11-08 02:44:02,794 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:44:05 wikitech-static check_icinga[23707]: 2021-11-08 02:44:05,570 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:44:06 wikitech-static check_icinga[23708]: 2021-11-08 02:44:06,253 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:46:01 wikitech-static CRON[23780]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:46:01 wikitech-static CRON[23781]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:46:02 wikitech-static check_icinga[23782]: 2021-11-08 02:46:02,465 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:46:02 wikitech-static check_icinga[23783]: 2021-11-08 02:46:02,573 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:46:05 wikitech-static check_icinga[23782]: 2021-11-08 02:46:05,365 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:46:05 wikitech-static check_icinga[23783]: 2021-11-08 02:46:05,698 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:48:01 wikitech-static CRON[23858]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:48:01 wikitech-static CRON[23859]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:48:02 wikitech-static check_icinga[23860]: 2021-11-08 02:48:02,865 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:48:02 wikitech-static check_icinga[23861]: 2021-11-08 02:48:02,869 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:48:05 wikitech-static check_icinga[23861]: 2021-11-08 02:48:05,910 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:48:05 wikitech-static check_icinga[23860]: 2021-11-08 02:48:05,935 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:50:01 wikitech-static CRON[23956]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:50:01 wikitech-static CRON[23957]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:50:02 wikitech-static check_icinga[23958]: 2021-11-08 02:50:02,167 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:50:02 wikitech-static check_icinga[23959]: 2021-11-08 02:50:02,193 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:50:05 wikitech-static check_icinga[23958]: 2021-11-08 02:50:05,141 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:50:05 wikitech-static check_icinga[23959]: 2021-11-08 02:50:05,460 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:52:01 wikitech-static CRON[24035]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:52:01 wikitech-static CRON[24036]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:52:02 wikitech-static check_icinga[24038]: 2021-11-08 02:52:02,600 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:52:02 wikitech-static check_icinga[24037]: 2021-11-08 02:52:02,667 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:52:05 wikitech-static check_icinga[24037]: 2021-11-08 02:52:05,747 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:52:05 wikitech-static check_icinga[24038]: 2021-11-08 02:52:05,853 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:54:01 wikitech-static CRON[24110]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:54:01 wikitech-static CRON[24111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:54:02 wikitech-static check_icinga[24112]: 2021-11-08 02:54:02,965 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:54:02 wikitech-static check_icinga[24113]: 2021-11-08 02:54:02,994 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:54:06 wikitech-static check_icinga[24113]: 2021-11-08 02:54:06,075 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:54:06 wikitech-static check_icinga[24112]: 2021-11-08 02:54:06,143 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:56:01 wikitech-static CRON[24186]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:56:01 wikitech-static CRON[24187]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:56:02 wikitech-static check_icinga[24188]: 2021-11-08 02:56:02,374 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:56:02 wikitech-static check_icinga[24189]: 2021-11-08 02:56:02,398 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:56:05 wikitech-static check_icinga[24188]: 2021-11-08 02:56:05,527 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:56:05 wikitech-static check_icinga[24189]: 2021-11-08 02:56:05,703 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 02:58:01 wikitech-static CRON[24262]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 02:58:01 wikitech-static CRON[24263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 02:58:02 wikitech-static check_icinga[24265]: 2021-11-08 02:58:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 02:58:02 wikitech-static check_icinga[24264]: 2021-11-08 02:58:02,925 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 02:58:06 wikitech-static check_icinga[24264]: 2021-11-08 02:58:06,087 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 02:58:06 wikitech-static check_icinga[24265]: 2021-11-08 02:58:06,130 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:00:01 wikitech-static CRON[24337]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:00:01 wikitech-static CRON[24339]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:00:02 wikitech-static check_icinga[24338]: 2021-11-08 03:00:02,325 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:00:02 wikitech-static check_icinga[24340]: 2021-11-08 03:00:02,373 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:00:05 wikitech-static check_icinga[24338]: 2021-11-08 03:00:05,384 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:00:05 wikitech-static check_icinga[24340]: 2021-11-08 03:00:05,590 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:02:01 wikitech-static CRON[24416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:02:01 wikitech-static CRON[24417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:02:02 wikitech-static check_icinga[24419]: 2021-11-08 03:02:02,756 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:02:02 wikitech-static check_icinga[24418]: 2021-11-08 03:02:02,761 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:02:05 wikitech-static check_icinga[24419]: 2021-11-08 03:02:05,924 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:02:05 wikitech-static check_icinga[24418]: 2021-11-08 03:02:05,931 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:04:01 wikitech-static CRON[24491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:04:01 wikitech-static CRON[24492]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:04:02 wikitech-static check_icinga[24494]: 2021-11-08 03:04:02,149 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:04:02 wikitech-static check_icinga[24493]: 2021-11-08 03:04:02,259 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:04:05 wikitech-static check_icinga[24494]: 2021-11-08 03:04:05,482 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:04:05 wikitech-static check_icinga[24493]: 2021-11-08 03:04:05,525 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:06:01 wikitech-static CRON[24566]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:06:01 wikitech-static CRON[24567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:06:02 wikitech-static check_icinga[24568]: 2021-11-08 03:06:02,714 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:06:02 wikitech-static check_icinga[24569]: 2021-11-08 03:06:02,745 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:06:05 wikitech-static check_icinga[24569]: 2021-11-08 03:06:05,759 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:06:05 wikitech-static check_icinga[24568]: 2021-11-08 03:06:05,867 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:08:01 wikitech-static CRON[24641]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:08:01 wikitech-static CRON[24642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:08:02 wikitech-static check_icinga[24643]: 2021-11-08 03:08:02,996 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:08:03 wikitech-static check_icinga[24644]: 2021-11-08 03:08:03,001 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:08:06 wikitech-static check_icinga[24644]: 2021-11-08 03:08:06,000 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:08:06 wikitech-static check_icinga[24643]: 2021-11-08 03:08:06,050 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:09:01 wikitech-static CRON[24688]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 03:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 03:09:05 wikitech-static systemd[1]: Started Clean php session files. Nov 8 03:10:01 wikitech-static CRON[24811]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:10:01 wikitech-static CRON[24812]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:10:02 wikitech-static check_icinga[24814]: 2021-11-08 03:10:02,388 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:10:02 wikitech-static check_icinga[24813]: 2021-11-08 03:10:02,391 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:10:05 wikitech-static check_icinga[24813]: 2021-11-08 03:10:05,639 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:10:05 wikitech-static check_icinga[24814]: 2021-11-08 03:10:05,688 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:12:01 wikitech-static CRON[24887]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:12:01 wikitech-static CRON[24888]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:12:02 wikitech-static check_icinga[24889]: 2021-11-08 03:12:02,988 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:12:03 wikitech-static check_icinga[24890]: 2021-11-08 03:12:03,019 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:12:06 wikitech-static check_icinga[24890]: 2021-11-08 03:12:06,163 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:12:06 wikitech-static check_icinga[24889]: 2021-11-08 03:12:06,198 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:14:01 wikitech-static CRON[24966]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:14:01 wikitech-static CRON[24967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:14:02 wikitech-static check_icinga[24968]: 2021-11-08 03:14:02,412 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:14:02 wikitech-static check_icinga[24969]: 2021-11-08 03:14:02,435 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:14:05 wikitech-static check_icinga[24968]: 2021-11-08 03:14:05,573 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:14:05 wikitech-static check_icinga[24969]: 2021-11-08 03:14:05,713 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:16:01 wikitech-static CRON[25041]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:16:01 wikitech-static CRON[25042]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:16:03 wikitech-static check_icinga[25043]: 2021-11-08 03:16:03,066 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:16:03 wikitech-static check_icinga[25044]: 2021-11-08 03:16:03,092 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:16:06 wikitech-static check_icinga[25044]: 2021-11-08 03:16:06,192 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:16:06 wikitech-static check_icinga[25043]: 2021-11-08 03:16:06,259 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:17:01 wikitech-static CRON[25091]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 8 03:18:01 wikitech-static CRON[25122]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:18:01 wikitech-static CRON[25123]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:18:02 wikitech-static check_icinga[25125]: 2021-11-08 03:18:02,433 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:18:02 wikitech-static check_icinga[25124]: 2021-11-08 03:18:02,472 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:18:05 wikitech-static check_icinga[25124]: 2021-11-08 03:18:05,634 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:18:05 wikitech-static check_icinga[25125]: 2021-11-08 03:18:05,706 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:20:01 wikitech-static CRON[25197]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:20:01 wikitech-static CRON[25199]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:20:02 wikitech-static check_icinga[25198]: 2021-11-08 03:20:02,903 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:20:02 wikitech-static check_icinga[25200]: 2021-11-08 03:20:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:20:06 wikitech-static check_icinga[25198]: 2021-11-08 03:20:06,028 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:20:06 wikitech-static check_icinga[25200]: 2021-11-08 03:20:06,179 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:22:01 wikitech-static CRON[25274]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:22:01 wikitech-static CRON[25275]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:22:02 wikitech-static check_icinga[25277]: 2021-11-08 03:22:02,348 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:22:02 wikitech-static check_icinga[25276]: 2021-11-08 03:22:02,353 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:22:05 wikitech-static check_icinga[25276]: 2021-11-08 03:22:05,486 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:22:05 wikitech-static check_icinga[25277]: 2021-11-08 03:22:05,565 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:24:01 wikitech-static CRON[25352]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:24:01 wikitech-static CRON[25353]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:24:02 wikitech-static check_icinga[25355]: 2021-11-08 03:24:02,798 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:24:02 wikitech-static check_icinga[25354]: 2021-11-08 03:24:02,805 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:24:05 wikitech-static check_icinga[25355]: 2021-11-08 03:24:05,980 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:24:06 wikitech-static check_icinga[25354]: 2021-11-08 03:24:06,064 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:26:01 wikitech-static CRON[25432]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:26:01 wikitech-static CRON[25433]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:26:02 wikitech-static check_icinga[25434]: 2021-11-08 03:26:02,257 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:26:02 wikitech-static check_icinga[25435]: 2021-11-08 03:26:02,261 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:26:05 wikitech-static check_icinga[25435]: 2021-11-08 03:26:05,337 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:26:05 wikitech-static check_icinga[25434]: 2021-11-08 03:26:05,676 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:28:01 wikitech-static CRON[25513]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:28:01 wikitech-static CRON[25514]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:28:02 wikitech-static check_icinga[25516]: 2021-11-08 03:28:02,895 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:28:02 wikitech-static check_icinga[25515]: 2021-11-08 03:28:02,929 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:28:05 wikitech-static check_icinga[25515]: 2021-11-08 03:28:05,935 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:28:06 wikitech-static check_icinga[25516]: 2021-11-08 03:28:06,083 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:30:01 wikitech-static CRON[25615]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:30:01 wikitech-static CRON[25617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:30:02 wikitech-static check_icinga[25616]: 2021-11-08 03:30:02,231 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:30:02 wikitech-static check_icinga[25618]: 2021-11-08 03:30:02,239 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:30:05 wikitech-static check_icinga[25616]: 2021-11-08 03:30:05,381 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:30:05 wikitech-static check_icinga[25618]: 2021-11-08 03:30:05,628 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:32:01 wikitech-static CRON[25711]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:32:01 wikitech-static CRON[25713]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:32:02 wikitech-static check_icinga[25712]: 2021-11-08 03:32:02,787 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:32:02 wikitech-static check_icinga[25714]: 2021-11-08 03:32:02,800 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:32:05 wikitech-static check_icinga[25714]: 2021-11-08 03:32:05,880 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:32:06 wikitech-static check_icinga[25712]: 2021-11-08 03:32:06,020 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:34:01 wikitech-static CRON[25786]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:34:01 wikitech-static CRON[25787]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:34:02 wikitech-static check_icinga[25788]: 2021-11-08 03:34:02,197 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:34:02 wikitech-static check_icinga[25789]: 2021-11-08 03:34:02,204 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:34:03 wikitech-static check_icinga[25789]: 2021-11-08 03:34:03,584 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)'] Nov 8 03:34:05 wikitech-static check_icinga[25788]: 2021-11-08 03:34:05,295 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:34:13 wikitech-static check_icinga[25789]: 2021-11-08 03:34:13,598 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:34:16 wikitech-static check_icinga[25789]: 2021-11-08 03:34:16,435 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:36:01 wikitech-static CRON[25868]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:36:01 wikitech-static CRON[25870]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:36:02 wikitech-static check_icinga[25871]: 2021-11-08 03:36:02,594 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:36:02 wikitech-static check_icinga[25869]: 2021-11-08 03:36:02,597 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:36:05 wikitech-static check_icinga[25869]: 2021-11-08 03:36:05,363 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:36:05 wikitech-static check_icinga[25871]: 2021-11-08 03:36:05,749 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:38:01 wikitech-static CRON[25945]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:38:01 wikitech-static CRON[25946]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:38:02 wikitech-static check_icinga[25948]: 2021-11-08 03:38:02,935 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:38:02 wikitech-static check_icinga[25947]: 2021-11-08 03:38:02,940 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:38:05 wikitech-static check_icinga[25947]: 2021-11-08 03:38:05,872 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:38:06 wikitech-static check_icinga[25948]: 2021-11-08 03:38:06,130 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:39:01 wikitech-static CRON[25992]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 03:39:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 03:39:07 wikitech-static systemd[1]: Started Clean php session files. Nov 8 03:40:01 wikitech-static CRON[26126]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:40:01 wikitech-static CRON[26127]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:40:02 wikitech-static check_icinga[26128]: 2021-11-08 03:40:02,329 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:40:02 wikitech-static check_icinga[26129]: 2021-11-08 03:40:02,340 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:40:05 wikitech-static check_icinga[26129]: 2021-11-08 03:40:05,130 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:40:05 wikitech-static check_icinga[26128]: 2021-11-08 03:40:05,511 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:42:01 wikitech-static CRON[26204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:42:01 wikitech-static CRON[26205]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:42:02 wikitech-static check_icinga[26207]: 2021-11-08 03:42:02,619 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:42:02 wikitech-static check_icinga[26206]: 2021-11-08 03:42:02,643 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:42:05 wikitech-static check_icinga[26206]: 2021-11-08 03:42:05,443 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:42:05 wikitech-static check_icinga[26207]: 2021-11-08 03:42:05,772 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:44:01 wikitech-static CRON[26282]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:44:01 wikitech-static CRON[26283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:44:02 wikitech-static check_icinga[26285]: 2021-11-08 03:44:02,976 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:44:02 wikitech-static check_icinga[26284]: 2021-11-08 03:44:02,997 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:44:05 wikitech-static check_icinga[26284]: 2021-11-08 03:44:05,865 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:44:06 wikitech-static check_icinga[26285]: 2021-11-08 03:44:06,167 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:46:01 wikitech-static CRON[26361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:46:01 wikitech-static CRON[26362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:46:02 wikitech-static check_icinga[26364]: 2021-11-08 03:46:02,457 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:46:02 wikitech-static check_icinga[26363]: 2021-11-08 03:46:02,460 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:46:05 wikitech-static check_icinga[26364]: 2021-11-08 03:46:05,242 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:46:05 wikitech-static check_icinga[26363]: 2021-11-08 03:46:05,553 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:48:01 wikitech-static CRON[26436]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:48:01 wikitech-static CRON[26437]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:48:02 wikitech-static check_icinga[26438]: 2021-11-08 03:48:02,697 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:48:02 wikitech-static check_icinga[26439]: 2021-11-08 03:48:02,698 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:48:05 wikitech-static check_icinga[26438]: 2021-11-08 03:48:05,617 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:48:05 wikitech-static check_icinga[26439]: 2021-11-08 03:48:05,877 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:50:01 wikitech-static CRON[26514]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:50:01 wikitech-static CRON[26516]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:50:03 wikitech-static check_icinga[26515]: 2021-11-08 03:50:03,020 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:50:03 wikitech-static check_icinga[26517]: 2021-11-08 03:50:03,034 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:50:05 wikitech-static check_icinga[26515]: 2021-11-08 03:50:05,959 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:50:06 wikitech-static check_icinga[26517]: 2021-11-08 03:50:06,221 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:52:01 wikitech-static CRON[26592]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:52:01 wikitech-static CRON[26593]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:52:02 wikitech-static check_icinga[26594]: 2021-11-08 03:52:02,335 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:52:02 wikitech-static check_icinga[26595]: 2021-11-08 03:52:02,425 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:52:05 wikitech-static check_icinga[26594]: 2021-11-08 03:52:05,353 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:52:05 wikitech-static check_icinga[26595]: 2021-11-08 03:52:05,607 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:54:01 wikitech-static CRON[26669]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:54:01 wikitech-static CRON[26670]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:54:02 wikitech-static check_icinga[26672]: 2021-11-08 03:54:02,706 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:54:02 wikitech-static check_icinga[26671]: 2021-11-08 03:54:02,731 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:54:05 wikitech-static check_icinga[26671]: 2021-11-08 03:54:05,875 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:54:05 wikitech-static check_icinga[26672]: 2021-11-08 03:54:05,923 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:56:01 wikitech-static CRON[26744]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:56:01 wikitech-static CRON[26746]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:56:02 wikitech-static check_icinga[26745]: 2021-11-08 03:56:02,105 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:56:02 wikitech-static check_icinga[26747]: 2021-11-08 03:56:02,132 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:56:05 wikitech-static check_icinga[26747]: 2021-11-08 03:56:05,152 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:56:05 wikitech-static check_icinga[26745]: 2021-11-08 03:56:05,196 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 03:58:01 wikitech-static CRON[26826]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 03:58:01 wikitech-static CRON[26827]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 03:58:02 wikitech-static check_icinga[26829]: 2021-11-08 03:58:02,375 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 03:58:02 wikitech-static check_icinga[26828]: 2021-11-08 03:58:02,487 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 03:58:05 wikitech-static check_icinga[26829]: 2021-11-08 03:58:05,604 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 03:58:05 wikitech-static check_icinga[26828]: 2021-11-08 03:58:05,739 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:00:01 wikitech-static CRON[26938]: (root) CMD (/usr/bin/systemd-cat -t "import-wikitech.sh" /wikitech-static/wikitechsync/import-wikitech.sh) Nov 8 04:00:01 wikitech-static CRON[26939]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:00:01 wikitech-static CRON[26940]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: --2021-11-08 04:00:02-- https://wikitech.wikimedia.org/dumps/labswiki-20211108.xml.gz Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Resolving wikitech.wikimedia.org (wikitech.wikimedia.org)... 208.80.154.224 Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Connecting to wikitech.wikimedia.org (wikitech.wikimedia.org)|208.80.154.224|:443... connected. Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: HTTP request sent, awaiting response... 200 OK Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Length: 15805956 (15M) [application/x-gzip] Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Saving to: ‘/srv/imports/labswiki-20211108.xml.gz’ Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 0K .......... .......... .......... .......... .......... 0% 1.06M 14s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 50K .......... .......... .......... .......... .......... 0% 1.72M 11s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 100K .......... .......... .......... .......... .......... 0% 2.90M 9s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 150K .......... .......... .......... .......... .......... 1% 3.15M 8s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 200K .......... .......... .......... .......... .......... 1% 4.95M 7s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 250K .......... .......... .......... .......... .......... 1% 8.63M 6s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 300K .......... .......... .......... .......... .......... 2% 8.05M 6s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 350K .......... .......... .......... .......... .......... 2% 8.77M 5s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 400K .......... .......... .......... .......... .......... 2% 11.4M 5s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 450K .......... .......... .......... .......... .......... 3% 11.1M 4s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 500K .......... .......... .......... .......... .......... 3% 10.3M 4s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 550K .......... .......... .......... .......... .......... 3% 9.92M 4s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 600K .......... .......... .......... .......... .......... 4% 18.6M 4s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 650K .......... .......... .......... .......... .......... 4% 14.0M 3s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 700K .......... .......... .......... .......... .......... 4% 23.1M 3s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 750K .......... .......... .......... .......... .......... 5% 18.4M 3s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 800K .......... .......... .......... .......... .......... 5% 15.4M 3s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 850K .......... .......... .......... .......... .......... 5% 19.1M 3s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 900K .......... .......... .......... .......... .......... 6% 10.3M 3s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 950K .......... .......... .......... .......... .......... 6% 8.80M 3s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1000K .......... .......... .......... .......... .......... 6% 16.8M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1050K .......... .......... .......... .......... .......... 7% 32.8M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1100K .......... .......... .......... .......... .......... 7% 27.6M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1150K .......... .......... .......... .......... .......... 7% 30.3M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1200K .......... .......... .......... .......... .......... 8% 41.2M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1250K .......... .......... .......... .......... .......... 8% 24.0M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1300K .......... .......... .......... .......... .......... 8% 41.0M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1350K .......... .......... .......... .......... .......... 9% 23.3M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1400K .......... .......... .......... .......... .......... 9% 27.5M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1450K .......... .......... .......... .......... .......... 9% 37.8M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1500K .......... .......... .......... .......... .......... 10% 25.4M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1550K .......... .......... .......... .......... .......... 10% 20.1M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1600K .......... .......... .......... .......... .......... 10% 134M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1650K .......... .......... .......... .......... .......... 11% 13.3M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1700K .......... .......... .......... .......... .......... 11% 87.5M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1750K .......... .......... .......... .......... .......... 11% 14.3M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1800K .......... .......... .......... .......... .......... 11% 42.9M 2s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1850K .......... .......... .......... .......... .......... 12% 142M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1900K .......... .......... .......... .......... .......... 12% 32.4M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1950K .......... .......... .......... .......... .......... 12% 9.83M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2000K .......... .......... .......... .......... .......... 13% 132M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2050K .......... .......... .......... .......... .......... 13% 145M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2100K .......... .......... .......... .......... .......... 13% 128M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2150K .......... .......... .......... .......... .......... 14% 13.9M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2200K .......... .......... .......... .......... .......... 14% 36.1M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2250K .......... .......... .......... .......... .......... 14% 24.7M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2300K .......... .......... .......... .......... .......... 15% 118M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2350K .......... .......... .......... .......... .......... 15% 29.6M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2400K .......... .......... .......... .......... .......... 15% 34.7M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2450K .......... .......... .......... .......... .......... 16% 9.65M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2500K .......... .......... .......... .......... .......... 16% 144M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2550K .......... .......... .......... .......... .......... 16% 129M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2600K .......... .......... .......... .......... .......... 17% 12.9M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2650K .......... .......... .......... .......... .......... 17% 152M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2700K .......... .......... .......... .......... .......... 17% 38.0M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2750K .......... .......... .......... .......... .......... 18% 135M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2800K .......... .......... .......... .......... .......... 18% 9.29M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2850K .......... .......... .......... .......... .......... 18% 95.7M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2900K .......... .......... .......... .......... .......... 19% 125M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2950K .......... .......... .......... .......... .......... 19% 12.6M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3000K .......... .......... .......... .......... .......... 19% 142M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3050K .......... .......... .......... .......... .......... 20% 111M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3100K .......... .......... .......... .......... .......... 20% 7.91M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3150K .......... .......... .......... .......... .......... 20% 131M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3200K .......... .......... .......... .......... .......... 21% 147M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3250K .......... .......... .......... .......... .......... 21% 161M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3300K .......... .......... .......... .......... .......... 21% 70.1M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3350K .......... .......... .......... .......... .......... 22% 15.6M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3400K .......... .......... .......... .......... .......... 22% 12.5M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3450K .......... .......... .......... .......... .......... 22% 128M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3500K .......... .......... .......... .......... .......... 22% 143M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3550K .......... .......... .......... .......... .......... 23% 65.2M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3600K .......... .......... .......... .......... .......... 23% 7.10M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3650K .......... .......... .......... .......... .......... 23% 133M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3700K .......... .......... .......... .......... .......... 24% 149M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3750K .......... .......... .......... .......... .......... 24% 109M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3800K .......... .......... .......... .......... .......... 24% 19.9M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3850K .......... .......... .......... .......... .......... 25% 117M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3900K .......... .......... .......... .......... .......... 25% 142M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3950K .......... .......... .......... .......... .......... 25% 12.2M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4000K .......... .......... .......... .......... .......... 26% 144M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4050K .......... .......... .......... .......... .......... 26% 26.5M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4100K .......... .......... .......... .......... .......... 26% 5.84M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4150K .......... .......... .......... .......... .......... 27% 112M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4200K .......... .......... .......... .......... .......... 27% 31.5M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4250K .......... .......... .......... .......... .......... 27% 136M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4300K .......... .......... .......... .......... .......... 28% 155M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4350K .......... .......... .......... .......... .......... 28% 140M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4400K .......... .......... .......... .......... .......... 28% 160M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4450K .......... .......... .......... .......... .......... 29% 21.5M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4500K .......... .......... .......... .......... .......... 29% 78.2M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4550K .......... .......... .......... .......... .......... 29% 23.4M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4600K .......... .......... .......... .......... .......... 30% 6.28M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4650K .......... .......... .......... .......... .......... 30% 62.8M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4700K .......... .......... .......... .......... .......... 30% 136M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4750K .......... .......... .......... .......... .......... 31% 134M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4800K .......... .......... .......... .......... .......... 31% 154M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4850K .......... .......... .......... .......... .......... 31% 153M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4900K .......... .......... .......... .......... .......... 32% 19.0M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4950K .......... .......... .......... .......... .......... 32% 85.6M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5000K .......... .......... .......... .......... .......... 32% 6.75M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5050K .......... .......... .......... .......... .......... 33% 146M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5100K .......... .......... .......... .......... .......... 33% 147M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5150K .......... .......... .......... .......... .......... 33% 90.9M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5200K .......... .......... .......... .......... .......... 34% 161M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5250K .......... .......... .......... .......... .......... 34% 7.13M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5300K .......... .......... .......... .......... .......... 34% 155M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5350K .......... .......... .......... .......... .......... 34% 94.0M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5400K .......... .......... .......... .......... .......... 35% 102M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5450K .......... .......... .......... .......... .......... 35% 156M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5500K .......... .......... .......... .......... .......... 35% 7.60M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5550K .......... .......... .......... .......... .......... 36% 137M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5600K .......... .......... .......... .......... .......... 36% 147M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5650K .......... .......... .......... .......... .......... 36% 166M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5700K .......... .......... .......... .......... .......... 37% 27.9M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5750K .......... .......... .......... .......... .......... 37% 9.29M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5800K .......... .......... .......... .......... .......... 37% 109M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5850K .......... .......... .......... .......... .......... 38% 142M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5900K .......... .......... .......... .......... .......... 38% 146M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5950K .......... .......... .......... .......... .......... 38% 7.00M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6000K .......... .......... .......... .......... .......... 39% 110M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6050K .......... .......... .......... .......... .......... 39% 130M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6100K .......... .......... .......... .......... .......... 39% 153M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6150K .......... .......... .......... .......... .......... 40% 93.6M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6200K .......... .......... .......... .......... .......... 40% 8.21M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6250K .......... .......... .......... .......... .......... 40% 144M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6300K .......... .......... .......... .......... .......... 41% 150M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6350K .......... .......... .......... .......... .......... 41% 85.2M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6400K .......... .......... .......... .......... .......... 41% 89.7M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6450K .......... .......... .......... .......... .......... 42% 7.27M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6500K .......... .......... .......... .......... .......... 42% 139M 1s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6550K .......... .......... .......... .......... .......... 42% 114M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6600K .......... .......... .......... .......... .......... 43% 96.2M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6650K .......... .......... .......... .......... .......... 43% 151M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6700K .......... .......... .......... .......... .......... 43% 7.60M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6750K .......... .......... .......... .......... .......... 44% 90.4M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6800K .......... .......... .......... .......... .......... 44% 154M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6850K .......... .......... .......... .......... .......... 44% 151M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6900K .......... .......... .......... .......... .......... 45% 94.3M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6950K .......... .......... .......... .......... .......... 45% 6.46M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7000K .......... .......... .......... .......... .......... 45% 142M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7050K .......... .......... .......... .......... .......... 45% 160M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7100K .......... .......... .......... .......... .......... 46% 97.7M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7150K .......... .......... .......... .......... .......... 46% 8.52M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7200K .......... .......... .......... .......... .......... 46% 131M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7250K .......... .......... .......... .......... .......... 47% 118M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7300K .......... .......... .......... .......... .......... 47% 106M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7350K .......... .......... .......... .......... .......... 47% 108M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7400K .......... .......... .......... .......... .......... 48% 5.04M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7450K .......... .......... .......... .......... .......... 48% 133M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7500K .......... .......... .......... .......... .......... 48% 90.4M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7550K .......... .......... .......... .......... .......... 49% 121M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7600K .......... .......... .......... .......... .......... 49% 148M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7650K .......... .......... .......... .......... .......... 49% 124M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7700K .......... .......... .......... .......... .......... 50% 155M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7750K .......... .......... .......... .......... .......... 50% 5.46M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7800K .......... .......... .......... .......... .......... 50% 108M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7850K .......... .......... .......... .......... .......... 51% 145M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7900K .......... .......... .......... .......... .......... 51% 5.77M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7950K .......... .......... .......... .......... .......... 51% 84.9M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8000K .......... .......... .......... .......... .......... 52% 149M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8050K .......... .......... .......... .......... .......... 52% 118M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8100K .......... .......... .......... .......... .......... 52% 100M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8150K .......... .......... .......... .......... .......... 53% 123M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8200K .......... .......... .......... .......... .......... 53% 2.31M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8250K .......... .......... .......... .......... .......... 53% 87.4M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8300K .......... .......... .......... .......... .......... 54% 146M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8350K .......... .......... .......... .......... .......... 54% 113M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8400K .......... .......... .......... .......... .......... 54% 105M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8450K .......... .......... .......... .......... .......... 55% 125M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8500K .......... .......... .......... .......... .......... 55% 90.8M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8550K .......... .......... .......... .......... .......... 55% 99.2M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8600K .......... .......... .......... .......... .......... 56% 2.60M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8650K .......... .......... .......... .......... .......... 56% 152M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8700K .......... .......... .......... .......... .......... 56% 142M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8750K .......... .......... .......... .......... .......... 57% 115M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8800K .......... .......... .......... .......... .......... 57% 5.51M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8850K .......... .......... .......... .......... .......... 57% 97.3M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8900K .......... .......... .......... .......... .......... 57% 145M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8950K .......... .......... .......... .......... .......... 58% 110M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9000K .......... .......... .......... .......... .......... 58% 109M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9050K .......... .......... .......... .......... .......... 58% 146M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9100K .......... .......... .......... .......... .......... 59% 104M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9150K .......... .......... .......... .......... .......... 59% 121M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9200K .......... .......... .......... .......... .......... 59% 146M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9250K .......... .......... .......... .......... .......... 60% 3.02M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9300K .......... .......... .......... .......... .......... 60% 104M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9350K .......... .......... .......... .......... .......... 60% 124M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9400K .......... .......... .......... .......... .......... 61% 107M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9450K .......... .......... .......... .......... .......... 61% 121M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9500K .......... .......... .......... .......... .......... 61% 118M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9550K .......... .......... .......... .......... .......... 62% 137M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9600K .......... .......... .......... .......... .......... 62% 98.9M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9650K .......... .......... .......... .......... .......... 62% 157M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9700K .......... .......... .......... .......... .......... 63% 135M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9750K .......... .......... .......... .......... .......... 63% 2.83M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9800K .......... .......... .......... .......... .......... 63% 155M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9850K .......... .......... .......... .......... .......... 64% 145M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9900K .......... .......... .......... .......... .......... 64% 132M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9950K .......... .......... .......... .......... .......... 64% 117M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10000K .......... .......... .......... .......... .......... 65% 133M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10050K .......... .......... .......... .......... .......... 65% 125M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10100K .......... .......... .......... .......... .......... 65% 139M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10150K .......... .......... .......... .......... .......... 66% 2.70M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10200K .......... .......... .......... .......... .......... 66% 115M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10250K .......... .......... .......... .......... .......... 66% 117M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10300K .......... .......... .......... .......... .......... 67% 143M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10350K .......... .......... .......... .......... .......... 67% 25.1M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10400K .......... .......... .......... .......... .......... 67% 145M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10450K .......... .......... .......... .......... .......... 68% 153M 0s Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10500K .......... .......... .......... .......... .......... 68% 142M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10550K .......... .......... .......... .......... .......... 68% 121M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10600K .......... .......... .......... .......... .......... 68% 158M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10650K .......... .......... .......... .......... .......... 69% 142M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10700K .......... .......... .......... .......... .......... 69% 153M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10750K .......... .......... .......... .......... .......... 69% 132M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10800K .......... .......... .......... .......... .......... 70% 144M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10850K .......... .......... .......... .......... .......... 70% 4.50M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10900K .......... .......... .......... .......... .......... 70% 147M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10950K .......... .......... .......... .......... .......... 71% 93.6M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11000K .......... .......... .......... .......... .......... 71% 2.39M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11050K .......... .......... .......... .......... .......... 71% 51.4M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11100K .......... .......... .......... .......... .......... 72% 142M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11150K .......... .......... .......... .......... .......... 72% 141M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11200K .......... .......... .......... .......... .......... 72% 98.0M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11250K .......... .......... .......... .......... .......... 73% 155M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11300K .......... .......... .......... .......... .......... 73% 144M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11350K .......... .......... .......... .......... .......... 73% 124M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11400K .......... .......... .......... .......... .......... 74% 159M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11450K .......... .......... .......... .......... .......... 74% 144M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11500K .......... .......... .......... .......... .......... 74% 5.06M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11550K .......... .......... .......... .......... .......... 75% 102M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11600K .......... .......... .......... .......... .......... 75% 4.74M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11650K .......... .......... .......... .......... .......... 75% 142M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11700K .......... .......... .......... .......... .......... 76% 160M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11750K .......... .......... .......... .......... .......... 76% 123M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11800K .......... .......... .......... .......... .......... 76% 148M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11850K .......... .......... .......... .......... .......... 77% 156M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11900K .......... .......... .......... .......... .......... 77% 151M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11950K .......... .......... .......... .......... .......... 77% 139M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12000K .......... .......... .......... .......... .......... 78% 147M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12050K .......... .......... .......... .......... .......... 78% 155M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12100K .......... .......... .......... .......... .......... 78% 148M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12150K .......... .......... .......... .......... .......... 79% 120M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12200K .......... .......... .......... .......... .......... 79% 5.47M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12250K .......... .......... .......... .......... .......... 79% 120M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12300K .......... .......... .......... .......... .......... 80% 136M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12350K .......... .......... .......... .......... .......... 80% 128M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12400K .......... .......... .......... .......... .......... 80% 115M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12450K .......... .......... .......... .......... .......... 80% 143M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12500K .......... .......... .......... .......... .......... 81% 143M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12550K .......... .......... .......... .......... .......... 81% 93.5M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12600K .......... .......... .......... .......... .......... 81% 142M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12650K .......... .......... .......... .......... .......... 82% 3.39M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12700K .......... .......... .......... .......... .......... 82% 108M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12750K .......... .......... .......... .......... .......... 82% 128M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12800K .......... .......... .......... .......... .......... 83% 120M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12850K .......... .......... .......... .......... .......... 83% 8.70M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12900K .......... .......... .......... .......... .......... 83% 103M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12950K .......... .......... .......... .......... .......... 84% 124M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13000K .......... .......... .......... .......... .......... 84% 151M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13050K .......... .......... .......... .......... .......... 84% 109M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13100K .......... .......... .......... .......... .......... 85% 158M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13150K .......... .......... .......... .......... .......... 85% 132M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13200K .......... .......... .......... .......... .......... 85% 4.86M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13250K .......... .......... .......... .......... .......... 86% 95.5M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13300K .......... .......... .......... .......... .......... 86% 158M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13350K .......... .......... .......... .......... .......... 86% 110M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13400K .......... .......... .......... .......... .......... 87% 4.91M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13450K .......... .......... .......... .......... .......... 87% 130M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13500K .......... .......... .......... .......... .......... 87% 129M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13550K .......... .......... .......... .......... .......... 88% 117M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13600K .......... .......... .......... .......... .......... 88% 144M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13650K .......... .......... .......... .......... .......... 88% 111M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13700K .......... .......... .......... .......... .......... 89% 150M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13750K .......... .......... .......... .......... .......... 89% 118M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13800K .......... .......... .......... .......... .......... 89% 114M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13850K .......... .......... .......... .......... .......... 90% 3.92M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13900K .......... .......... .......... .......... .......... 90% 12.9M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13950K .......... .......... .......... .......... .......... 90% 107M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14000K .......... .......... .......... .......... .......... 91% 133M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14050K .......... .......... .......... .......... .......... 91% 149M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14100K .......... .......... .......... .......... .......... 91% 94.1M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14150K .......... .......... .......... .......... .......... 91% 124M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14200K .......... .......... .......... .......... .......... 92% 135M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14250K .......... .......... .......... .......... .......... 92% 104M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14300K .......... .......... .......... .......... .......... 92% 147M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14350K .......... .......... .......... .......... .......... 93% 79.2M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14400K .......... .......... .......... .......... .......... 93% 3.32M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14450K .......... .......... .......... .......... .......... 93% 158M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14500K .......... .......... .......... .......... .......... 94% 149M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14550K .......... .......... .......... .......... .......... 94% 117M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14600K .......... .......... .......... .......... .......... 94% 5.71M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14650K .......... .......... .......... .......... .......... 95% 135M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14700K .......... .......... .......... .......... .......... 95% 119M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14750K .......... .......... .......... .......... .......... 95% 104M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14800K .......... .......... .......... .......... .......... 96% 143M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14850K .......... .......... .......... .......... .......... 96% 150M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14900K .......... .......... .......... .......... .......... 96% 151M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14950K .......... .......... .......... .......... .......... 97% 126M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15000K .......... .......... .......... .......... .......... 97% 149M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15050K .......... .......... .......... .......... .......... 97% 149M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15100K .......... .......... .......... .......... .......... 98% 142M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15150K .......... .......... .......... .......... .......... 98% 3.93M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15200K .......... .......... .......... .......... .......... 98% 146M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15250K .......... .......... .......... .......... .......... 99% 157M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15300K .......... .......... .......... .......... .......... 99% 153M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15350K .......... .......... .......... .......... .......... 99% 125M 0s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15400K .......... .......... .......... ..... 100% 172M=0.7s Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 2021-11-08 04:00:03 (20.6 MB/s) - ‘/srv/imports/labswiki-20211108.xml.gz’ saved [15805956/15805956] Nov 8 04:00:03 wikitech-static check_icinga[26943]: 2021-11-08 04:00:03,545 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:00:03 wikitech-static check_icinga[26941]: 2021-11-08 04:00:03,553 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:00:06 wikitech-static check_icinga[26941]: 2021-11-08 04:00:06,823 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:00:06 wikitech-static check_icinga[26943]: 2021-11-08 04:00:06,912 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:00:09 wikitech-static import-wikitech.sh[26942]: 100 (46.30 pages/sec 46.30 revs/sec) Nov 8 04:00:10 wikitech-static import-wikitech.sh[26942]: 200 (62.19 pages/sec 62.19 revs/sec) Nov 8 04:00:11 wikitech-static import-wikitech.sh[26942]: 300 (80.62 pages/sec 80.62 revs/sec) Nov 8 04:00:11 wikitech-static import-wikitech.sh[26942]: 400 (96.82 pages/sec 96.82 revs/sec) Nov 8 04:00:11 wikitech-static import-wikitech.sh[26942]: 500 (108.41 pages/sec 108.41 revs/sec) Nov 8 04:00:12 wikitech-static import-wikitech.sh[26942]: 600 (116.28 pages/sec 116.28 revs/sec) Nov 8 04:00:23 wikitech-static import-wikitech.sh[26942]: 700 (42.15 pages/sec 42.15 revs/sec) Nov 8 04:00:24 wikitech-static import-wikitech.sh[26942]: 800 (46.84 pages/sec 46.84 revs/sec) Nov 8 04:00:24 wikitech-static import-wikitech.sh[26942]: 900 (51.61 pages/sec 51.61 revs/sec) Nov 8 04:00:25 wikitech-static import-wikitech.sh[26942]: 1000 (56.08 pages/sec 56.08 revs/sec) Nov 8 04:00:38 wikitech-static import-wikitech.sh[26942]: 1100 (35.05 pages/sec 35.05 revs/sec) Nov 8 04:00:39 wikitech-static import-wikitech.sh[26942]: 1200 (37.91 pages/sec 37.91 revs/sec) Nov 8 04:00:39 wikitech-static import-wikitech.sh[26942]: 1300 (40.62 pages/sec 40.62 revs/sec) Nov 8 04:00:39 wikitech-static import-wikitech.sh[26942]: 1400 (43.07 pages/sec 43.07 revs/sec) Nov 8 04:00:40 wikitech-static import-wikitech.sh[26942]: 1500 (45.50 pages/sec 45.50 revs/sec) Nov 8 04:00:40 wikitech-static import-wikitech.sh[26942]: 1600 (48.14 pages/sec 48.14 revs/sec) Nov 8 04:00:40 wikitech-static import-wikitech.sh[26942]: 1700 (50.59 pages/sec 50.59 revs/sec) Nov 8 04:00:41 wikitech-static import-wikitech.sh[26942]: 1800 (52.85 pages/sec 52.85 revs/sec) Nov 8 04:00:48 wikitech-static import-wikitech.sh[26942]: 1900 (45.81 pages/sec 45.81 revs/sec) Nov 8 04:00:49 wikitech-static import-wikitech.sh[26942]: 2000 (47.90 pages/sec 47.90 revs/sec) Nov 8 04:00:49 wikitech-static import-wikitech.sh[26942]: 2100 (49.84 pages/sec 49.84 revs/sec) Nov 8 04:00:49 wikitech-static import-wikitech.sh[26942]: 2200 (51.65 pages/sec 51.65 revs/sec) Nov 8 04:00:50 wikitech-static import-wikitech.sh[26942]: 2300 (53.40 pages/sec 53.40 revs/sec) Nov 8 04:00:50 wikitech-static import-wikitech.sh[26942]: 2400 (55.18 pages/sec 55.18 revs/sec) Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2500 (57.15 pages/sec 57.15 revs/sec) Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2600 (59.05 pages/sec 59.05 revs/sec) Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2700 (60.99 pages/sec 60.99 revs/sec) Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2800 (62.89 pages/sec 62.89 revs/sec) Nov 8 04:00:52 wikitech-static import-wikitech.sh[26942]: 2900 (64.50 pages/sec 64.50 revs/sec) Nov 8 04:00:52 wikitech-static import-wikitech.sh[26942]: 3000 (66.28 pages/sec 66.28 revs/sec) Nov 8 04:00:52 wikitech-static import-wikitech.sh[26942]: 3100 (68.15 pages/sec 68.15 revs/sec) Nov 8 04:00:53 wikitech-static import-wikitech.sh[26942]: 3200 (69.89 pages/sec 69.89 revs/sec) Nov 8 04:00:53 wikitech-static import-wikitech.sh[26942]: 3300 (71.71 pages/sec 71.71 revs/sec) Nov 8 04:00:53 wikitech-static import-wikitech.sh[26942]: 3400 (73.43 pages/sec 73.43 revs/sec) Nov 8 04:00:57 wikitech-static import-wikitech.sh[26942]: 3500 (69.49 pages/sec 69.49 revs/sec) Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3600 (71.02 pages/sec 71.02 revs/sec) Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3700 (72.52 pages/sec 72.52 revs/sec) Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3800 (74.09 pages/sec 74.09 revs/sec) Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3900 (75.57 pages/sec 75.57 revs/sec) Nov 8 04:00:59 wikitech-static import-wikitech.sh[26942]: 4000 (77.01 pages/sec 77.01 revs/sec) Nov 8 04:00:59 wikitech-static import-wikitech.sh[26942]: 4100 (78.37 pages/sec 78.37 revs/sec) Nov 8 04:00:59 wikitech-static import-wikitech.sh[26942]: 4200 (79.92 pages/sec 79.92 revs/sec) Nov 8 04:01:00 wikitech-static import-wikitech.sh[26942]: 4300 (81.00 pages/sec 81.00 revs/sec) Nov 8 04:01:00 wikitech-static import-wikitech.sh[26942]: 4400 (82.35 pages/sec 82.35 revs/sec) Nov 8 04:01:01 wikitech-static import-wikitech.sh[26942]: 4500 (83.56 pages/sec 83.56 revs/sec) Nov 8 04:01:01 wikitech-static import-wikitech.sh[26942]: 4600 (85.04 pages/sec 85.04 revs/sec) Nov 8 04:01:01 wikitech-static import-wikitech.sh[26942]: 4700 (86.27 pages/sec 86.27 revs/sec) Nov 8 04:01:02 wikitech-static import-wikitech.sh[26942]: 4800 (87.18 pages/sec 87.18 revs/sec) Nov 8 04:01:02 wikitech-static import-wikitech.sh[26942]: 4900 (88.50 pages/sec 88.50 revs/sec) Nov 8 04:01:03 wikitech-static import-wikitech.sh[26942]: 5000 (89.86 pages/sec 89.86 revs/sec) Nov 8 04:01:03 wikitech-static import-wikitech.sh[26942]: 5100 (91.04 pages/sec 91.04 revs/sec) Nov 8 04:01:03 wikitech-static import-wikitech.sh[26942]: 5200 (92.32 pages/sec 92.32 revs/sec) Nov 8 04:01:04 wikitech-static import-wikitech.sh[26942]: 5300 (93.20 pages/sec 93.20 revs/sec) Nov 8 04:01:04 wikitech-static import-wikitech.sh[26942]: 5400 (94.02 pages/sec 94.02 revs/sec) Nov 8 04:01:05 wikitech-static import-wikitech.sh[26942]: 5500 (94.82 pages/sec 94.82 revs/sec) Nov 8 04:01:05 wikitech-static import-wikitech.sh[26942]: 5600 (95.99 pages/sec 95.99 revs/sec) Nov 8 04:01:06 wikitech-static import-wikitech.sh[26942]: 5700 (96.99 pages/sec 96.99 revs/sec) Nov 8 04:01:06 wikitech-static import-wikitech.sh[26942]: 5800 (98.12 pages/sec 98.12 revs/sec) Nov 8 04:01:06 wikitech-static import-wikitech.sh[26942]: 5900 (99.29 pages/sec 99.29 revs/sec) Nov 8 04:01:07 wikitech-static import-wikitech.sh[26942]: 6000 (100.52 pages/sec 100.52 revs/sec) Nov 8 04:01:07 wikitech-static import-wikitech.sh[26942]: 6100 (101.30 pages/sec 101.30 revs/sec) Nov 8 04:01:07 wikitech-static import-wikitech.sh[26942]: 6200 (102.45 pages/sec 102.45 revs/sec) Nov 8 04:01:08 wikitech-static import-wikitech.sh[26942]: 6300 (103.55 pages/sec 103.55 revs/sec) Nov 8 04:01:08 wikitech-static import-wikitech.sh[26942]: 6400 (104.73 pages/sec 104.73 revs/sec) Nov 8 04:01:08 wikitech-static import-wikitech.sh[26942]: 6500 (105.55 pages/sec 105.55 revs/sec) Nov 8 04:01:09 wikitech-static import-wikitech.sh[26942]: 6600 (106.24 pages/sec 106.24 revs/sec) Nov 8 04:01:09 wikitech-static import-wikitech.sh[26942]: 6700 (107.43 pages/sec 107.43 revs/sec) Nov 8 04:01:10 wikitech-static import-wikitech.sh[26942]: 6800 (108.50 pages/sec 108.50 revs/sec) Nov 8 04:01:10 wikitech-static import-wikitech.sh[26942]: 6900 (109.40 pages/sec 109.40 revs/sec) Nov 8 04:01:10 wikitech-static import-wikitech.sh[26942]: 7000 (110.42 pages/sec 110.42 revs/sec) Nov 8 04:01:11 wikitech-static import-wikitech.sh[26942]: 7100 (111.32 pages/sec 111.32 revs/sec) Nov 8 04:01:11 wikitech-static import-wikitech.sh[26942]: 7200 (112.36 pages/sec 112.36 revs/sec) Nov 8 04:01:11 wikitech-static import-wikitech.sh[26942]: 7300 (113.46 pages/sec 113.46 revs/sec) Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7400 (114.41 pages/sec 114.41 revs/sec) Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7500 (115.47 pages/sec 115.47 revs/sec) Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7600 (116.52 pages/sec 116.52 revs/sec) Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7700 (117.59 pages/sec 117.59 revs/sec) Nov 8 04:01:13 wikitech-static import-wikitech.sh[26942]: 7800 (118.54 pages/sec 118.54 revs/sec) Nov 8 04:01:13 wikitech-static import-wikitech.sh[26942]: 7900 (118.97 pages/sec 118.97 revs/sec) Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8000 (120.00 pages/sec 120.00 revs/sec) Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8100 (120.96 pages/sec 120.96 revs/sec) Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8200 (121.98 pages/sec 121.98 revs/sec) Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8300 (122.85 pages/sec 122.85 revs/sec) Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8400 (123.91 pages/sec 123.91 revs/sec) Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8500 (124.93 pages/sec 124.93 revs/sec) Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8600 (125.96 pages/sec 125.96 revs/sec) Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8700 (127.01 pages/sec 127.01 revs/sec) Nov 8 04:01:16 wikitech-static import-wikitech.sh[26942]: 8800 (127.94 pages/sec 127.94 revs/sec) Nov 8 04:01:16 wikitech-static import-wikitech.sh[26942]: 8900 (128.84 pages/sec 128.84 revs/sec) Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9000 (129.27 pages/sec 129.27 revs/sec) Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9100 (130.25 pages/sec 130.25 revs/sec) Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9200 (131.21 pages/sec 131.21 revs/sec) Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9300 (132.15 pages/sec 132.15 revs/sec) Nov 8 04:01:18 wikitech-static import-wikitech.sh[26942]: 9400 (132.89 pages/sec 132.89 revs/sec) Nov 8 04:01:18 wikitech-static import-wikitech.sh[26942]: 9500 (133.77 pages/sec 133.77 revs/sec) Nov 8 04:01:18 wikitech-static import-wikitech.sh[26942]: 9600 (134.67 pages/sec 134.67 revs/sec) Nov 8 04:01:24 wikitech-static import-wikitech.sh[26942]: 9700 (125.48 pages/sec 125.48 revs/sec) Nov 8 04:01:24 wikitech-static import-wikitech.sh[26942]: 9800 (126.35 pages/sec 126.35 revs/sec) Nov 8 04:01:25 wikitech-static import-wikitech.sh[26942]: 9900 (127.14 pages/sec 127.14 revs/sec) Nov 8 04:01:25 wikitech-static import-wikitech.sh[26942]: 10000 (128.03 pages/sec 128.03 revs/sec) Nov 8 04:01:25 wikitech-static import-wikitech.sh[26942]: 10100 (128.92 pages/sec 128.92 revs/sec) Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10200 (129.73 pages/sec 129.73 revs/sec) Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10300 (130.47 pages/sec 130.47 revs/sec) Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10400 (131.32 pages/sec 131.32 revs/sec) Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10500 (132.12 pages/sec 132.12 revs/sec) Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10600 (132.79 pages/sec 132.79 revs/sec) Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10700 (133.70 pages/sec 133.70 revs/sec) Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10800 (134.56 pages/sec 134.56 revs/sec) Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10900 (135.29 pages/sec 135.29 revs/sec) Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11000 (136.10 pages/sec 136.10 revs/sec) Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11100 (136.88 pages/sec 136.88 revs/sec) Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11200 (137.74 pages/sec 137.74 revs/sec) Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11300 (138.52 pages/sec 138.52 revs/sec) Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11400 (139.36 pages/sec 139.36 revs/sec) Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11500 (140.14 pages/sec 140.14 revs/sec) Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11600 (140.95 pages/sec 140.95 revs/sec) Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11700 (141.75 pages/sec 141.75 revs/sec) Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 11800 (142.56 pages/sec 142.56 revs/sec) Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 11900 (143.27 pages/sec 143.27 revs/sec) Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 12000 (144.07 pages/sec 144.07 revs/sec) Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 12100 (144.80 pages/sec 144.80 revs/sec) Nov 8 04:01:31 wikitech-static import-wikitech.sh[26942]: 12200 (145.28 pages/sec 145.28 revs/sec) Nov 8 04:01:31 wikitech-static import-wikitech.sh[26942]: 12300 (145.97 pages/sec 145.97 revs/sec) Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12400 (146.52 pages/sec 146.52 revs/sec) Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12500 (147.22 pages/sec 147.22 revs/sec) Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12600 (147.96 pages/sec 147.96 revs/sec) Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12700 (148.73 pages/sec 148.73 revs/sec) Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12800 (149.53 pages/sec 149.53 revs/sec) Nov 8 04:01:33 wikitech-static import-wikitech.sh[26942]: 12900 (150.20 pages/sec 150.20 revs/sec) Nov 8 04:01:33 wikitech-static import-wikitech.sh[26942]: 13000 (150.82 pages/sec 150.82 revs/sec) Nov 8 04:01:33 wikitech-static import-wikitech.sh[26942]: 13100 (151.57 pages/sec 151.57 revs/sec) Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13200 (152.28 pages/sec 152.28 revs/sec) Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13300 (152.96 pages/sec 152.96 revs/sec) Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13400 (153.59 pages/sec 153.59 revs/sec) Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13500 (154.32 pages/sec 154.32 revs/sec) Nov 8 04:01:35 wikitech-static import-wikitech.sh[26942]: 13600 (155.07 pages/sec 155.07 revs/sec) Nov 8 04:01:35 wikitech-static import-wikitech.sh[26942]: 13700 (155.66 pages/sec 155.66 revs/sec) Nov 8 04:01:35 wikitech-static import-wikitech.sh[26942]: 13800 (156.33 pages/sec 156.33 revs/sec) Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 13900 (156.84 pages/sec 156.84 revs/sec) Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 14000 (157.40 pages/sec 157.40 revs/sec) Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 14100 (157.99 pages/sec 157.99 revs/sec) Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 14200 (158.69 pages/sec 158.69 revs/sec) Nov 8 04:01:37 wikitech-static import-wikitech.sh[26942]: 14300 (159.28 pages/sec 159.28 revs/sec) Nov 8 04:01:37 wikitech-static import-wikitech.sh[26942]: 14400 (159.36 pages/sec 159.36 revs/sec) Nov 8 04:01:38 wikitech-static import-wikitech.sh[26942]: 14500 (159.90 pages/sec 159.90 revs/sec) Nov 8 04:01:38 wikitech-static import-wikitech.sh[26942]: 14600 (160.20 pages/sec 160.20 revs/sec) Nov 8 04:01:39 wikitech-static import-wikitech.sh[26942]: 14700 (160.23 pages/sec 160.23 revs/sec) Nov 8 04:01:39 wikitech-static import-wikitech.sh[26942]: 14800 (160.58 pages/sec 160.58 revs/sec) Nov 8 04:01:39 wikitech-static import-wikitech.sh[26942]: 14900 (160.96 pages/sec 160.96 revs/sec) Nov 8 04:01:40 wikitech-static import-wikitech.sh[26942]: 15000 (160.87 pages/sec 160.87 revs/sec) Nov 8 04:01:44 wikitech-static import-wikitech.sh[26942]: 15100 (155.83 pages/sec 155.83 revs/sec) Nov 8 04:01:45 wikitech-static import-wikitech.sh[26942]: 15200 (155.69 pages/sec 155.69 revs/sec) Nov 8 04:01:45 wikitech-static import-wikitech.sh[26942]: 15300 (156.15 pages/sec 156.15 revs/sec) Nov 8 04:01:45 wikitech-static import-wikitech.sh[26942]: 15400 (156.18 pages/sec 156.18 revs/sec) Nov 8 04:01:46 wikitech-static import-wikitech.sh[26942]: 15500 (155.61 pages/sec 155.61 revs/sec) Nov 8 04:01:48 wikitech-static import-wikitech.sh[26942]: 15600 (154.59 pages/sec 154.59 revs/sec) Nov 8 04:01:49 wikitech-static import-wikitech.sh[26942]: 15700 (154.32 pages/sec 154.32 revs/sec) Nov 8 04:01:49 wikitech-static import-wikitech.sh[26942]: 15800 (154.34 pages/sec 154.34 revs/sec) Nov 8 04:01:50 wikitech-static import-wikitech.sh[26942]: 15900 (154.08 pages/sec 154.08 revs/sec) Nov 8 04:01:52 wikitech-static import-wikitech.sh[26942]: 16000 (152.79 pages/sec 152.79 revs/sec) Nov 8 04:01:52 wikitech-static import-wikitech.sh[26942]: 16100 (153.29 pages/sec 153.29 revs/sec) Nov 8 04:01:54 wikitech-static import-wikitech.sh[26942]: 16200 (151.69 pages/sec 151.69 revs/sec) Nov 8 04:01:54 wikitech-static import-wikitech.sh[26942]: 16300 (151.66 pages/sec 151.66 revs/sec) Nov 8 04:01:55 wikitech-static import-wikitech.sh[26942]: 16400 (151.70 pages/sec 151.70 revs/sec) Nov 8 04:01:55 wikitech-static import-wikitech.sh[26942]: 16500 (152.18 pages/sec 152.18 revs/sec) Nov 8 04:01:56 wikitech-static import-wikitech.sh[26942]: 16600 (152.72 pages/sec 152.72 revs/sec) Nov 8 04:01:56 wikitech-static import-wikitech.sh[26942]: 16700 (153.12 pages/sec 153.12 revs/sec) Nov 8 04:01:56 wikitech-static import-wikitech.sh[26942]: 16800 (153.62 pages/sec 153.62 revs/sec) Nov 8 04:01:57 wikitech-static import-wikitech.sh[26942]: 16900 (154.09 pages/sec 154.09 revs/sec) Nov 8 04:01:57 wikitech-static import-wikitech.sh[26942]: 17000 (154.25 pages/sec 154.25 revs/sec) Nov 8 04:01:57 wikitech-static import-wikitech.sh[26942]: 17100 (154.68 pages/sec 154.68 revs/sec) Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17200 (155.26 pages/sec 155.26 revs/sec) Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17300 (155.81 pages/sec 155.81 revs/sec) Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17400 (156.27 pages/sec 156.27 revs/sec) Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17500 (156.81 pages/sec 156.81 revs/sec) Nov 8 04:01:59 wikitech-static import-wikitech.sh[26942]: 17600 (157.06 pages/sec 157.06 revs/sec) Nov 8 04:01:59 wikitech-static import-wikitech.sh[26942]: 17700 (157.52 pages/sec 157.52 revs/sec) Nov 8 04:02:00 wikitech-static import-wikitech.sh[26942]: 17800 (157.67 pages/sec 157.67 revs/sec) Nov 8 04:02:00 wikitech-static import-wikitech.sh[26942]: 17900 (158.14 pages/sec 158.14 revs/sec) Nov 8 04:02:00 wikitech-static import-wikitech.sh[26942]: 18000 (158.64 pages/sec 158.64 revs/sec) Nov 8 04:02:01 wikitech-static import-wikitech.sh[26942]: 18100 (159.13 pages/sec 159.13 revs/sec) Nov 8 04:02:01 wikitech-static import-wikitech.sh[26942]: 18200 (159.59 pages/sec 159.59 revs/sec) Nov 8 04:02:02 wikitech-static import-wikitech.sh[26942]: 18300 (159.52 pages/sec 159.52 revs/sec) Nov 8 04:02:02 wikitech-static CRON[27111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:02:02 wikitech-static CRON[27112]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:02:02 wikitech-static import-wikitech.sh[26942]: 18400 (159.45 pages/sec 159.45 revs/sec) Nov 8 04:02:03 wikitech-static import-wikitech.sh[26942]: 18500 (159.55 pages/sec 159.55 revs/sec) Nov 8 04:02:03 wikitech-static import-wikitech.sh[26942]: 18600 (160.01 pages/sec 160.01 revs/sec) Nov 8 04:02:04 wikitech-static import-wikitech.sh[26942]: 18700 (160.14 pages/sec 160.14 revs/sec) Nov 8 04:02:05 wikitech-static import-wikitech.sh[26942]: 18800 (159.45 pages/sec 159.45 revs/sec) Nov 8 04:02:07 wikitech-static import-wikitech.sh[26942]: 18900 (157.45 pages/sec 157.45 revs/sec) Nov 8 04:02:08 wikitech-static import-wikitech.sh[26942]: 19000 (156.47 pages/sec 156.47 revs/sec) Nov 8 04:02:10 wikitech-static check_icinga[27114]: 2021-11-08 04:02:10,294 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:02:10 wikitech-static check_icinga[27113]: 2021-11-08 04:02:10,317 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:02:13 wikitech-static check_icinga[27113]: 2021-11-08 04:02:13,823 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:02:14 wikitech-static check_icinga[27114]: 2021-11-08 04:02:14,076 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:04:02 wikitech-static CRON[27202]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:04:02 wikitech-static CRON[27203]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:04:10 wikitech-static check_icinga[27204]: 2021-11-08 04:04:10,131 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:04:10 wikitech-static check_icinga[27205]: 2021-11-08 04:04:10,155 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:04:13 wikitech-static check_icinga[27205]: 2021-11-08 04:04:13,745 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:04:13 wikitech-static check_icinga[27204]: 2021-11-08 04:04:13,791 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:06:02 wikitech-static CRON[27323]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:06:02 wikitech-static CRON[27324]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:06:03 wikitech-static check_icinga[27325]: 2021-11-08 04:06:03,707 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:06:03 wikitech-static check_icinga[27326]: 2021-11-08 04:06:03,716 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:06:06 wikitech-static check_icinga[27326]: 2021-11-08 04:06:06,737 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:06:06 wikitech-static check_icinga[27325]: 2021-11-08 04:06:06,964 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:08:01 wikitech-static CRON[27402]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:08:01 wikitech-static CRON[27403]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:08:04 wikitech-static check_icinga[27404]: 2021-11-08 04:08:04,168 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:08:04 wikitech-static check_icinga[27405]: 2021-11-08 04:08:04,167 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:08:07 wikitech-static check_icinga[27404]: 2021-11-08 04:08:07,358 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:08:07 wikitech-static check_icinga[27405]: 2021-11-08 04:08:07,423 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:09:01 wikitech-static CRON[27450]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 04:09:05 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 04:09:09 wikitech-static systemd[1]: Started Clean php session files. Nov 8 04:10:01 wikitech-static CRON[27579]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:10:01 wikitech-static CRON[27581]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:10:04 wikitech-static check_icinga[27580]: 2021-11-08 04:10:04,238 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:10:04 wikitech-static check_icinga[27582]: 2021-11-08 04:10:04,240 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:10:07 wikitech-static check_icinga[27580]: 2021-11-08 04:10:07,472 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:10:07 wikitech-static check_icinga[27582]: 2021-11-08 04:10:07,806 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:11:01 wikitech-static CRON[27627]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 8 04:11:03 wikitech-static check_icinga_validate_config[27628]: Valid config, nothing to do. Nov 8 04:12:01 wikitech-static CRON[27668]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:12:01 wikitech-static CRON[27670]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:12:02 wikitech-static check_icinga[27669]: 2021-11-08 04:12:02,433 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:12:02 wikitech-static check_icinga[27671]: 2021-11-08 04:12:02,435 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:12:05 wikitech-static check_icinga[27669]: 2021-11-08 04:12:05,517 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:12:05 wikitech-static check_icinga[27671]: 2021-11-08 04:12:05,638 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:14:01 wikitech-static CRON[27746]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:14:01 wikitech-static CRON[27747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:14:03 wikitech-static check_icinga[27748]: 2021-11-08 04:14:03,453 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:14:03 wikitech-static check_icinga[27749]: 2021-11-08 04:14:03,456 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:14:07 wikitech-static check_icinga[27748]: 2021-11-08 04:14:07,312 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:14:07 wikitech-static check_icinga[27749]: 2021-11-08 04:14:07,333 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:16:01 wikitech-static CRON[27825]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:16:01 wikitech-static CRON[27826]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:16:03 wikitech-static check_icinga[27828]: 2021-11-08 04:16:03,589 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:16:03 wikitech-static check_icinga[27827]: 2021-11-08 04:16:03,593 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:16:06 wikitech-static check_icinga[27827]: 2021-11-08 04:16:06,768 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:16:07 wikitech-static check_icinga[27828]: 2021-11-08 04:16:07,073 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:17:01 wikitech-static CRON[27874]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 8 04:18:01 wikitech-static CRON[27908]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:18:01 wikitech-static CRON[27910]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:18:02 wikitech-static check_icinga[27911]: 2021-11-08 04:18:02,344 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:18:02 wikitech-static check_icinga[27909]: 2021-11-08 04:18:02,364 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:18:05 wikitech-static check_icinga[27909]: 2021-11-08 04:18:05,427 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:18:05 wikitech-static check_icinga[27911]: 2021-11-08 04:18:05,478 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:18:25 wikitech-static import-wikitech.sh[26942]: 19100 (17.40 pages/sec 17.40 revs/sec) Nov 8 04:18:33 wikitech-static import-wikitech.sh[26942]: 19200 (17.35 pages/sec 17.35 revs/sec) Nov 8 04:18:43 wikitech-static import-wikitech.sh[26942]: 19300 (17.29 pages/sec 17.29 revs/sec) Nov 8 04:18:51 wikitech-static import-wikitech.sh[26942]: 19400 (17.26 pages/sec 17.26 revs/sec) Nov 8 04:18:55 wikitech-static import-wikitech.sh[26942]: 19500 (17.28 pages/sec 17.28 revs/sec) Nov 8 04:18:59 wikitech-static import-wikitech.sh[26942]: 19600 (17.32 pages/sec 17.32 revs/sec) Nov 8 04:19:02 wikitech-static import-wikitech.sh[26942]: 19700 (17.36 pages/sec 17.36 revs/sec) Nov 8 04:19:04 wikitech-static import-wikitech.sh[26942]: 19800 (17.41 pages/sec 17.41 revs/sec) Nov 8 04:19:07 wikitech-static import-wikitech.sh[26942]: 19900 (17.45 pages/sec 17.45 revs/sec) Nov 8 04:19:25 wikitech-static import-wikitech.sh[26942]: 20000 (17.28 pages/sec 17.28 revs/sec) Nov 8 04:19:29 wikitech-static import-wikitech.sh[26942]: 20100 (17.30 pages/sec 17.30 revs/sec) Nov 8 04:19:32 wikitech-static import-wikitech.sh[26942]: 20200 (17.34 pages/sec 17.34 revs/sec) Nov 8 04:19:36 wikitech-static import-wikitech.sh[26942]: 20300 (17.36 pages/sec 17.36 revs/sec) Nov 8 04:19:40 wikitech-static import-wikitech.sh[26942]: 20400 (17.39 pages/sec 17.39 revs/sec) Nov 8 04:19:42 wikitech-static import-wikitech.sh[26942]: 20500 (17.45 pages/sec 17.45 revs/sec) Nov 8 04:19:45 wikitech-static import-wikitech.sh[26942]: 20600 (17.49 pages/sec 17.49 revs/sec) Nov 8 04:19:47 wikitech-static import-wikitech.sh[26942]: 20700 (17.55 pages/sec 17.55 revs/sec) Nov 8 04:19:48 wikitech-static import-wikitech.sh[26942]: 20800 (17.61 pages/sec 17.61 revs/sec) Nov 8 04:19:51 wikitech-static import-wikitech.sh[26942]: 20900 (17.64 pages/sec 17.64 revs/sec) Nov 8 04:19:54 wikitech-static import-wikitech.sh[26942]: 21000 (17.70 pages/sec 17.70 revs/sec) Nov 8 04:19:54 wikitech-static import-wikitech.sh[26942]: 21100 (17.77 pages/sec 17.77 revs/sec) Nov 8 04:19:55 wikitech-static import-wikitech.sh[26942]: 21200 (17.85 pages/sec 17.85 revs/sec) Nov 8 04:19:55 wikitech-static import-wikitech.sh[26942]: 21300 (17.93 pages/sec 17.93 revs/sec) Nov 8 04:19:55 wikitech-static import-wikitech.sh[26942]: 21400 (18.00 pages/sec 18.00 revs/sec) Nov 8 04:19:57 wikitech-static import-wikitech.sh[26942]: 21500 (18.07 pages/sec 18.07 revs/sec) Nov 8 04:19:58 wikitech-static import-wikitech.sh[26942]: 21600 (18.13 pages/sec 18.13 revs/sec) Nov 8 04:20:00 wikitech-static import-wikitech.sh[26942]: 21700 (18.19 pages/sec 18.19 revs/sec) Nov 8 04:20:01 wikitech-static import-wikitech.sh[26942]: 21800 (18.26 pages/sec 18.26 revs/sec) Nov 8 04:20:01 wikitech-static CRON[27987]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:20:01 wikitech-static CRON[27988]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:20:03 wikitech-static import-wikitech.sh[26942]: 21900 (18.31 pages/sec 18.31 revs/sec) Nov 8 04:20:05 wikitech-static import-wikitech.sh[26942]: 22000 (18.36 pages/sec 18.36 revs/sec) Nov 8 04:20:07 wikitech-static import-wikitech.sh[26942]: 22100 (18.41 pages/sec 18.41 revs/sec) Nov 8 04:20:09 wikitech-static check_icinga[27989]: 2021-11-08 04:20:09,308 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:20:09 wikitech-static check_icinga[27990]: 2021-11-08 04:20:09,310 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:20:09 wikitech-static import-wikitech.sh[26942]: 22200 (18.47 pages/sec 18.47 revs/sec) Nov 8 04:20:10 wikitech-static import-wikitech.sh[26942]: 22300 (18.53 pages/sec 18.53 revs/sec) Nov 8 04:20:11 wikitech-static import-wikitech.sh[26942]: 22400 (18.61 pages/sec 18.61 revs/sec) Nov 8 04:20:11 wikitech-static import-wikitech.sh[26942]: 22500 (18.68 pages/sec 18.68 revs/sec) Nov 8 04:20:12 wikitech-static import-wikitech.sh[26942]: 22600 (18.75 pages/sec 18.75 revs/sec) Nov 8 04:20:12 wikitech-static check_icinga[27989]: 2021-11-08 04:20:12,957 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:20:13 wikitech-static check_icinga[27990]: 2021-11-08 04:20:13,207 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:20:13 wikitech-static import-wikitech.sh[26942]: 22700 (18.82 pages/sec 18.82 revs/sec) Nov 8 04:20:13 wikitech-static import-wikitech.sh[26942]: 22800 (18.90 pages/sec 18.90 revs/sec) Nov 8 04:20:14 wikitech-static import-wikitech.sh[26942]: 22900 (18.98 pages/sec 18.98 revs/sec) Nov 8 04:20:14 wikitech-static import-wikitech.sh[26942]: 23000 (19.06 pages/sec 19.06 revs/sec) Nov 8 04:20:14 wikitech-static import-wikitech.sh[26942]: 23100 (19.13 pages/sec 19.13 revs/sec) Nov 8 04:20:15 wikitech-static import-wikitech.sh[26942]: 23200 (19.20 pages/sec 19.20 revs/sec) Nov 8 04:20:16 wikitech-static import-wikitech.sh[26942]: 23300 (19.27 pages/sec 19.27 revs/sec) Nov 8 04:20:16 wikitech-static import-wikitech.sh[26942]: 23400 (19.35 pages/sec 19.35 revs/sec) Nov 8 04:20:17 wikitech-static import-wikitech.sh[26942]: 23500 (19.42 pages/sec 19.42 revs/sec) Nov 8 04:20:17 wikitech-static import-wikitech.sh[26942]: 23600 (19.50 pages/sec 19.50 revs/sec) Nov 8 04:20:18 wikitech-static import-wikitech.sh[26942]: 23700 (19.57 pages/sec 19.57 revs/sec) Nov 8 04:20:19 wikitech-static import-wikitech.sh[26942]: 23800 (19.64 pages/sec 19.64 revs/sec) Nov 8 04:20:19 wikitech-static import-wikitech.sh[26942]: 23900 (19.72 pages/sec 19.72 revs/sec) Nov 8 04:20:19 wikitech-static import-wikitech.sh[26942]: 24000 (19.79 pages/sec 19.79 revs/sec) Nov 8 04:20:20 wikitech-static import-wikitech.sh[26942]: 24100 (19.87 pages/sec 19.87 revs/sec) Nov 8 04:20:37 wikitech-static import-wikitech.sh[26942]: Done! Nov 8 04:20:37 wikitech-static import-wikitech.sh[26942]: You might want to run rebuildrecentchanges.php to regenerate RecentChanges, Nov 8 04:20:37 wikitech-static import-wikitech.sh[26942]: and initSiteStats.php to update page and revision counts Nov 8 04:20:49 wikitech-static import-wikitech.sh[26942]: 100 (25.31 pages/sec 25.31 revs/sec) Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: 200 (40.81 pages/sec 40.81 revs/sec) Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: MWException from line 974 of /srv/mediawiki/w/includes/import/WikiImporter.php: Missing text field in import. Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #0 /srv/mediawiki/w/includes/import/WikiImporter.php(1134): WikiImporter->makeContent(Object(Title), '830', Array) Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #1 /srv/mediawiki/w/includes/import/WikiImporter.php(1111): WikiImporter->processUpload(Array, Array) Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #2 /srv/mediawiki/w/includes/import/WikiImporter.php(863): WikiImporter->handleUpload(Array) Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #3 /srv/mediawiki/w/includes/import/WikiImporter.php(678): WikiImporter->handlePage() Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #4 /srv/mediawiki/w/maintenance/importDump.php(353): WikiImporter->doImport() Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #5 /srv/mediawiki/w/maintenance/importDump.php(286): BackupReader->importFromHandle(Resource id #741) Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #6 /srv/mediawiki/w/maintenance/importDump.php(130): BackupReader->importFromFile('compress.zlib:/...') Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #7 /srv/mediawiki/w/maintenance/doMaintenance.php(112): BackupReader->execute() Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #8 /srv/mediawiki/w/maintenance/importDump.php(358): require_once('/srv/mediawiki/...') Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #9 {main} Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: Rebuilding $wgRCMaxAge=7776000 seconds (90 days) Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: Clearing recentchanges table for time range... Nov 8 04:20:59 wikitech-static import-wikitech.sh[26942]: Loading from page and revision tables... Nov 8 04:21:02 wikitech-static import-wikitech.sh[26942]: Inserting from page and revision tables... Nov 8 04:22:01 wikitech-static CRON[28152]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:22:01 wikitech-static CRON[28153]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:22:02 wikitech-static check_icinga[28155]: 2021-11-08 04:22:02,712 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:22:02 wikitech-static check_icinga[28154]: 2021-11-08 04:22:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:22:05 wikitech-static check_icinga[28154]: 2021-11-08 04:22:05,572 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:22:05 wikitech-static check_icinga[28155]: 2021-11-08 04:22:05,862 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:22:19 wikitech-static import-wikitech.sh[26942]: Updating links and size differences... Nov 8 04:22:43 wikitech-static import-wikitech.sh[26942]: Loading from user and logging tables... Nov 8 04:22:43 wikitech-static import-wikitech.sh[26942]: Flagging bot account edits... Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Flagging auto-patrolled edits... Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Removing duplicate revision and logging entries... Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Deleting feed timestamps. Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Done. Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: ERROR:root:Failed to get db server for wikitech Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: last image dump for wikitech was: never Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBadminuser Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBuser Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBadminpassword Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBpassword Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: db credentials acquired Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: base url for image retrieval is https://upload.wikimedia.org/wikipedia/labs Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command /usr/bin/php /srv/mediawiki/w/maintenance/getSlaveServer.php --wiki=wikitech --group=dump Nov 8 04:23:21 wikitech-static import-wikitech.sh[26942]: Reloading Apache httpd web server: apache2. Nov 8 04:23:21 wikitech-static systemd[1]: Stopping memcached daemon... Nov 8 04:23:21 wikitech-static systemd-memcached-wrapper[27630]: Signal handled: Terminated. Nov 8 04:23:21 wikitech-static systemd[1]: Stopped memcached daemon. Nov 8 04:23:21 wikitech-static systemd[1]: Started memcached daemon. Nov 8 04:24:01 wikitech-static CRON[28285]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:24:01 wikitech-static CRON[28287]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:24:02 wikitech-static check_icinga[28286]: 2021-11-08 04:24:02,814 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:24:02 wikitech-static check_icinga[28288]: 2021-11-08 04:24:02,818 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:24:05 wikitech-static check_icinga[28286]: 2021-11-08 04:24:05,898 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:24:06 wikitech-static check_icinga[28288]: 2021-11-08 04:24:06,081 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:26:01 wikitech-static CRON[28442]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:26:01 wikitech-static CRON[28444]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:26:02 wikitech-static check_icinga[28445]: 2021-11-08 04:26:02,324 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:26:02 wikitech-static check_icinga[28443]: 2021-11-08 04:26:02,400 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:26:05 wikitech-static check_icinga[28445]: 2021-11-08 04:26:05,423 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:26:05 wikitech-static check_icinga[28443]: 2021-11-08 04:26:05,523 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:28:01 wikitech-static CRON[28519]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:28:01 wikitech-static CRON[28521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:28:02 wikitech-static check_icinga[28520]: 2021-11-08 04:28:02,914 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:28:02 wikitech-static check_icinga[28522]: 2021-11-08 04:28:02,947 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:28:06 wikitech-static check_icinga[28522]: 2021-11-08 04:28:06,068 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:28:06 wikitech-static check_icinga[28520]: 2021-11-08 04:28:06,150 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:30:01 wikitech-static CRON[28598]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:30:01 wikitech-static CRON[28600]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:30:02 wikitech-static check_icinga[28601]: 2021-11-08 04:30:02,720 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:30:02 wikitech-static check_icinga[28599]: 2021-11-08 04:30:02,724 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:30:05 wikitech-static check_icinga[28599]: 2021-11-08 04:30:05,666 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:30:05 wikitech-static check_icinga[28601]: 2021-11-08 04:30:05,922 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:32:02 wikitech-static CRON[28685]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:32:02 wikitech-static CRON[28687]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:32:03 wikitech-static check_icinga[28686]: 2021-11-08 04:32:03,093 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:32:03 wikitech-static check_icinga[28688]: 2021-11-08 04:32:03,100 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:32:06 wikitech-static check_icinga[28688]: 2021-11-08 04:32:06,058 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:32:06 wikitech-static check_icinga[28686]: 2021-11-08 04:32:06,140 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:34:01 wikitech-static CRON[28760]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:34:01 wikitech-static CRON[28762]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:34:02 wikitech-static check_icinga[28761]: 2021-11-08 04:34:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:34:02 wikitech-static check_icinga[28763]: 2021-11-08 04:34:02,390 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:34:03 wikitech-static check_icinga[28761]: 2021-11-08 04:34:03,784 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)'] Nov 8 04:34:05 wikitech-static check_icinga[28763]: 2021-11-08 04:34:05,539 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:34:13 wikitech-static check_icinga[28761]: 2021-11-08 04:34:13,793 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:34:16 wikitech-static check_icinga[28761]: 2021-11-08 04:34:16,791 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:36:02 wikitech-static CRON[29000]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:36:02 wikitech-static CRON[29001]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:36:13 wikitech-static check_icinga[29003]: 2021-11-08 04:36:12,905 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:36:13 wikitech-static check_icinga[29002]: 2021-11-08 04:36:12,909 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:36:16 wikitech-static check_icinga[29002]: 2021-11-08 04:36:16,527 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:36:16 wikitech-static check_icinga[29003]: 2021-11-08 04:36:16,739 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:38:03 wikitech-static CRON[29084]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:38:03 wikitech-static CRON[29085]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:39:12 wikitech-static CRON[29140]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 04:39:16 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 04:40:00 wikitech-static check_icinga[29086]: 2021-11-08 04:40:00,028 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:40:00 wikitech-static check_icinga[29087]: 2021-11-08 04:39:59,994 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:40:04 wikitech-static CRON[29186]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:40:04 wikitech-static CRON[29185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:40:09 wikitech-static check_icinga[29086]: 2021-11-08 04:40:09,251 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:40:09 wikitech-static check_icinga[29087]: 2021-11-08 04:40:09,915 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:40:15 wikitech-static systemd[1]: Started Clean php session files. Nov 8 04:41:17 wikitech-static check_icinga[29188]: 2021-11-08 04:41:16,773 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 04:41:20 wikitech-static check_icinga[29187]: 2021-11-08 04:41:16,774 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 04:41:25 wikitech-static check_icinga[29187]: 2021-11-08 04:41:25,025 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 04:41:25 wikitech-static check_icinga[29188]: 2021-11-08 04:41:25,030 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 04:42:09 wikitech-static CRON[29349]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:42:09 wikitech-static CRON[29350]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:44:24 wikitech-static CRON[29406]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:44:24 wikitech-static CRON[29407]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:46:26 wikitech-static CRON[29458]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:46:26 wikitech-static CRON[29457]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:49:21 wikitech-static CRON[29491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:49:28 wikitech-static CRON[29492]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:52:29 wikitech-static CRON[29522]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:53:27 wikitech-static CRON[29523]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:54:29 wikitech-static sshd[785]: /usr/sbin/sshd: error while loading shared libraries: libgcrypt.so.20: failed to map segment from shared object Nov 8 04:55:00 wikitech-static CRON[29507]: (CRON) info (No MTA installed, discarding output) Nov 8 04:57:35 wikitech-static CRON[29541]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 04:58:03 wikitech-static CRON[29542]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 04:58:31 wikitech-static cron[669]: Module is unknown Nov 8 04:58:53 wikitech-static cron[669]: (CRON) error (can't fork) Nov 8 04:58:55 wikitech-static kernel: [60933412.339095] check_icinga[29461]: segfault at 1dcb0 ip 000000000001dcb0 sp 00007ffcd0dbd6c8 error 14 in python3.5[558e772b1000+3f0000] Nov 8 04:58:56 wikitech-static CRON[29533]: (CRON) info (No MTA installed, discarding output) Nov 8 04:58:56 wikitech-static CRON[29532]: (CRON) info (No MTA installed, discarding output) Nov 8 04:59:01 wikitech-static cron[669]: (CRON) error (can't fork) Nov 8 04:59:01 wikitech-static cron[669]: (CRON) error (can't fork) Nov 8 04:59:01 wikitech-static cron[669]: Authentication failure Nov 8 04:59:03 wikitech-static CRON[29547]: Module is unknown Nov 8 04:59:03 wikitech-static CRON[29454]: (CRON) info (No MTA installed, discarding output) Nov 8 04:59:03 wikitech-static CRON[29557]: Authentication failure Nov 8 04:59:05 wikitech-static CRON[29567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:01:38 wikitech-static CRON[29585]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:01:38 wikitech-static CRON[29586]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:02:18 wikitech-static CRON[29602]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:02:18 wikitech-static CRON[29603]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:02:20 wikitech-static check_icinga[29355]: 2021-11-08 05:02:17,374 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:02:20 wikitech-static check_icinga[29356]: 2021-11-08 05:02:17,320 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 05:04:05 wikitech-static check_icinga[29356]: 2021-11-08 05:04:02,881 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))"] Nov 8 05:04:06 wikitech-static check_icinga[29355]: 2021-11-08 05:04:03,826 [ERROR] Check for host alert1001.wikimedia.org (1/3) failed: ["('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))"] Nov 8 05:04:18 wikitech-static check_icinga[29356]: 2021-11-08 05:04:18,217 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 05:04:19 wikitech-static check_icinga[29355]: 2021-11-08 05:04:19,433 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:04:39 wikitech-static CRON[29617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:04:39 wikitech-static CRON[29618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:05:06 wikitech-static check_icinga[29355]: 2021-11-08 05:05:02,357 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 05:05:06 wikitech-static check_icinga[29356]: 2021-11-08 05:05:02,357 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 05:06:35 wikitech-static CRON[29636]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:06:37 wikitech-static CRON[29637]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:08:18 wikitech-static CRON[29646]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:08:18 wikitech-static CRON[29647]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:09:27 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 05:09:51 wikitech-static CRON[29667]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 05:10:07 wikitech-static CRON[29675]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:10:07 wikitech-static CRON[29676]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:10:11 wikitech-static check_icinga[29493]: 2021-11-08 05:10:11,014 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:10:13 wikitech-static check_icinga[29527]: 2021-11-08 05:10:11,039 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 05:10:13 wikitech-static check_icinga[29411]: 2021-11-08 05:10:11,437 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:10:13 wikitech-static check_icinga[29460]: 2021-11-08 05:10:11,360 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:10:13 wikitech-static check_icinga[29412]: 2021-11-08 05:10:11,222 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 05:10:13 wikitech-static check_icinga[29494]: 2021-11-08 05:10:11,109 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 05:10:13 wikitech-static check_icinga[29587]: 2021-11-08 05:10:10,983 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:11:57 wikitech-static check_icinga[29494]: 2021-11-08 05:11:54,044 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))"] Nov 8 05:51:12 wikitech-static kernel: [60936548.020519] systemd invoked oom-killer: gfp_mask=0x24201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=0, order=0, oom_score_adj=0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020522] systemd cpuset=/ mems_allowed=0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020528] CPU: 0 PID: 1 Comm: systemd Not tainted 4.9.0-11-amd64 #1 Debian 4.9.189-3+deb9u2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020530] Hardware name: Xen HVM domU, BIOS 4.1.5 11/28/2013 Nov 8 05:51:14 wikitech-static kernel: [60936548.020533] 0000000000000000 ffffffff93936404 ffffaf52c01a3c10 ffff944999270ec0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020537] ffffffff93809690 0000000000000000 0000000000000000 0000000c00000000 Nov 8 05:51:14 wikitech-static kernel: [60936548.020540] ffff9449bdaeed80 ffffffff9378d207 0000004200000000 0000000000000001 Nov 8 05:51:14 wikitech-static kernel: [60936548.020543] Call Trace: Nov 8 05:51:14 wikitech-static kernel: [60936548.020551] [] ? dump_stack+0x5c/0x78 Nov 8 05:51:14 wikitech-static kernel: [60936548.020555] [] ? dump_header+0x78/0x1fd Nov 8 05:51:14 wikitech-static kernel: [60936548.020558] [] ? get_page_from_freelist+0x3f7/0xb20 Nov 8 05:51:14 wikitech-static kernel: [60936548.020561] [] ? oom_kill_process+0x22a/0x3f0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020564] [] ? out_of_memory+0x111/0x470 Nov 8 05:51:14 wikitech-static kernel: [60936548.020567] [] ? __alloc_pages_slowpath+0xa1f/0xb30 Nov 8 05:51:14 wikitech-static kernel: [60936548.020570] [] ? __alloc_pages_nodemask+0x201/0x260 Nov 8 05:51:14 wikitech-static kernel: [60936548.020573] [] ? alloc_pages_current+0x91/0x140 Nov 8 05:51:14 wikitech-static kernel: [60936548.020575] [] ? filemap_fault+0x326/0x5d0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020610] [] ? ext4_filemap_fault+0x31/0x50 [ext4] Nov 8 05:51:14 wikitech-static kernel: [60936548.020613] [] ? __do_fault+0xa9/0x1c0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020616] [] ? handle_mm_fault+0xda4/0x1350 Nov 8 05:51:14 wikitech-static kernel: [60936548.020619] [] ? ep_poll+0x192/0x350 Nov 8 05:51:14 wikitech-static kernel: [60936548.020622] [] ? __do_page_fault+0x255/0x4f0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020625] [] ? posix_ktime_get_ts+0xd/0x10 Nov 8 05:51:14 wikitech-static kernel: [60936548.020629] [] ? page_fault+0x28/0x30 Nov 8 05:51:14 wikitech-static kernel: [60936548.020631] Mem-Info: Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] active_anon:87514 inactive_anon:87578 isolated_anon:32 Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] active_file:501 inactive_file:646 isolated_file:0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] unevictable:0 dirty:0 writeback:1 unstable:0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] slab_reclaimable:2835 slab_unreclaimable:12606 Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] mapped:2791 shmem:6690 pagetables:11307 bounce:0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] free:12214 free_pcp:14 free_cma:0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020641] Node 0 active_anon:350056kB inactive_anon:350312kB active_file:2004kB inactive_file:2584kB unevictable:0kB isolated(anon):128kB isolated(file):0kB mapped:11164kB dirty:0kB writeback:4kB shmem:26760kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:42525 all_unreclaimable? yes Nov 8 05:51:14 wikitech-static kernel: [60936548.020642] Node 0 DMA free:4524kB min:720kB low:900kB high:1080kB active_anon:3980kB inactive_anon:3864kB active_file:4kB inactive_file:12kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:40kB slab_unreclaimable:612kB kernel_stack:64kB pagetables:468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Nov 8 05:51:14 wikitech-static kernel: [60936548.020649] lowmem_reserve[]: 0 951 951 951 951 Nov 8 05:51:14 wikitech-static kernel: [60936548.020653] Node 0 DMA32 free:44332kB min:44332kB low:55412kB high:66492kB active_anon:346076kB inactive_anon:346448kB active_file:2000kB inactive_file:2576kB unevictable:0kB writepending:4kB present:1028096kB managed:998436kB mlocked:0kB slab_reclaimable:11300kB slab_unreclaimable:49812kB kernel_stack:4240kB pagetables:44760kB bounce:0kB free_pcp:56kB local_pcp:56kB free_cma:0kB Nov 8 05:51:14 wikitech-static kernel: [60936548.020658] lowmem_reserve[]: 0 0 0 0 0 Nov 8 05:51:14 wikitech-static kernel: [60936548.020662] Node 0 DMA: 87*4kB (M) 118*8kB (UM) 70*16kB (M) 8*32kB (UM) 11*64kB (UM) 7*128kB (UM) 1*256kB (U) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4524kB Nov 8 05:51:14 wikitech-static kernel: [60936548.020674] Node 0 DMA32: 9214*4kB (UME) 898*8kB (UME) 19*16kB (UM) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44344kB Nov 8 05:51:14 wikitech-static kernel: [60936548.020685] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Nov 8 05:51:14 wikitech-static kernel: [60936548.020687] 8723 total pagecache pages Nov 8 05:51:14 wikitech-static kernel: [60936548.020689] 873 pages in swap cache Nov 8 05:51:14 wikitech-static kernel: [60936548.020690] Swap cache stats: add 20773779, delete 20772906, find 85139396/90941849 Nov 8 05:51:14 wikitech-static kernel: [60936548.020692] Free swap = 0kB Nov 8 05:51:14 wikitech-static kernel: [60936548.020693] Total swap = 1048572kB Nov 8 05:51:14 wikitech-static kernel: [60936548.020694] 261021 pages RAM Nov 8 05:51:14 wikitech-static kernel: [60936548.020696] 0 pages HighMem/MovableOnly Nov 8 05:51:14 wikitech-static kernel: [60936548.020697] 7436 pages reserved Nov 8 05:51:14 wikitech-static kernel: [60936548.020698] 0 pages hwpoisoned Nov 8 05:51:14 wikitech-static kernel: [60936548.020699] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name Nov 8 05:51:14 wikitech-static kernel: [60936548.020704] [ 639] 106 639 11279 43 28 3 94 -900 dbus-daemon Nov 8 05:51:14 wikitech-static kernel: [60936548.020707] [ 652] 0 652 1051 0 8 3 33 0 acpid Nov 8 05:51:14 wikitech-static kernel: [60936548.020710] [ 669] 0 669 7416 28 19 3 43 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020713] [ 674] 0 674 11814 32 28 3 324 0 systemd-logind Nov 8 05:51:14 wikitech-static kernel: [60936548.020715] [ 688] 0 688 3631 0 12 3 39 0 agetty Nov 8 05:51:14 wikitech-static kernel: [60936548.020718] [ 703] 0 703 1069 0 8 3 28 0 sshguard-journa Nov 8 05:51:14 wikitech-static kernel: [60936548.020722] [ 706] 0 706 12724 15 29 4 96 0 journalctl Nov 8 05:51:14 wikitech-static kernel: [60936548.020724] [ 785] 0 785 17489 27 39 3 166 -1000 sshd Nov 8 05:51:14 wikitech-static kernel: [60936548.020727] [ 907] 0 907 35210 83 35 3 1578 0 nova-agent Nov 8 05:51:14 wikitech-static kernel: [60936548.020730] [26102] 0 26102 14101 0 30 3 206 0 systemd Nov 8 05:51:14 wikitech-static kernel: [60936548.020732] [26103] 0 26103 57519 0 48 3 438 0 (sd-pam) Nov 8 05:51:14 wikitech-static kernel: [60936548.020735] [ 2724] 0 2724 62561 40 30 4 366 0 rsyslogd Nov 8 05:51:14 wikitech-static kernel: [60936548.020737] [ 3273] 107 3273 177141 9001 213 4 55042 0 mysqld Nov 8 05:51:14 wikitech-static kernel: [60936548.020740] [14717] 0 14717 31701 0 32 3 960 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020743] [15062] 0 15062 31701 0 32 3 959 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020745] [15381] 0 15381 31701 0 33 3 960 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020748] [15452] 0 15452 31701 0 32 3 959 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020750] [15506] 0 15506 31699 0 31 3 1009 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020753] [16228] 0 16228 31701 0 30 3 959 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020755] [16325] 0 16325 31701 0 31 3 960 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020758] [16447] 0 16447 31701 0 31 3 960 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020760] [16575] 0 16575 31701 0 32 3 959 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020763] [16905] 0 16905 31699 0 33 4 958 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020765] [17027] 0 17027 31699 0 32 3 959 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020768] [17157] 0 17157 31701 0 32 3 959 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020770] [17475] 0 17475 31699 0 32 3 958 0 dirmngr Nov 8 05:51:14 wikitech-static kernel: [60936548.020773] [ 1213] 100 1213 31821 1 32 3 132 0 systemd-timesyn Nov 8 05:51:14 wikitech-static kernel: [60936548.020776] [17211] 0 17211 11310 12 23 3 90 -1000 systemd-udevd Nov 8 05:51:14 wikitech-static kernel: [60936548.020778] [15128] 0 15128 116636 130 151 3 1795 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020781] [28241] 108 28241 92324 944 45 4 7894 0 memcached Nov 8 05:51:14 wikitech-static kernel: [60936548.020784] [28248] 33 28248 152271 4664 206 4 14014 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020786] [28249] 33 28249 172155 10151 245 4 29173 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020789] [28250] 33 28250 140714 4333 184 4 3823 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020791] [28251] 33 28251 172221 10180 246 4 29277 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020794] [28252] 33 28252 158768 6558 220 4 18787 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020797] [28253] 33 28253 166207 9128 233 4 23874 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020799] [28411] 33 28411 119139 3125 173 3 2240 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020802] [28439] 33 28439 155002 5339 212 4 16703 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020804] [28768] 33 28768 118447 1687 172 3 2097 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020807] [28817] 33 28817 175595 13369 238 4 19314 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020809] [29050] 33 29050 137371 2755 177 4 1938 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020812] [29095] 33 29095 158268 1582 185 4 4844 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020814] [29097] 33 29097 118891 3111 170 3 1991 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020817] [29169] 33 29169 161532 4034 191 4 6464 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020819] [29301] 33 29301 166392 4508 201 4 10741 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020821] [29365] 33 29365 135092 1486 175 4 2007 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020824] [29391] 33 29391 134110 1337 169 4 1849 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020827] [29393] 33 29393 135061 2555 162 4 2052 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020829] [29418] 33 29418 135070 2628 170 4 1923 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020832] [29419] 33 29419 135020 3041 171 4 1892 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020834] [29508] 0 29508 12206 19 28 3 86 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020837] [29523] 0 29523 1069 0 7 3 21 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020839] [29527] 0 29527 39825 6411 57 4 306 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020842] [29589] 33 29589 118799 3159 170 3 1862 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020845] [29600] 0 29600 12206 24 28 3 80 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020847] [29601] 0 29601 12206 18 28 3 86 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020850] [29602] 0 29602 1069 0 8 3 21 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020852] [29603] 0 29603 1069 0 8 3 22 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020855] [29604] 0 29604 21598 4140 47 3 989 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020858] [29605] 0 29605 21590 4044 46 3 1080 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020860] [29606] 33 29606 135088 2823 170 4 1952 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020863] [29614] 0 29614 12206 39 28 3 65 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020865] [29615] 0 29615 12206 38 28 3 66 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020868] [29617] 0 29617 1069 0 7 3 16 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020871] [29618] 0 29618 1069 0 8 3 16 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020873] [29619] 0 29619 38077 3863 48 3 984 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020876] [29620] 0 29620 38110 3958 49 4 900 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020878] [29631] 0 29631 12206 33 28 3 71 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020881] [29632] 0 29632 12206 38 28 3 66 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020883] [29636] 0 29636 1069 17 8 3 0 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020886] [29637] 0 29637 1069 15 9 3 1 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020889] [29638] 0 29638 36555 3643 42 3 1005 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020891] [29639] 0 29639 36141 3608 46 3 1006 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020894] [29641] 33 29641 117775 1675 160 3 1709 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020896] [29642] 33 29642 118156 2788 161 3 1713 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020899] [29644] 0 29644 12206 44 28 3 60 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020901] [29645] 0 29645 12206 47 28 3 57 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020904] [29646] 0 29646 1069 8 8 3 9 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020906] [29647] 0 29647 1069 6 8 3 11 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020909] [29649] 0 29649 36392 3987 45 3 508 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020911] [29650] 0 29650 36171 4053 47 4 469 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020914] [29652] 0 29652 1069 6 8 3 10 0 sessionclean Nov 8 05:51:14 wikitech-static kernel: [60936548.020917] [29653] 0 29653 1069 8 8 3 15 0 sessionclean Nov 8 05:51:14 wikitech-static kernel: [60936548.020919] [29656] 0 29656 3588 9 10 3 10 0 sort Nov 8 05:51:14 wikitech-static kernel: [60936548.020922] [29657] 0 29657 3588 13 10 3 7 0 sort Nov 8 05:51:14 wikitech-static kernel: [60936548.020925] [29658] 0 29658 1069 13 8 3 10 0 sessionclean Nov 8 05:51:14 wikitech-static kernel: [60936548.020927] [29671] 0 29671 12206 18 28 3 86 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020930] [29672] 0 29672 12206 25 28 3 79 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020932] [29674] 0 29674 62982 722 107 3 178 0 php7.3 Nov 8 05:51:14 wikitech-static kernel: [60936548.020935] [29675] 0 29675 1069 0 7 3 21 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020938] [29676] 0 29676 1069 0 7 3 22 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020940] [29677] 0 29677 35574 3850 44 3 421 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020943] [29678] 0 29678 35590 3815 44 3 458 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020945] [29706] 0 29706 12206 45 28 3 60 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020948] [29707] 0 29707 12206 49 28 3 56 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020950] [29717] 0 29717 1069 9 7 4 11 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020953] [29718] 0 29718 1069 7 7 3 13 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020956] [29720] 0 29720 12206 41 28 3 64 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020958] [29721] 0 29721 12206 38 28 3 67 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.020961] [29723] 0 29723 33669 3131 39 3 333 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020963] [29724] 0 29724 33606 3123 41 3 324 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020966] [29752] 0 29752 1069 14 8 3 7 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020968] [29754] 0 29754 1069 14 8 3 6 0 sh Nov 8 05:51:14 wikitech-static kernel: [60936548.020971] [29755] 0 29755 33538 2650 39 3 386 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020974] [29768] 0 29768 33644 3229 40 3 236 0 check_icinga Nov 8 05:51:14 wikitech-static kernel: [60936548.020976] [29869] 33 29869 77573 1488 131 3 954 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020979] [29871] 33 29871 117598 1032 151 3 1684 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020981] [29876] 33 29876 117117 1120 150 3 1617 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020984] [29877] 33 29877 117592 1034 151 3 1686 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020986] [29884] 33 29884 117136 1130 151 3 1643 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020989] [29887] 33 29887 117174 826 156 3 1672 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020991] [29892] 33 29892 77582 1482 133 3 956 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020994] [29893] 33 29893 77580 1499 132 3 950 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020996] [29894] 33 29894 117179 1083 156 3 1676 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.020999] [29918] 33 29918 117084 1070 150 3 1661 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021001] [29942] 33 29942 117086 622 148 3 1664 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021004] [29943] 33 29943 117064 673 149 3 1652 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021006] [29944] 33 29944 117080 563 149 3 1678 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021009] [29945] 33 29945 117080 1077 151 3 1653 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021011] [29965] 33 29965 2089 251 11 3 0 0 lua Nov 8 05:51:14 wikitech-static kernel: [60936548.021014] [29966] 33 29966 117064 666 148 3 1657 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021016] [30001] 33 30001 116657 792 146 3 1559 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021019] [30003] 33 30003 80693 903 134 3 1015 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021022] [30006] 33 30006 117068 677 148 3 1651 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021024] [30057] 0 30057 11166 66 26 3 31 0 cron Nov 8 05:51:14 wikitech-static kernel: [60936548.021027] [30074] 33 30074 116644 177 137 3 1752 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021029] [30076] 33 30076 77053 943 126 3 961 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021032] [30077] 33 30077 116644 171 137 3 1758 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021034] [30078] 33 30078 116649 231 139 3 1715 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021037] [30079] 33 30079 116649 229 139 3 1717 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021039] [30080] 33 30080 116644 171 137 3 1758 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021042] [30081] 33 30081 77053 947 126 3 958 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021044] [30082] 33 30082 116644 162 137 3 1760 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021047] [30083] 33 30083 116644 171 137 3 1758 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021049] [30084] 33 30084 116644 161 137 3 1761 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021052] [30085] 33 30085 116644 161 137 3 1761 0 apache2 Nov 8 05:51:14 wikitech-static kernel: [60936548.021054] Out of memory: Kill process 3273 (mysqld) score 124 or sacrifice child Nov 8 05:51:14 wikitech-static kernel: [60936548.021179] Killed process 3273 (mysqld) total-vm:708564kB, anon-rss:36004kB, file-rss:0kB, shmem-rss:0kB Nov 8 05:51:14 wikitech-static kernel: [60936548.046071] oom_reaper: reaped process 3273 (mysqld), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Linux version 4.9.0-11-amd64 (debian-kernel@lists.debian.org) (gcc version 6.3.0 20170516 (Debian 6.3.0-18+deb9u1) ) #1 SMP Debian 4.9.189-3+deb9u2 (2019-11-11) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.9.0-11-amd64 root=/dev/xvda1 ro quiet Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] x86/fpu: Legacy x87 FPU detected. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: BIOS-provided physical RAM map: Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fbfffff] usable Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] NX (Execute Disable) protection: active Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] SMBIOS 2.4 present. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMI: Xen HVM domU, BIOS 4.1.5 11/28/2013 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Hypervisor detected: Xen Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Xen version 4.1. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Xen Platform PCI: I/O protocol version 1 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] You might have to change the root device Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] from /dev/hd[a-d] to /dev/xvd[a-d] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] in your root= kernel command line option Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] HVMOP_pagetable_dying not supported Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Kernel/User page tables isolation: disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] AGP: No AGP bridge found Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: last_pfn = 0x3fc00 max_arch_pfn = 0x400000000 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] MTRR default type: write-back Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] MTRR fixed ranges enabled: Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 00000-9FFFF write-back Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] A0000-BFFFF write-combining Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] C0000-FFFFF write-back Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] MTRR variable ranges enabled: Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 0 base 0000F0000000 mask FFFFF8000000 uncachable Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 1 base 0000F8000000 mask FFFFFC000000 uncachable Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 2 disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 3 disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 4 disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 5 disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 6 disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 7 disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] TOM2: 000000083f000000 aka 33776M Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] found SMP MP-table at [mem 0x000fb710-0x000fb71f] mapped at [ffff918e000fb710] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Base memory trampoline at [ffff918e00098000] 98000 size 24576 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13535000, 0x13535fff] PGTABLE Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13536000, 0x13536fff] PGTABLE Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13537000, 0x13537fff] PGTABLE Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13538000, 0x13538fff] PGTABLE Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] RAMDISK: [mem 0x35aa2000-0x36d48fff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: Early table checksum verification disabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen ) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: XSDT 0x00000000FC00EF80 000044 (v01 Xen HVM 00000000 HVML 00000000) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: FACP 0x00000000FC00ED40 0000F4 (v04 Xen HVM 00000000 HVML 00000000) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: DSDT 0x00000000FC003040 00BC75 (v02 Xen HVM 00000000 INTL 20090123) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: FACS 0x00000000FC003000 000040 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: FACS 0x00000000FC003000 000040 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: APIC 0x00000000FC00EE40 0000D8 (v02 Xen HVM 00000000 HVML 00000000) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: HPET 0x00000000FC00EF20 000038 (v01 Xen HVM 00000000 HVML 00000000) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: WAET 0x00000000FC00EF58 000028 (v01 Xen HVM 00000000 HVML 00000000) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: Local APIC address 0xfee00000 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] No NUMA configuration found Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000003fbfffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] NODE_DATA(0) allocated [mem 0x3fbfb000-0x3fbfffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Zone ranges: Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA32 [mem 0x0000000001000000-0x000000003fbfffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Normal empty Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Device empty Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Movable zone start for each node Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Early memory node ranges Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009dfff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] node 0: [mem 0x0000000000100000-0x000000003fbfffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000003fbfffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] On node 0 totalpages: 261021 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA zone: 64 pages used for memmap Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA zone: 21 pages reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA zone: 3997 pages, LIFO batch:0 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA32 zone: 4016 pages used for memmap Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA32 zone: 257024 pages, LIFO batch:31 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: PM-Timer IO Port: 0x1f48 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: Local APIC address 0xfee00000 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ0 used by override. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ5 used by override. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ9 used by override. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ10 used by override. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ11 used by override. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Using ACPI (MADT) for SMP configuration information Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] smpboot: Allowing 15 CPUs, 14 hotplug CPUs Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: [mem 0x3fc00000-0xfbffffff] available for PCI devices Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Booting paravirtualized kernel on Xen HVM Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:15 nr_node_ids:1 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] percpu: Embedded 35 pages/cpu s105304 r8192 d29864 u262144 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] pcpu-alloc: s105304 r8192 d29864 u262144 alloc=1*2097152 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 -- Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] xen: PV spinlocks enabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 256920 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Policy zone: DMA32 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.9.0-11-amd64 root=/dev/xvda1 ro quiet Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] AGP: Checking aperture... Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] AGP: No AGP bridge found Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Calgary: detecting Calgary via BIOS EBDA area Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing! Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Memory: 990712K/1044084K available (6288K kernel code, 1162K rwdata, 2880K rodata, 1424K init, 656K bss, 53372K reserved, 0K cma-reserved) Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Hierarchical RCU implementation. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Build-time adjustment of leaf fanout to 64. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=15. Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=15 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] NR_IRQS:33024 nr_irqs:952 16 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] xen:events: Using 2-level ABI Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] xen:events: Xen HVM callback vector for event delivery is enabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Console: colour VGA+ 80x25 Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] console [tty0] enabled Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22! Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] hpet clockevent registered Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] tsc: Fast TSC calibration using PIT Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] tsc: Detected 2999.945 MHz processor Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] tsc: Marking TSC unstable due to TSCs unsynchronized Nov 8 05:54:27 wikitech-static kernel: [ 0.024000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6000.16 BogoMIPS (lpj=12000336) Nov 8 05:54:27 wikitech-static kernel: [ 0.024000] pid_max: default: 32768 minimum: 301 Nov 8 05:54:27 wikitech-static kernel: [ 0.024000] ACPI: Core revision 20160831 Nov 8 05:54:27 wikitech-static kernel: [ 0.031234] ACPI: 1 ACPI AML tables successfully acquired and loaded Nov 8 05:54:27 wikitech-static kernel: [ 0.031368] Security Framework initialized Nov 8 05:54:27 wikitech-static kernel: [ 0.031370] Yama: disabled by default; enable with sysctl kernel.yama.* Nov 8 05:54:27 wikitech-static kernel: [ 0.031382] AppArmor: AppArmor disabled by boot time parameter Nov 8 05:54:27 wikitech-static kernel: [ 0.031505] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.031976] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.032125] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.032128] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.032458] mce: CPU supports 0 MCE banks Nov 8 05:54:27 wikitech-static kernel: [ 0.032469] Last level iTLB entries: 4KB 512, 2MB 1024, 4MB 512 Nov 8 05:54:27 wikitech-static kernel: [ 0.032470] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 512, 1GB 0 Nov 8 05:54:27 wikitech-static kernel: [ 0.032471] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Nov 8 05:54:27 wikitech-static kernel: [ 0.032473] Spectre V2 : Spectre mitigation: LFENCE not serializing, switching to generic retpoline Nov 8 05:54:27 wikitech-static kernel: [ 0.033464] Spectre V2 : Mitigation: Full generic retpoline Nov 8 05:54:27 wikitech-static kernel: [ 0.033465] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Nov 8 05:54:27 wikitech-static kernel: [ 0.033467] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp Nov 8 05:54:27 wikitech-static kernel: [ 0.049324] ftrace: allocating 25339 entries in 99 pages Nov 8 05:54:27 wikitech-static kernel: [ 0.084143] smpboot: Max logical packages: 15 Nov 8 05:54:27 wikitech-static kernel: [ 0.085241] x2apic: IRQ remapping doesn't support X2APIC mode Nov 8 05:54:27 wikitech-static kernel: [ 0.088006] Switched APIC routing to physical flat. Nov 8 05:54:27 wikitech-static kernel: [ 0.091238] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0 Nov 8 05:54:27 wikitech-static kernel: [ 0.131664] clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Nov 8 05:54:27 wikitech-static kernel: [ 0.131703] Xen: using vcpuop timer interface Nov 8 05:54:27 wikitech-static kernel: [ 0.131714] installing Xen timer for CPU 0 Nov 8 05:54:27 wikitech-static kernel: [ 0.131817] smpboot: CPU0: AMD Opteron(tm) Processor 4332 HE (family: 0x15, model: 0x2, stepping: 0x0) Nov 8 05:54:27 wikitech-static kernel: [ 0.131860] cpu 0 spinlock event irq 53 Nov 8 05:54:27 wikitech-static kernel: [ 0.131862] Performance Events: AMD PMU driver. Nov 8 05:54:27 wikitech-static kernel: [ 0.131876] ... version: 0 Nov 8 05:54:27 wikitech-static kernel: [ 0.131877] ... bit width: 48 Nov 8 05:54:27 wikitech-static kernel: [ 0.131878] ... generic registers: 4 Nov 8 05:54:27 wikitech-static kernel: [ 0.131879] ... value mask: 0000ffffffffffff Nov 8 05:54:27 wikitech-static kernel: [ 0.131881] ... max period: 00007fffffffffff Nov 8 05:54:27 wikitech-static kernel: [ 0.131881] ... fixed-purpose events: 0 Nov 8 05:54:27 wikitech-static kernel: [ 0.131882] ... event mask: 000000000000000f Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] x86: Booted up 1 node, 1 CPUs Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] smpboot: Total of 1 processors activated (6000.16 BogoMIPS) Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] devtmpfs: initialized Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] x86/mm: Memory block size: 128MB Nov 8 05:54:27 wikitech-static kernel: [ 0.132617] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns Nov 8 05:54:27 wikitech-static kernel: [ 0.132636] futex hash table entries: 4096 (order: 6, 262144 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.132753] pinctrl core: initialized pinctrl subsystem Nov 8 05:54:27 wikitech-static kernel: [ 0.133038] NET: Registered protocol family 16 Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] cpuidle: using governor ladder Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] cpuidle: using governor menu Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] ACPI: bus type PCI registered Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] PCI: Using configuration type 1 for base access Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] PCI: Using configuration type 1 for extended access Nov 8 05:54:27 wikitech-static kernel: [ 0.133800] HugeTLB registered 2 MB page size, pre-allocated 0 pages Nov 8 05:54:27 wikitech-static kernel: [ 0.134099] ACPI: Added _OSI(Module Device) Nov 8 05:54:27 wikitech-static kernel: [ 0.134100] ACPI: Added _OSI(Processor Device) Nov 8 05:54:27 wikitech-static kernel: [ 0.134101] ACPI: Added _OSI(3.0 _SCP Extensions) Nov 8 05:54:27 wikitech-static kernel: [ 0.134102] ACPI: Added _OSI(Processor Aggregator Device) Nov 8 05:54:27 wikitech-static kernel: [ 0.134522] xen: --> pirq=16 -> irq=9 (gsi=9) Nov 8 05:54:27 wikitech-static kernel: [ 0.140347] ACPI: Interpreter enabled Nov 8 05:54:27 wikitech-static kernel: [ 0.140358] ACPI: (supports S0 S5) Nov 8 05:54:27 wikitech-static kernel: [ 0.140360] ACPI: Using IOAPIC for interrupt routing Nov 8 05:54:27 wikitech-static kernel: [ 0.140390] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Nov 8 05:54:27 wikitech-static kernel: [ 0.219834] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Nov 8 05:54:27 wikitech-static kernel: [ 0.219843] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Nov 8 05:54:27 wikitech-static kernel: [ 0.219850] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM Nov 8 05:54:27 wikitech-static kernel: [ 0.222872] acpiphp: Slot [0] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.223977] acpiphp: Slot [3] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224085] acpiphp: Slot [4] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224209] acpiphp: Slot [5] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224288] acpiphp: Slot [6] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224339] acpiphp: Slot [7] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224390] acpiphp: Slot [8] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224441] acpiphp: Slot [9] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224496] acpiphp: Slot [10] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224549] acpiphp: Slot [11] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224599] acpiphp: Slot [12] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224651] acpiphp: Slot [13] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224706] acpiphp: Slot [14] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224764] acpiphp: Slot [15] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224814] acpiphp: Slot [16] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224864] acpiphp: Slot [17] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224916] acpiphp: Slot [18] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.224968] acpiphp: Slot [19] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225019] acpiphp: Slot [20] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225069] acpiphp: Slot [21] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225121] acpiphp: Slot [22] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225172] acpiphp: Slot [23] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225222] acpiphp: Slot [24] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225274] acpiphp: Slot [25] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225324] acpiphp: Slot [26] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225375] acpiphp: Slot [27] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225425] acpiphp: Slot [28] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225499] acpiphp: Slot [29] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225585] acpiphp: Slot [30] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225672] acpiphp: Slot [31] registered Nov 8 05:54:27 wikitech-static kernel: [ 0.225741] PCI host bridge to bus 0000:00 Nov 8 05:54:27 wikitech-static kernel: [ 0.225746] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Nov 8 05:54:27 wikitech-static kernel: [ 0.225749] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Nov 8 05:54:27 wikitech-static kernel: [ 0.225751] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Nov 8 05:54:27 wikitech-static kernel: [ 0.225754] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff window] Nov 8 05:54:27 wikitech-static kernel: [ 0.225757] pci_bus 0000:00: root bus resource [bus 00-ff] Nov 8 05:54:27 wikitech-static kernel: [ 0.227382] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Nov 8 05:54:27 wikitech-static kernel: [ 0.230259] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Nov 8 05:54:27 wikitech-static kernel: [ 0.232860] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Nov 8 05:54:27 wikitech-static kernel: [ 0.233960] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] Nov 8 05:54:27 wikitech-static kernel: [ 0.234402] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Nov 8 05:54:27 wikitech-static kernel: [ 0.234403] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Nov 8 05:54:27 wikitech-static kernel: [ 0.234405] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Nov 8 05:54:27 wikitech-static kernel: [ 0.234407] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Nov 8 05:54:27 wikitech-static kernel: [ 0.235054] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 Nov 8 05:54:27 wikitech-static kernel: [ 0.236007] pci 0000:00:01.2: reg 0x20: [io 0xc300-0xc31f] Nov 8 05:54:27 wikitech-static kernel: [ 0.237088] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Nov 8 05:54:27 wikitech-static kernel: [ 0.237116] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug, Nov 8 05:54:27 wikitech-static kernel: [ 0.237116] * this clock source is slow. Consider trying other clock sources Nov 8 05:54:27 wikitech-static kernel: [ 0.238145] pci 0000:00:01.3: quirk: [io 0x1f40-0x1f7f] claimed by PIIX4 ACPI Nov 8 05:54:27 wikitech-static kernel: [ 0.239809] pci 0000:00:02.0: [1013:00b8] type 00 class 0x030000 Nov 8 05:54:27 wikitech-static kernel: [ 0.240943] pci 0000:00:02.0: reg 0x10: [mem 0xf0000000-0xf1ffffff pref] Nov 8 05:54:27 wikitech-static kernel: [ 0.241987] pci 0000:00:02.0: reg 0x14: [mem 0xf3000000-0xf3000fff] Nov 8 05:54:27 wikitech-static kernel: [ 0.244894] pci 0000:00:03.0: [5853:0001] type 00 class 0x010000 Nov 8 05:54:27 wikitech-static kernel: [ 0.245424] pci 0000:00:03.0: reg 0x10: [io 0xc000-0xc0ff] Nov 8 05:54:27 wikitech-static kernel: [ 0.245776] pci 0000:00:03.0: reg 0x14: [mem 0xf2000000-0xf2ffffff pref] Nov 8 05:54:27 wikitech-static kernel: [ 0.248427] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11) Nov 8 05:54:27 wikitech-static kernel: [ 0.248651] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) Nov 8 05:54:27 wikitech-static kernel: [ 0.248852] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) Nov 8 05:54:27 wikitech-static kernel: [ 0.249116] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11) Nov 8 05:54:27 wikitech-static kernel: [ 0.274336] ACPI: Enabled 2 GPEs in block 00 to 1F Nov 8 05:54:27 wikitech-static kernel: [ 0.274449] xen:balloon: Initialising balloon driver Nov 8 05:54:27 wikitech-static kernel: [ 0.276047] xen_balloon: Initialising balloon driver Nov 8 05:54:27 wikitech-static kernel: [ 0.277652] vgaarb: setting as boot device: PCI:0000:00:02.0 Nov 8 05:54:27 wikitech-static kernel: [ 0.277655] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none Nov 8 05:54:27 wikitech-static kernel: [ 0.277656] vgaarb: loaded Nov 8 05:54:27 wikitech-static kernel: [ 0.277657] vgaarb: bridge control possible 0000:00:02.0 Nov 8 05:54:27 wikitech-static kernel: [ 0.277791] PCI: Using ACPI for IRQ routing Nov 8 05:54:27 wikitech-static kernel: [ 0.277794] PCI: pci_cache_line_size set to 64 bytes Nov 8 05:54:27 wikitech-static kernel: [ 0.278149] e820: reserve RAM buffer [mem 0x0009e000-0x0009ffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.278151] e820: reserve RAM buffer [mem 0x3fc00000-0x3fffffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.278399] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 Nov 8 05:54:27 wikitech-static kernel: [ 0.278404] hpet0: 3 comparators, 64-bit 62.500000 MHz counter Nov 8 05:54:27 wikitech-static kernel: [ 0.282079] clocksource: Switched to clocksource xen Nov 8 05:54:27 wikitech-static kernel: [ 0.292321] VFS: Disk quotas dquot_6.6.0 Nov 8 05:54:27 wikitech-static kernel: [ 0.292358] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.292556] pnp: PnP ACPI init Nov 8 05:54:27 wikitech-static kernel: [ 0.292648] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.292652] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.292714] system 00:01: [io 0x10c0-0x1141] has been reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.292716] system 00:01: [io 0xb044-0xb047] has been reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.292719] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.292812] system 00:02: [io 0x08a0-0x08a3] has been reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.292814] system 00:02: [io 0x0cc0-0x0ccf] has been reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.292816] system 00:02: [io 0x04d0-0x04d1] has been reserved Nov 8 05:54:27 wikitech-static kernel: [ 0.292819] system 00:02: Plug and Play ACPI device, IDs PNP0c02 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.292846] xen: --> pirq=17 -> irq=8 (gsi=8) Nov 8 05:54:27 wikitech-static kernel: [ 0.292873] pnp 00:03: Plug and Play ACPI device, IDs PNP0b00 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.292895] xen: --> pirq=18 -> irq=12 (gsi=12) Nov 8 05:54:27 wikitech-static kernel: [ 0.292917] pnp 00:04: Plug and Play ACPI device, IDs PNP0f13 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.292937] xen: --> pirq=19 -> irq=1 (gsi=1) Nov 8 05:54:27 wikitech-static kernel: [ 0.292958] pnp 00:05: Plug and Play ACPI device, IDs PNP0303 PNP030b (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.292984] xen: --> pirq=20 -> irq=6 (gsi=6) Nov 8 05:54:27 wikitech-static kernel: [ 0.292988] pnp 00:06: [dma 2] Nov 8 05:54:27 wikitech-static kernel: [ 0.293026] pnp 00:06: Plug and Play ACPI device, IDs PNP0700 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.293062] xen: --> pirq=21 -> irq=4 (gsi=4) Nov 8 05:54:27 wikitech-static kernel: [ 0.293093] pnp 00:07: Plug and Play ACPI device, IDs PNP0501 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.293132] xen: --> pirq=22 -> irq=7 (gsi=7) Nov 8 05:54:27 wikitech-static kernel: [ 0.293152] pnp 00:08: Plug and Play ACPI device, IDs PNP0400 (active) Nov 8 05:54:27 wikitech-static kernel: [ 0.319195] pnp: PnP ACPI: found 9 devices Nov 8 05:54:27 wikitech-static kernel: [ 0.325635] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Nov 8 05:54:27 wikitech-static kernel: [ 0.325651] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Nov 8 05:54:27 wikitech-static kernel: [ 0.325654] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Nov 8 05:54:27 wikitech-static kernel: [ 0.325656] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Nov 8 05:54:27 wikitech-static kernel: [ 0.325658] pci_bus 0000:00: resource 7 [mem 0xf0000000-0xfbffffff window] Nov 8 05:54:27 wikitech-static kernel: [ 0.325931] NET: Registered protocol family 2 Nov 8 05:54:27 wikitech-static kernel: [ 0.326187] TCP established hash table entries: 8192 (order: 4, 65536 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.326219] TCP bind hash table entries: 8192 (order: 5, 131072 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.326256] TCP: Hash tables configured (established 8192 bind 8192) Nov 8 05:54:27 wikitech-static kernel: [ 0.326298] UDP hash table entries: 512 (order: 2, 16384 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.326307] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes) Nov 8 05:54:27 wikitech-static kernel: [ 0.326387] NET: Registered protocol family 1 Nov 8 05:54:27 wikitech-static kernel: [ 0.326399] pci 0000:00:00.0: Limiting direct PCI/PCI transfers Nov 8 05:54:27 wikitech-static kernel: [ 0.326466] pci 0000:00:01.0: PIIX3: Enabling Passive Release Nov 8 05:54:27 wikitech-static kernel: [ 0.326526] pci 0000:00:01.0: Activating ISA DMA hang workarounds Nov 8 05:54:27 wikitech-static kernel: [ 0.327062] xen: --> pirq=23 -> irq=23 (gsi=23) Nov 8 05:54:27 wikitech-static kernel: [ 0.328142] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Nov 8 05:54:27 wikitech-static kernel: [ 0.328199] PCI: CLS 0 bytes, default 64 Nov 8 05:54:27 wikitech-static kernel: [ 0.328279] Unpacking initramfs... Nov 8 05:54:27 wikitech-static kernel: [ 0.636062] random: fast init done Nov 8 05:54:27 wikitech-static kernel: [ 0.698973] Freeing initrd memory: 19100K Nov 8 05:54:27 wikitech-static kernel: [ 0.699233] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2b3e9497a9e, max_idle_ns: 440795264360 ns Nov 8 05:54:27 wikitech-static kernel: [ 0.699606] audit: initializing netlink subsys (disabled) Nov 8 05:54:27 wikitech-static kernel: [ 0.699629] audit: type=2000 audit(1636350847.445:1): initialized Nov 8 05:54:27 wikitech-static kernel: [ 0.700026] workingset: timestamp_bits=40 max_order=18 bucket_order=0 Nov 8 05:54:27 wikitech-static kernel: [ 0.700042] zbud: loaded Nov 8 05:54:27 wikitech-static kernel: [ 0.700873] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) Nov 8 05:54:27 wikitech-static kernel: [ 0.700903] io scheduler noop registered Nov 8 05:54:27 wikitech-static kernel: [ 0.700904] io scheduler deadline registered Nov 8 05:54:27 wikitech-static kernel: [ 0.700916] io scheduler cfq registered (default) Nov 8 05:54:27 wikitech-static kernel: [ 0.700973] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Nov 8 05:54:27 wikitech-static kernel: [ 0.700980] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 Nov 8 05:54:27 wikitech-static kernel: [ 0.701119] GHES: HEST is not enabled! Nov 8 05:54:27 wikitech-static kernel: [ 0.701615] xen: --> pirq=24 -> irq=30 (gsi=30) Nov 8 05:54:27 wikitech-static kernel: [ 0.701698] xen:grant_table: Grant tables using version 1 layout Nov 8 05:54:27 wikitech-static kernel: [ 0.701715] Grant table initialized Nov 8 05:54:27 wikitech-static kernel: [ 0.701761] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22! Nov 8 05:54:27 wikitech-static kernel: [ 0.702488] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Nov 8 05:54:27 wikitech-static kernel: [ 0.734672] 00:07: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Nov 8 05:54:27 wikitech-static kernel: [ 0.735208] Linux agpgart interface v0.103 Nov 8 05:54:27 wikitech-static kernel: [ 0.735360] AMD IOMMUv2 driver by Joerg Roedel Nov 8 05:54:27 wikitech-static kernel: [ 0.735361] AMD IOMMUv2 functionality not available on this system Nov 8 05:54:27 wikitech-static kernel: [ 0.735499] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12 Nov 8 05:54:27 wikitech-static kernel: [ 0.738057] serio: i8042 KBD port at 0x60,0x64 irq 1 Nov 8 05:54:27 wikitech-static kernel: [ 0.738072] serio: i8042 AUX port at 0x60,0x64 irq 12 Nov 8 05:54:27 wikitech-static kernel: [ 0.738294] mousedev: PS/2 mouse device common for all mice Nov 8 05:54:27 wikitech-static kernel: [ 0.739281] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 Nov 8 05:54:27 wikitech-static kernel: [ 0.739905] rtc_cmos 00:03: RTC can wake from S4 Nov 8 05:54:27 wikitech-static kernel: [ 0.740024] rtc_cmos 00:03: rtc core: registered rtc_cmos as rtc0 Nov 8 05:54:27 wikitech-static kernel: [ 0.740142] rtc_cmos 00:03: alarms up to one day, 114 bytes nvram, hpet irqs Nov 8 05:54:27 wikitech-static kernel: [ 0.740169] ledtrig-cpu: registered to indicate activity on CPUs Nov 8 05:54:27 wikitech-static kernel: [ 0.740427] NET: Registered protocol family 10 Nov 8 05:54:27 wikitech-static kernel: [ 0.740677] mip6: Mobile IPv6 Nov 8 05:54:27 wikitech-static kernel: [ 0.740679] NET: Registered protocol family 17 Nov 8 05:54:27 wikitech-static kernel: [ 0.740682] mpls_gso: MPLS GSO support Nov 8 05:54:27 wikitech-static kernel: [ 0.740919] registered taskstats version 1 Nov 8 05:54:27 wikitech-static kernel: [ 0.740933] zswap: loaded using pool lzo/zbud Nov 8 05:54:27 wikitech-static kernel: [ 0.741012] ima: No TPM chip found, activating TPM-bypass! Nov 8 05:54:27 wikitech-static kernel: [ 0.741015] ima: Allocated hash algorithm: sha256 Nov 8 05:54:27 wikitech-static kernel: [ 0.741328] xenbus_probe_frontend: Device with no driver: device/vbd/768 Nov 8 05:54:27 wikitech-static kernel: [ 0.741329] xenbus_probe_frontend: Device with no driver: device/vbd/5632 Nov 8 05:54:27 wikitech-static kernel: [ 0.741330] xenbus_probe_frontend: Device with no driver: device/vif/0 Nov 8 05:54:27 wikitech-static kernel: [ 0.741331] xenbus_probe_frontend: Device with no driver: device/vif/1 Nov 8 05:54:27 wikitech-static kernel: [ 0.741364] rtc_cmos 00:03: setting system clock to 2021-11-08 05:54:07 UTC (1636350847) Nov 8 05:54:27 wikitech-static kernel: [ 0.741389] PM: Hibernation image not present or could not be loaded. Nov 8 05:54:27 wikitech-static kernel: [ 0.742787] Freeing unused kernel memory: 1424K Nov 8 05:54:27 wikitech-static kernel: [ 0.742789] Write protecting the kernel read-only data: 12288k Nov 8 05:54:27 wikitech-static kernel: [ 0.743631] Freeing unused kernel memory: 1888K Nov 8 05:54:27 wikitech-static kernel: [ 0.746747] Freeing unused kernel memory: 1216K Nov 8 05:54:27 wikitech-static kernel: [ 0.753348] x86/mm: Checked W+X mappings: passed, no W+X pages found. Nov 8 05:54:27 wikitech-static kernel: [ 0.766308] random: systemd-udevd: uninitialized urandom read (16 bytes read) Nov 8 05:54:27 wikitech-static kernel: [ 0.766389] random: systemd-udevd: uninitialized urandom read (16 bytes read) Nov 8 05:54:27 wikitech-static kernel: [ 0.766396] random: systemd-udevd: uninitialized urandom read (16 bytes read) Nov 8 05:54:27 wikitech-static kernel: [ 0.884457] SCSI subsystem initialized Nov 8 05:54:27 wikitech-static kernel: [ 0.888628] ACPI: bus type USB registered Nov 8 05:54:27 wikitech-static kernel: [ 0.888653] usbcore: registered new interface driver usbfs Nov 8 05:54:27 wikitech-static kernel: [ 0.888665] usbcore: registered new interface driver hub Nov 8 05:54:27 wikitech-static kernel: [ 0.888689] usbcore: registered new device driver usb Nov 8 05:54:27 wikitech-static kernel: [ 0.889276] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Nov 8 05:54:27 wikitech-static kernel: [ 0.889617] uhci_hcd: USB Universal Host Controller Interface driver Nov 8 05:54:27 wikitech-static kernel: [ 0.890240] uhci_hcd 0000:00:01.2: UHCI Host Controller Nov 8 05:54:27 wikitech-static kernel: [ 0.890246] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 Nov 8 05:54:27 wikitech-static kernel: [ 0.890324] uhci_hcd 0000:00:01.2: detected 2 ports Nov 8 05:54:27 wikitech-static kernel: [ 0.890527] uhci_hcd 0000:00:01.2: irq 23, io base 0x0000c300 Nov 8 05:54:27 wikitech-static kernel: [ 0.903130] FDC 0 is a S82078B Nov 8 05:54:27 wikitech-static kernel: [ 0.905277] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001 Nov 8 05:54:27 wikitech-static kernel: [ 0.905281] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Nov 8 05:54:27 wikitech-static kernel: [ 0.905283] usb usb1: Product: UHCI Host Controller Nov 8 05:54:27 wikitech-static kernel: [ 0.905285] usb usb1: Manufacturer: Linux 4.9.0-11-amd64 uhci_hcd Nov 8 05:54:27 wikitech-static kernel: [ 0.905287] usb usb1: SerialNumber: 0000:00:01.2 Nov 8 05:54:27 wikitech-static kernel: [ 0.905687] hub 1-0:1.0: USB hub found Nov 8 05:54:27 wikitech-static kernel: [ 0.905849] hub 1-0:1.0: 2 ports detected Nov 8 05:54:27 wikitech-static kernel: [ 0.906298] piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr Nov 8 05:54:27 wikitech-static kernel: [ 0.910051] libata version 3.00 loaded. Nov 8 05:54:27 wikitech-static kernel: [ 0.910445] ata_piix 0000:00:01.1: version 2.13 Nov 8 05:54:27 wikitech-static kernel: [ 0.915373] Invalid max_queues (4), will use default max: 1. Nov 8 05:54:27 wikitech-static kernel: [ 0.917221] xen_netfront: Initialising Xen virtual ethernet driver Nov 8 05:54:27 wikitech-static kernel: [ 0.920395] scsi host0: ata_piix Nov 8 05:54:27 wikitech-static kernel: [ 0.921047] SSE version of gcm_enc/dec engaged. Nov 8 05:54:27 wikitech-static kernel: [ 0.928281] scsi host1: ata_piix Nov 8 05:54:27 wikitech-static kernel: [ 0.928359] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 Nov 8 05:54:27 wikitech-static kernel: [ 0.928360] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 Nov 8 05:54:27 wikitech-static kernel: [ 0.958029] blkfront: xvda: barrier: enabled; persistent grants: disabled; indirect descriptors: disabled; Nov 8 05:54:27 wikitech-static kernel: [ 0.962200] xvda: xvda1 Nov 8 05:54:27 wikitech-static kernel: [ 0.965528] blkfront: xvdc: barrier: enabled; persistent grants: disabled; indirect descriptors: disabled; Nov 8 05:54:27 wikitech-static kernel: [ 0.975803] xvdc: xvdc1 Nov 8 05:54:27 wikitech-static kernel: [ 1.232088] usb 1-2: new full-speed USB device number 2 using uhci_hcd Nov 8 05:54:27 wikitech-static kernel: [ 1.784231] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 Nov 8 05:54:27 wikitech-static kernel: [ 1.827364] usb 1-2: New USB device found, idVendor=0627, idProduct=0001 Nov 8 05:54:27 wikitech-static kernel: [ 1.827367] usb 1-2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Nov 8 05:54:27 wikitech-static kernel: [ 1.827369] usb 1-2: Product: QEMU USB Tablet Nov 8 05:54:27 wikitech-static kernel: [ 1.827370] usb 1-2: Manufacturer: QEMU 0.10.2 Nov 8 05:54:27 wikitech-static kernel: [ 1.827372] usb 1-2: SerialNumber: 1 Nov 8 05:54:27 wikitech-static kernel: [ 2.029324] hidraw: raw HID events driver (C) Jiri Kosina Nov 8 05:54:27 wikitech-static kernel: [ 2.224574] usbcore: registered new interface driver usbhid Nov 8 05:54:27 wikitech-static kernel: [ 2.224576] usbhid: USB HID core driver Nov 8 05:54:27 wikitech-static kernel: [ 2.225450] input: QEMU 0.10.2 QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-2/1-2:1.0/0003:0627:0001.0001/input/input3 Nov 8 05:54:27 wikitech-static kernel: [ 2.225638] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Pointer [QEMU 0.10.2 QEMU USB Tablet] on usb-0000:00:01.2-2/input0 Nov 8 05:54:27 wikitech-static kernel: [ 4.103630] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null) Nov 8 05:54:27 wikitech-static kernel: [ 6.069087] ip_tables: (C) 2000-2006 Netfilter Core Team Nov 8 05:54:27 wikitech-static kernel: [ 7.523995] EXT4-fs (xvda1): re-mounted. Opts: errors=remount-ro,barrier=0 Nov 8 05:54:27 wikitech-static kernel: [ 7.784495] Adding 1048572k swap on /swapfile. Priority:-1 extents:46 across:8470524k SSFS Nov 8 05:54:27 wikitech-static kernel: [ 8.481975] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 Nov 8 05:54:27 wikitech-static kernel: [ 8.481981] ACPI: Power Button [PWRF] Nov 8 05:54:27 wikitech-static kernel: [ 8.482036] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input5 Nov 8 05:54:27 wikitech-static kernel: [ 8.482038] ACPI: Sleep Button [SLPF] Nov 8 05:54:27 wikitech-static kernel: [ 8.642490] [drm] Initialized Nov 8 05:54:27 wikitech-static kernel: [ 8.706776] parport_pc 00:08: reported by Plug and Play ACPI Nov 8 05:54:27 wikitech-static kernel: [ 8.707493] parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE] Nov 8 05:54:27 wikitech-static kernel: [ 8.721839] xen: --> pirq=25 -> irq=24 (gsi=24) Nov 8 05:54:27 wikitech-static kernel: [ 8.731060] [TTM] Zone kernel: Available graphics memory: 507170 kiB Nov 8 05:54:27 wikitech-static kernel: [ 8.731062] [TTM] Initializing pool allocator Nov 8 05:54:27 wikitech-static kernel: [ 8.731067] [TTM] Initializing DMA pool allocator Nov 8 05:54:27 wikitech-static kernel: [ 8.731643] [drm] fb mappable at 0xF0000000 Nov 8 05:54:27 wikitech-static kernel: [ 8.731644] [drm] vram aper at 0xF0000000 Nov 8 05:54:27 wikitech-static kernel: [ 8.731644] [drm] size 33554432 Nov 8 05:54:27 wikitech-static kernel: [ 8.731645] [drm] fb depth is 24 Nov 8 05:54:27 wikitech-static kernel: [ 8.731646] [drm] pitch is 3072 Nov 8 05:54:27 wikitech-static kernel: [ 8.731701] fbcon: cirrusdrmfb (fb0) is primary device Nov 8 05:54:27 wikitech-static kernel: [ 8.806233] input: PC Speaker as /devices/platform/pcspkr/input/input6 Nov 8 05:54:27 wikitech-static kernel: [ 8.981652] ppdev: user-space parallel port driver Nov 8 05:54:27 wikitech-static kernel: [ 8.984939] Console: switching to colour frame buffer device 128x48 Nov 8 05:54:27 wikitech-static kernel: [ 9.059343] cirrus 0000:00:02.0: fb0: cirrusdrmfb frame buffer device Nov 8 05:54:27 wikitech-static kernel: [ 9.187627] EDAC MC: Ver: 3.0.0 Nov 8 05:54:27 wikitech-static kernel: [ 9.189004] [drm] Initialized cirrus 1.0.0 20110418 for 0000:00:02.0 on minor 0 Nov 8 05:54:27 wikitech-static kernel: [ 9.190037] MCE: In-kernel MCE decoding enabled. Nov 8 05:54:27 wikitech-static systemd[1]: Starting Flush Journal to Persistent Storage... Nov 8 05:54:27 wikitech-static systemd[1]: Started Load/Save Random Seed. Nov 8 05:54:27 wikitech-static systemd[1]: Activated swap /swapfile. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Swap. Nov 8 05:54:27 wikitech-static systemd[1]: Started Flush Journal to Persistent Storage. Nov 8 05:54:27 wikitech-static systemd[1]: Started udev Coldplug all Devices. Nov 8 05:54:27 wikitech-static systemd[1]: Started Create Static Device Nodes in /dev. Nov 8 05:54:27 wikitech-static systemd[1]: Starting udev Kernel Device Manager... Nov 8 05:54:27 wikitech-static systemd[1]: Started Set the console keyboard layout. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Local File Systems (Pre). Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Local File Systems. Nov 8 05:54:27 wikitech-static systemd[1]: Starting Set console font and keymap... Nov 8 05:54:27 wikitech-static systemd[1]: Starting Create Volatile Files and Directories... Nov 8 05:54:27 wikitech-static systemd[1]: Started Set console font and keymap. Nov 8 05:54:27 wikitech-static systemd[1]: Started udev Kernel Device Manager. Nov 8 05:54:27 wikitech-static systemd[1]: Started Create Volatile Files and Directories. Nov 8 05:54:27 wikitech-static systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 8 05:54:27 wikitech-static systemd[1]: Starting Network Time Synchronization... Nov 8 05:54:27 wikitech-static systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 8 05:54:27 wikitech-static systemd[1]: Started Network Time Synchronization. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target System Time Synchronized. Nov 8 05:54:27 wikitech-static cloud-init[226]: Cloud-init v. 0.7.9 running 'init-local' at Mon, 08 Nov 2021 05:54:21 +0000. Up 15.20 seconds. Nov 8 05:54:27 wikitech-static systemd[1]: Started Initial cloud-init job (pre-networking). Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Network (Pre). Nov 8 05:54:27 wikitech-static systemd[1]: Starting Raise network interfaces... Nov 8 05:54:27 wikitech-static ifup[377]: Waiting for DAD... Done Nov 8 05:54:27 wikitech-static systemd[1]: Started Raise network interfaces. Nov 8 05:54:27 wikitech-static systemd[1]: Starting Initial cloud-init job (metadata service crawler)... Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Network. Nov 8 05:54:27 wikitech-static cloud-init[615]: Cloud-init v. 0.7.9 running 'init' at Mon, 08 Nov 2021 05:54:25 +0000. Up 18.88 seconds. Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: ++++++++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++++++ Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +--------+------+-----------------+---------------+-------+-------------------+ Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | Device | Up | Address | Mask | Scope | Hw-Address | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +--------+------+-----------------+---------------+-------+-------------------+ Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth0: | True | 192.237.162.200 | 255.255.255.0 | . | bc:76:4e:10:2e:d5 | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth0: | True | . | . | d | bc:76:4e:10:2e:d5 | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | lo: | True | 127.0.0.1 | 255.0.0.0 | . | . | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | lo: | True | . | . | d | . | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth1: | True | 10.208.138.205 | 255.255.128.0 | . | bc:76:4e:10:3e:64 | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth1: | True | . | . | d | bc:76:4e:10:3e:64 | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +--------+------+-----------------+---------------+-------+-------------------+ Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +++++++++++++++++++++++++++++++Route IPv4 info+++++++++++++++++++++++++++++++ Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +-------+---------------+---------------+---------------+-----------+-------+ Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +-------+---------------+---------------+---------------+-----------+-------+ Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 0 | 0.0.0.0 | 192.237.162.1 | 0.0.0.0 | eth0 | UG | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 1 | 10.176.0.0 | 10.208.128.1 | 255.240.0.0 | eth1 | UG | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 2 | 10.208.0.0 | 10.208.128.1 | 255.240.0.0 | eth1 | UG | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 3 | 10.208.128.0 | 0.0.0.0 | 255.255.128.0 | eth1 | U | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 4 | 192.237.162.0 | 0.0.0.0 | 255.255.255.0 | eth0 | U | Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +-------+---------------+---------------+---------------+-----------+-------+ Nov 8 05:54:27 wikitech-static systemd[1]: Started Initial cloud-init job (metadata service crawler). Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Network is Online. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target System Initialization. Nov 8 05:54:27 wikitech-static systemd[1]: certbot.timer: Adding 3h 55min 15.302870s random time. Nov 8 05:54:27 wikitech-static systemd[1]: Started Run certbot twice daily. Nov 8 05:54:27 wikitech-static systemd[1]: apt-daily.timer: Adding 6h 28min 36.762679s random time. Nov 8 05:54:27 wikitech-static systemd[1]: Started Daily apt download activities. Nov 8 05:54:27 wikitech-static systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 8 05:54:27 wikitech-static systemd[1]: Started Clean PHP session files every 30 mins. Nov 8 05:54:27 wikitech-static systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 8 05:54:27 wikitech-static systemd[1]: apt-daily-upgrade.timer: Adding 24min 24.407279s random time. Nov 8 05:54:27 wikitech-static systemd[1]: Started Daily apt upgrade and clean activities. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Timers. Nov 8 05:54:27 wikitech-static systemd[1]: Listening on ACPID Listen Socket. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Sockets. Nov 8 05:54:27 wikitech-static systemd[1]: Started ACPI Events Check. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Paths. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Basic System. Nov 8 05:54:27 wikitech-static systemd[1]: Starting LSB: XenServer Virtual Machine daemon providing host integration services... Nov 8 05:54:27 wikitech-static systemd[1]: Starting The Apache HTTP Server... Nov 8 05:54:27 wikitech-static systemd[1]: Starting MariaDB 10.1.48 database server... Nov 8 05:54:27 wikitech-static systemd[1]: Starting /etc/rc.local Compatibility... Nov 8 05:54:27 wikitech-static systemd[1]: Started D-Bus System Message Bus. Nov 8 05:54:27 wikitech-static xe-linux-distribution[656]: Mounting xenfs on /proc/xen: OK Nov 8 05:54:27 wikitech-static systemd[1]: Starting System Logging Service... Nov 8 05:54:27 wikitech-static systemd[1]: Started irqbalance daemon. Nov 8 05:54:27 wikitech-static systemd[1]: Started Regular background program processing daemon. Nov 8 05:54:27 wikitech-static systemd[1]: Starting SSHGuard... Nov 8 05:54:27 wikitech-static systemd[1]: Started memcached daemon. Nov 8 05:54:27 wikitech-static systemd[1]: Started ACPI event daemon. Nov 8 05:54:27 wikitech-static cron[688]: (CRON) INFO (pidfile fd = 3) Nov 8 05:54:27 wikitech-static systemd[1]: Starting Login Service... Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Cloud-config availability. Nov 8 05:54:27 wikitech-static systemd[1]: Starting Apply the settings specified in cloud-config... Nov 8 05:54:27 wikitech-static systemd[1]: Starting Permit User Sessions... Nov 8 05:54:27 wikitech-static systemd[1]: Started /etc/rc.local Compatibility. Nov 8 05:54:27 wikitech-static systemd[1]: Started Login Service. Nov 8 05:54:27 wikitech-static systemd[1]: Started Permit User Sessions. Nov 8 05:54:27 wikitech-static systemd[1]: Started Getty on tty1. Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Login Prompts. Nov 8 05:54:27 wikitech-static /usr/sbin/irqbalance: Balancing is ineffective on systems with a single cpu. Shutting down Nov 8 05:54:27 wikitech-static xe-linux-distribution[656]: Detecting Linux distribution version: OK Nov 8 05:54:27 wikitech-static cron[688]: (CRON) INFO (Running @reboot jobs) Nov 8 05:54:27 wikitech-static liblogging-stdlog: [origin software="rsyslogd" swVersion="8.24.0" x-pid="686" x-info="http://www.rsyslog.com"] start Nov 8 05:54:27 wikitech-static systemd[1]: Started System Logging Service. Nov 8 05:54:27 wikitech-static xe-linux-distribution[656]: Starting xe daemon: OK Nov 8 05:54:27 wikitech-static systemd[1]: Started LSB: XenServer Virtual Machine daemon providing host integration services. Nov 8 05:54:27 wikitech-static systemd[1]: Starting nova-agent... Nov 8 05:54:27 wikitech-static kernel: [ 20.674120] ip6_tables: (C) 2000-2006 Netfilter Core Team Nov 8 05:54:27 wikitech-static acpid: starting up with netlink and the input layer Nov 8 05:54:27 wikitech-static systemd[1]: Started SSHGuard. Nov 8 05:54:27 wikitech-static acpid: 1 rule loaded Nov 8 05:54:27 wikitech-static acpid: waiting for events: event logging is off Nov 8 05:54:27 wikitech-static systemd[1]: Starting OpenBSD Secure Shell server... Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain INPUT (policy ACCEPT) Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: sshguard all -- 0.0.0.0/0 0.0.0.0/0 Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain FORWARD (policy ACCEPT) Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain OUTPUT (policy ACCEPT) Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain sshguard (1 references) Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination Nov 8 05:54:28 wikitech-static systemd[1]: Started OpenBSD Secure Shell server. Nov 8 05:54:28 wikitech-static cloud-init[694]: Cloud-init v. 0.7.9 running 'modules:config' at Mon, 08 Nov 2021 05:54:28 +0000. Up 21.55 seconds. Nov 8 05:54:28 wikitech-static mysqld[896]: 2021-11-08 5:54:28 140647699062144 [Note] /usr/sbin/mysqld (mysqld 10.1.48-MariaDB-0+deb9u2) starting as process 896 ... Nov 8 05:54:28 wikitech-static systemd[1]: Started Apply the settings specified in cloud-config. Nov 8 05:54:29 wikitech-static systemd[1]: Started The Apache HTTP Server. Nov 8 05:54:29 wikitech-static systemd[1]: Started nova-agent. Nov 8 05:54:31 wikitech-static kernel: [ 25.007477] random: crng init done Nov 8 05:54:31 wikitech-static kernel: [ 25.007480] random: 7 urandom warning(s) missed due to ratelimiting Nov 8 05:54:34 wikitech-static systemd[1]: Started MariaDB 10.1.48 database server. Nov 8 05:54:34 wikitech-static systemd[1]: Reached target Multi-User System. Nov 8 05:54:34 wikitech-static systemd[1]: Starting Execute cloud user/final scripts... Nov 8 05:54:34 wikitech-static systemd[1]: Reached target Graphical Interface. Nov 8 05:54:34 wikitech-static systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 8 05:54:34 wikitech-static systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 8 05:54:35 wikitech-static cloud-init[954]: Cloud-init v. 0.7.9 running 'modules:final' at Mon, 08 Nov 2021 05:54:34 +0000. Up 28.12 seconds. Nov 8 05:54:35 wikitech-static cloud-init[954]: Cloud-init v. 0.7.9 finished at Mon, 08 Nov 2021 05:54:35 +0000. Datasource DataSourceNone. Up 28.43 seconds Nov 8 05:54:35 wikitech-static cloud-init[954]: 2021-11-08 05:54:35,196 - cc_final_message.py[WARNING]: Used fallback datasource Nov 8 05:54:35 wikitech-static systemd[1]: Started Execute cloud user/final scripts. Nov 8 05:54:35 wikitech-static systemd[1]: Reached target Cloud-init target. Nov 8 05:54:35 wikitech-static systemd[1]: Startup finished in 5.560s (kernel) + 22.966s (userspace) = 28.527s. Nov 8 05:54:46 wikitech-static systemd-timesyncd[287]: Synchronized to time server [2001:4998:58:183a::1001]:123 (2.debian.pool.ntp.org). Nov 8 05:56:02 wikitech-static CRON[1040]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:56:02 wikitech-static CRON[1041]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:56:03 wikitech-static check_icinga[1043]: 2021-11-08 05:56:03,677 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:56:03 wikitech-static check_icinga[1042]: 2021-11-08 05:56:03,678 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 05:56:06 wikitech-static check_icinga[1042]: 2021-11-08 05:56:06,769 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 05:56:06 wikitech-static check_icinga[1042]: 2021-11-08 05:56:06,775 [INFO] Emailing jcrespo for alert2001.wikimedia.org Nov 8 05:56:06 wikitech-static check_icinga[1043]: 2021-11-08 05:56:06,776 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 05:56:06 wikitech-static check_icinga[1043]: 2021-11-08 05:56:06,777 [INFO] Emailing andrew-email for alert1001.wikimedia.org Nov 8 05:56:07 wikitech-static check_icinga[1042]: 2021-11-08 05:56:07,174 [INFO] Emailing vgutierrez for alert2001.wikimedia.org Nov 8 05:56:07 wikitech-static check_icinga[1043]: 2021-11-08 05:56:07,244 [INFO] Emailing dcaro-email for alert1001.wikimedia.org Nov 8 05:56:07 wikitech-static check_icinga[1042]: 2021-11-08 05:56:07,485 [INFO] Emailing elukey for alert2001.wikimedia.org Nov 8 05:56:07 wikitech-static check_icinga[1043]: 2021-11-08 05:56:07,864 [INFO] Emailing cdanis for alert1001.wikimedia.org Nov 8 05:56:08 wikitech-static check_icinga[1042]: 2021-11-08 05:56:08,165 [INFO] Emailing cdanis for alert2001.wikimedia.org Nov 8 05:56:08 wikitech-static check_icinga[1043]: 2021-11-08 05:56:08,200 [INFO] Emailing glavagetto for alert1001.wikimedia.org Nov 8 05:56:08 wikitech-static check_icinga[1042]: 2021-11-08 05:56:08,434 [INFO] Emailing lsobanski for alert2001.wikimedia.org Nov 8 05:56:08 wikitech-static check_icinga[1043]: 2021-11-08 05:56:08,727 [INFO] Emailing mmandere for alert1001.wikimedia.org Nov 8 05:56:08 wikitech-static check_icinga[1042]: 2021-11-08 05:56:08,984 [INFO] Emailing cmjohnson for alert2001.wikimedia.org Nov 8 05:56:08 wikitech-static check_icinga[1043]: 2021-11-08 05:56:08,990 [INFO] Emailing wpao for alert1001.wikimedia.org Nov 8 05:56:09 wikitech-static check_icinga[1042]: 2021-11-08 05:56:09,513 [INFO] Emailing marostegui for alert2001.wikimedia.org Nov 8 05:56:09 wikitech-static check_icinga[1043]: 2021-11-08 05:56:09,573 [INFO] Emailing jmm for alert1001.wikimedia.org Nov 8 05:56:09 wikitech-static check_icinga[1042]: 2021-11-08 05:56:09,847 [INFO] Emailing volans for alert2001.wikimedia.org Nov 8 05:56:10 wikitech-static check_icinga[1042]: 2021-11-08 05:56:10,120 [INFO] Emailing bblack for alert2001.wikimedia.org Nov 8 05:56:10 wikitech-static check_icinga[1042]: 2021-11-08 05:56:10,832 [INFO] Emailing ema for alert2001.wikimedia.org Nov 8 05:56:11 wikitech-static check_icinga[1043]: 2021-11-08 05:56:11,182 [INFO] Emailing jijiki for alert1001.wikimedia.org Nov 8 05:56:11 wikitech-static check_icinga[1042]: 2021-11-08 05:56:11,360 [INFO] Emailing mdipietro for alert2001.wikimedia.org Nov 8 05:56:11 wikitech-static check_icinga[1043]: 2021-11-08 05:56:11,701 [INFO] Emailing ariel for alert1001.wikimedia.org Nov 8 05:56:11 wikitech-static check_icinga[1042]: 2021-11-08 05:56:11,907 [INFO] Emailing akosiaris for alert2001.wikimedia.org Nov 8 05:56:12 wikitech-static check_icinga[1043]: 2021-11-08 05:56:12,228 [INFO] Emailing vgutierrez for alert1001.wikimedia.org Nov 8 05:56:12 wikitech-static check_icinga[1043]: 2021-11-08 05:56:12,745 [INFO] Emailing lsobanski for alert1001.wikimedia.org Nov 8 05:56:12 wikitech-static check_icinga[1042]: 2021-11-08 05:56:12,748 [INFO] Emailing rkemper for alert2001.wikimedia.org Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,052 [INFO] Emailing ema for alert1001.wikimedia.org Nov 8 05:56:13 wikitech-static check_icinga[1042]: 2021-11-08 05:56:13,237 [INFO] Emailing herron for alert2001.wikimedia.org Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,328 [INFO] Emailing fgiunchedi for alert1001.wikimedia.org Nov 8 05:56:13 wikitech-static check_icinga[1042]: 2021-11-08 05:56:13,530 [INFO] Emailing wpao for alert2001.wikimedia.org Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,586 [INFO] Emailing herron for alert1001.wikimedia.org Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,852 [INFO] Emailing bblack for alert1001.wikimedia.org Nov 8 05:56:14 wikitech-static check_icinga[1042]: 2021-11-08 05:56:14,013 [INFO] Emailing aborrero-email for alert2001.wikimedia.org Nov 8 05:56:14 wikitech-static check_icinga[1043]: 2021-11-08 05:56:14,391 [INFO] Emailing bstorm-email for alert1001.wikimedia.org Nov 8 05:56:14 wikitech-static check_icinga[1042]: 2021-11-08 05:56:14,526 [INFO] Emailing jmm for alert2001.wikimedia.org Nov 8 05:56:14 wikitech-static check_icinga[1043]: 2021-11-08 05:56:14,669 [INFO] Emailing otto for alert1001.wikimedia.org Nov 8 05:56:14 wikitech-static check_icinga[1043]: 2021-11-08 05:56:14,970 [INFO] Emailing mdipietro for alert1001.wikimedia.org Nov 8 05:56:14 wikitech-static check_icinga[1042]: 2021-11-08 05:56:14,986 [INFO] Emailing jbond for alert2001.wikimedia.org Nov 8 05:56:15 wikitech-static check_icinga[1043]: 2021-11-08 05:56:15,257 [INFO] Emailing mark for alert1001.wikimedia.org Nov 8 05:56:15 wikitech-static check_icinga[1042]: 2021-11-08 05:56:15,508 [INFO] Emailing fgiunchedi for alert2001.wikimedia.org Nov 8 05:56:15 wikitech-static check_icinga[1043]: 2021-11-08 05:56:15,524 [INFO] Emailing jbond for alert1001.wikimedia.org Nov 8 05:56:15 wikitech-static check_icinga[1042]: 2021-11-08 05:56:15,795 [INFO] Emailing dcaro-email for alert2001.wikimedia.org Nov 8 05:56:16 wikitech-static check_icinga[1043]: 2021-11-08 05:56:16,038 [INFO] Emailing robh for alert1001.wikimedia.org Nov 8 05:56:16 wikitech-static check_icinga[1042]: 2021-11-08 05:56:16,269 [INFO] Emailing faidon for alert2001.wikimedia.org Nov 8 05:56:16 wikitech-static check_icinga[1042]: 2021-11-08 05:56:16,556 [INFO] Emailing nskaggs for alert2001.wikimedia.org Nov 8 05:56:16 wikitech-static check_icinga[1043]: 2021-11-08 05:56:16,571 [INFO] Emailing marostegui for alert1001.wikimedia.org Nov 8 05:56:16 wikitech-static check_icinga[1043]: 2021-11-08 05:56:16,859 [INFO] Emailing volans for alert1001.wikimedia.org Nov 8 05:56:17 wikitech-static check_icinga[1042]: 2021-11-08 05:56:17,048 [INFO] Emailing cwhite for alert2001.wikimedia.org Nov 8 05:56:17 wikitech-static check_icinga[1043]: 2021-11-08 05:56:17,126 [INFO] Emailing fsero for alert1001.wikimedia.org Nov 8 05:56:17 wikitech-static check_icinga[1043]: 2021-11-08 05:56:17,398 [INFO] Emailing dzahn for alert1001.wikimedia.org Nov 8 05:56:17 wikitech-static check_icinga[1042]: 2021-11-08 05:56:17,564 [INFO] Emailing robh for alert2001.wikimedia.org Nov 8 05:56:17 wikitech-static check_icinga[1042]: 2021-11-08 05:56:17,830 [INFO] Emailing otto for alert2001.wikimedia.org Nov 8 05:56:17 wikitech-static check_icinga[1043]: 2021-11-08 05:56:17,852 [INFO] Emailing gehel for alert1001.wikimedia.org Nov 8 05:56:18 wikitech-static check_icinga[1043]: 2021-11-08 05:56:18,100 [INFO] Emailing jcrespo for alert1001.wikimedia.org Nov 8 05:56:18 wikitech-static check_icinga[1042]: 2021-11-08 05:56:18,109 [INFO] Emailing dzahn for alert2001.wikimedia.org Nov 8 05:56:18 wikitech-static check_icinga[1042]: 2021-11-08 05:56:18,387 [INFO] Emailing glavagetto for alert2001.wikimedia.org Nov 8 05:56:18 wikitech-static check_icinga[1043]: 2021-11-08 05:56:18,580 [INFO] Emailing akosiaris for alert1001.wikimedia.org Nov 8 05:56:18 wikitech-static check_icinga[1042]: 2021-11-08 05:56:18,928 [INFO] Emailing mark for alert2001.wikimedia.org Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,098 [INFO] Emailing rlazarus for alert1001.wikimedia.org Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,319 [INFO] Emailing nskaggs for alert1001.wikimedia.org Nov 8 05:56:19 wikitech-static check_icinga[1042]: 2021-11-08 05:56:19,413 [INFO] Emailing jijiki for alert2001.wikimedia.org Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,592 [INFO] Emailing tstarling for alert1001.wikimedia.org Nov 8 05:56:19 wikitech-static check_icinga[1042]: 2021-11-08 05:56:19,704 [INFO] Emailing rlazarus for alert2001.wikimedia.org Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,882 [INFO] Emailing elukey for alert1001.wikimedia.org Nov 8 05:56:20 wikitech-static check_icinga[1042]: 2021-11-08 05:56:20,187 [INFO] Emailing andrew-email for alert2001.wikimedia.org Nov 8 05:56:20 wikitech-static check_icinga[1043]: 2021-11-08 05:56:20,401 [INFO] Emailing aborrero-email for alert1001.wikimedia.org Nov 8 05:56:20 wikitech-static check_icinga[1042]: 2021-11-08 05:56:20,467 [INFO] Emailing gehel for alert2001.wikimedia.org Nov 8 05:56:20 wikitech-static check_icinga[1043]: 2021-11-08 05:56:20,671 [INFO] Emailing cmjohnson for alert1001.wikimedia.org Nov 8 05:56:20 wikitech-static check_icinga[1042]: 2021-11-08 05:56:20,725 [INFO] Emailing mmandere for alert2001.wikimedia.org Nov 8 05:56:21 wikitech-static check_icinga[1042]: 2021-11-08 05:56:21,000 [INFO] Emailing tstarling for alert2001.wikimedia.org Nov 8 05:56:21 wikitech-static check_icinga[1043]: 2021-11-08 05:56:21,156 [INFO] Emailing rkemper for alert1001.wikimedia.org Nov 8 05:56:21 wikitech-static check_icinga[1042]: 2021-11-08 05:56:21,251 [INFO] Emailing ariel for alert2001.wikimedia.org Nov 8 05:56:21 wikitech-static check_icinga[1043]: 2021-11-08 05:56:21,429 [INFO] Emailing cwhite for alert1001.wikimedia.org Nov 8 05:56:21 wikitech-static check_icinga[1043]: 2021-11-08 05:56:21,714 [INFO] Emailing faidon for alert1001.wikimedia.org Nov 8 05:56:21 wikitech-static check_icinga[1042]: 2021-11-08 05:56:21,792 [INFO] Emailing fsero for alert2001.wikimedia.org Nov 8 05:56:22 wikitech-static check_icinga[1042]: 2021-11-08 05:56:22,044 [INFO] Emailing bstorm-email for alert2001.wikimedia.org Nov 8 05:56:22 wikitech-static check_icinga[1043]: 2021-11-08 05:56:22,242 [INFO] Paging victorops for alert1001.wikimedia.org Nov 8 05:58:01 wikitech-static CRON[1120]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 05:58:01 wikitech-static CRON[1121]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 05:58:02 wikitech-static check_icinga[1122]: 2021-11-08 05:58:02,675 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 05:58:02 wikitech-static check_icinga[1123]: 2021-11-08 05:58:02,702 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 05:58:05 wikitech-static check_icinga[1123]: 2021-11-08 05:58:05,775 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 05:58:05 wikitech-static check_icinga[1122]: 2021-11-08 05:58:05,936 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:00:01 wikitech-static CRON[1203]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:00:01 wikitech-static CRON[1204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:00:02 wikitech-static check_icinga[1206]: 2021-11-08 06:00:02,071 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:00:02 wikitech-static check_icinga[1205]: 2021-11-08 06:00:02,099 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:00:05 wikitech-static check_icinga[1206]: 2021-11-08 06:00:05,118 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:00:05 wikitech-static check_icinga[1205]: 2021-11-08 06:00:05,209 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:02:01 wikitech-static CRON[1288]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:02:01 wikitech-static CRON[1289]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:02:02 wikitech-static check_icinga[1291]: 2021-11-08 06:02:02,332 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:02:02 wikitech-static check_icinga[1290]: 2021-11-08 06:02:02,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:02:05 wikitech-static check_icinga[1290]: 2021-11-08 06:02:05,552 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:02:05 wikitech-static check_icinga[1291]: 2021-11-08 06:02:05,607 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:02:32 wikitech-static systemd[1]: Created slice User Slice of root. Nov 8 06:02:32 wikitech-static systemd[1]: Started Session 9 of user root. Nov 8 06:02:32 wikitech-static systemd[1]: Starting User Manager for UID 0... Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent (ssh-agent emulation). Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent and passphrase cache (restricted). Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent (access for web browsers). Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Timers. Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG network certificate management daemon. Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Paths. Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent and passphrase cache. Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Sockets. Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Basic System. Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Default. Nov 8 06:02:32 wikitech-static systemd[1342]: Startup finished in 254ms. Nov 8 06:02:32 wikitech-static systemd[1]: Started User Manager for UID 0. Nov 8 06:04:01 wikitech-static CRON[1384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:04:01 wikitech-static CRON[1385]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:04:02 wikitech-static check_icinga[1388]: 2021-11-08 06:04:02,832 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:04:02 wikitech-static check_icinga[1387]: 2021-11-08 06:04:02,839 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:04:05 wikitech-static check_icinga[1387]: 2021-11-08 06:04:05,943 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:04:06 wikitech-static check_icinga[1388]: 2021-11-08 06:04:06,101 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:06:01 wikitech-static CRON[1462]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:06:01 wikitech-static CRON[1463]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:06:02 wikitech-static check_icinga[1465]: 2021-11-08 06:06:02,292 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:06:02 wikitech-static check_icinga[1464]: 2021-11-08 06:06:02,293 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:06:05 wikitech-static check_icinga[1465]: 2021-11-08 06:06:05,602 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:06:05 wikitech-static check_icinga[1464]: 2021-11-08 06:06:05,659 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:08:01 wikitech-static CRON[1608]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:08:01 wikitech-static CRON[1609]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:08:02 wikitech-static check_icinga[1610]: 2021-11-08 06:08:02,820 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:08:02 wikitech-static check_icinga[1611]: 2021-11-08 06:08:02,823 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:08:06 wikitech-static check_icinga[1610]: 2021-11-08 06:08:06,021 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:08:06 wikitech-static check_icinga[1611]: 2021-11-08 06:08:06,026 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:09:01 wikitech-static CRON[1660]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi) Nov 8 06:09:19 wikitech-static systemd[1]: Starting Cleanup of Temporary Directories... Nov 8 06:09:19 wikitech-static systemd[1]: Starting Clean php session files... Nov 8 06:09:19 wikitech-static systemd[1]: Started Cleanup of Temporary Directories. Nov 8 06:09:20 wikitech-static systemd[1]: Started Clean php session files. Nov 8 06:10:01 wikitech-static CRON[1801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:10:01 wikitech-static CRON[1802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:10:02 wikitech-static check_icinga[1803]: 2021-11-08 06:10:02,272 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:10:02 wikitech-static check_icinga[1804]: 2021-11-08 06:10:02,340 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:10:05 wikitech-static check_icinga[1804]: 2021-11-08 06:10:05,435 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:10:05 wikitech-static check_icinga[1803]: 2021-11-08 06:10:05,572 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:11:01 wikitech-static CRON[1851]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh) Nov 8 06:11:02 wikitech-static check_icinga_validate_config[1852]: Valid config, nothing to do. Nov 8 06:12:01 wikitech-static CRON[1888]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:12:01 wikitech-static CRON[1889]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:12:02 wikitech-static check_icinga[1890]: 2021-11-08 06:12:02,507 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:12:02 wikitech-static check_icinga[1891]: 2021-11-08 06:12:02,517 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:12:05 wikitech-static check_icinga[1890]: 2021-11-08 06:12:05,638 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:12:05 wikitech-static check_icinga[1891]: 2021-11-08 06:12:05,680 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:14:01 wikitech-static CRON[1978]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:14:01 wikitech-static CRON[1979]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:14:02 wikitech-static check_icinga[1980]: 2021-11-08 06:14:02,862 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:14:02 wikitech-static check_icinga[1981]: 2021-11-08 06:14:02,868 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:14:06 wikitech-static check_icinga[1980]: 2021-11-08 06:14:06,057 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:14:06 wikitech-static check_icinga[1981]: 2021-11-08 06:14:06,096 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:15:56 wikitech-static systemd[1]: Started Session 25 of user root. Nov 8 06:16:01 wikitech-static CRON[2105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:16:01 wikitech-static CRON[2106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:16:02 wikitech-static check_icinga[2107]: 2021-11-08 06:16:02,276 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:16:02 wikitech-static check_icinga[2108]: 2021-11-08 06:16:02,310 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:16:05 wikitech-static check_icinga[2108]: 2021-11-08 06:16:05,400 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:16:05 wikitech-static check_icinga[2107]: 2021-11-08 06:16:05,488 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:17:01 wikitech-static CRON[2154]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Nov 8 06:18:01 wikitech-static CRON[2192]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:18:01 wikitech-static CRON[2193]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:18:02 wikitech-static check_icinga[2194]: 2021-11-08 06:18:02,662 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:18:02 wikitech-static check_icinga[2195]: 2021-11-08 06:18:02,668 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:18:05 wikitech-static check_icinga[2194]: 2021-11-08 06:18:05,752 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:18:05 wikitech-static check_icinga[2195]: 2021-11-08 06:18:05,914 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:18:40 wikitech-static systemd[1]: getty@tty1.service: Service has no hold-off time, scheduling restart. Nov 8 06:18:40 wikitech-static systemd[1]: Stopped Getty on tty1. Nov 8 06:18:40 wikitech-static systemd[1]: Started Getty on tty1. Nov 8 06:20:01 wikitech-static CRON[2402]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org) Nov 8 06:20:01 wikitech-static CRON[2403]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org) Nov 8 06:20:03 wikitech-static check_icinga[2405]: 2021-11-08 06:20:03,038 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org) Nov 8 06:20:03 wikitech-static check_icinga[2404]: 2021-11-08 06:20:03,102 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org) Nov 8 06:20:06 wikitech-static check_icinga[2404]: 2021-11-08 06:20:06,224 [INFO] Check for host alert2001.wikimedia.org: OK Nov 8 06:20:06 wikitech-static check_icinga[2405]: 2021-11-08 06:20:06,231 [INFO] Check for host alert1001.wikimedia.org: OK Nov 8 06:21:19 wikitech-static systemd[1]: Started Session 33 of user root.