Prev Index Next

kadi: Thu Jun 5 08:04:17 2025

File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_events.log

Task	Status	Age	MaxAge	Last Date
kadi	NOT OK	0.11	1.0	Thu Jun 5 08:04:17 2025

Errors:

Line 103: 2025-06-04 09:02:41,869 main: ERROR in processing MajorEvent
Line 104: 2025-06-04 09:02:42,156 main: Traceback:
Line 105: Traceback (most recent call last):
Line 107: raise TypeError
Line 108: TypeError
Line 110: During handling of the above exception, another exception occurred:
Line 112: Traceback (most recent call last):
Line 131: raise ChandraTimeError("Invalid input format '%s'" % fmt_in)
Line 132: chandra_time.Time.ChandraTimeError: Invalid input format 'None'
Line 348: 2025-06-04 10:02:28,579 main: ERROR in processing MajorEvent
Line 349: 2025-06-04 10:02:28,582 main: Traceback:
Line 350: Traceback (most recent call last):
Line 352: raise TypeError
Line 353: TypeError
Line 355: During handling of the above exception, another exception occurred:
Line 357: Traceback (most recent call last):
Line 376: raise ChandraTimeError("Invalid input format '%s'" % fmt_in)
Line 377: chandra_time.Time.ChandraTimeError: Invalid input format 'None'
Line 781: Traceback (most recent call last):
Line 785: KeyError: 'version'
Line 787: During handling of the above exception, another exception occurred:
Line 789: Traceback (most recent call last):
Line 797: TimeoutError: [Errno 110] Connection timed out
Line 799: The above exception was the direct cause of the following exception:
Line 801: Traceback (most recent call last):
Line 819: raise ConnectTimeoutError(
Line 820: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 820: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 822: The above exception was the direct cause of the following exception:
Line 824: Traceback (most recent call last):
Line 832: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 834: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 834: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 836: During handling of the above exception, another exception occurred:
Line 838: Traceback (most recent call last):
Line 901: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 901: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 921: Traceback (most recent call last):
Line 925: KeyError: 'version'
Line 927: During handling of the above exception, another exception occurred:
Line 929: Traceback (most recent call last):
Line 937: TimeoutError: [Errno 110] Connection timed out
Line 939: The above exception was the direct cause of the following exception:
Line 941: Traceback (most recent call last):
Line 959: raise ConnectTimeoutError(
Line 960: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 960: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 962: The above exception was the direct cause of the following exception:
Line 964: Traceback (most recent call last):
Line 972: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 974: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 974: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 976: During handling of the above exception, another exception occurred:
Line 978: Traceback (most recent call last):
Line 1041: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1041: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1061: Traceback (most recent call last):
Line 1065: KeyError: 'version'
Line 1067: During handling of the above exception, another exception occurred:
Line 1069: Traceback (most recent call last):
Line 1077: TimeoutError: [Errno 110] Connection timed out
Line 1079: The above exception was the direct cause of the following exception:
Line 1081: Traceback (most recent call last):
Line 1099: raise ConnectTimeoutError(
Line 1100: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1100: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1102: The above exception was the direct cause of the following exception:
Line 1104: Traceback (most recent call last):
Line 1112: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1114: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1114: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1116: During handling of the above exception, another exception occurred:
Line 1118: Traceback (most recent call last):
Line 1181: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1181: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1201: Traceback (most recent call last):
Line 1205: KeyError: 'version'
Line 1207: During handling of the above exception, another exception occurred:
Line 1209: Traceback (most recent call last):
Line 1217: TimeoutError: [Errno 110] Connection timed out
Line 1219: The above exception was the direct cause of the following exception:
Line 1221: Traceback (most recent call last):
Line 1239: raise ConnectTimeoutError(
Line 1240: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1240: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1242: The above exception was the direct cause of the following exception:
Line 1244: Traceback (most recent call last):
Line 1252: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1254: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1254: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1256: During handling of the above exception, another exception occurred:
Line 1258: Traceback (most recent call last):
Line 1321: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1321: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1341: Traceback (most recent call last):
Line 1345: KeyError: 'version'
Line 1347: During handling of the above exception, another exception occurred:
Line 1349: Traceback (most recent call last):
Line 1357: TimeoutError: [Errno 110] Connection timed out
Line 1359: The above exception was the direct cause of the following exception:
Line 1361: Traceback (most recent call last):
Line 1379: raise ConnectTimeoutError(
Line 1380: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1380: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1382: The above exception was the direct cause of the following exception:
Line 1384: Traceback (most recent call last):
Line 1392: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1394: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1394: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1396: During handling of the above exception, another exception occurred:
Line 1398: Traceback (most recent call last):
Line 1461: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1461: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1481: Traceback (most recent call last):
Line 1485: KeyError: 'version'
Line 1487: During handling of the above exception, another exception occurred:
Line 1489: Traceback (most recent call last):
Line 1497: TimeoutError: [Errno 110] Connection timed out
Line 1499: The above exception was the direct cause of the following exception:
Line 1501: Traceback (most recent call last):
Line 1519: raise ConnectTimeoutError(
Line 1520: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1520: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1522: The above exception was the direct cause of the following exception:
Line 1524: Traceback (most recent call last):
Line 1532: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1534: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1534: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1536: During handling of the above exception, another exception occurred:
Line 1538: Traceback (most recent call last):
Line 1601: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1601: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1621: Traceback (most recent call last):
Line 1625: KeyError: 'version'
Line 1627: During handling of the above exception, another exception occurred:
Line 1629: Traceback (most recent call last):
Line 1637: TimeoutError: [Errno 110] Connection timed out
Line 1639: The above exception was the direct cause of the following exception:
Line 1641: Traceback (most recent call last):
Line 1659: raise ConnectTimeoutError(
Line 1660: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1660: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1662: The above exception was the direct cause of the following exception:
Line 1664: Traceback (most recent call last):
Line 1672: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1674: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1674: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1676: During handling of the above exception, another exception occurred:
Line 1678: Traceback (most recent call last):
Line 1741: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1741: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1761: Traceback (most recent call last):
Line 1765: KeyError: 'version'
Line 1767: During handling of the above exception, another exception occurred:
Line 1769: Traceback (most recent call last):
Line 1777: TimeoutError: [Errno 110] Connection timed out
Line 1779: The above exception was the direct cause of the following exception:
Line 1781: Traceback (most recent call last):
Line 1799: raise ConnectTimeoutError(
Line 1800: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1800: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1802: The above exception was the direct cause of the following exception:
Line 1804: Traceback (most recent call last):
Line 1812: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1814: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1814: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1816: During handling of the above exception, another exception occurred:
Line 1818: Traceback (most recent call last):
Line 1881: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1881: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1901: Traceback (most recent call last):
Line 1905: KeyError: 'version'
Line 1907: During handling of the above exception, another exception occurred:
Line 1909: Traceback (most recent call last):
Line 1917: TimeoutError: [Errno 110] Connection timed out
Line 1919: The above exception was the direct cause of the following exception:
Line 1921: Traceback (most recent call last):
Line 1939: raise ConnectTimeoutError(
Line 1940: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1940: urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')
Line 1942: The above exception was the direct cause of the following exception:
Line 1944: Traceback (most recent call last):
Line 1952: raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1954: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1954: urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 1956: During handling of the above exception, another exception occurred:
Line 1958: Traceback (most recent call last):
Line 2021: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
Line 2021: requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

File contents:

2025-06-04 09:02:12,866 log_run_info: ******************************************
2025-06-04 09:02:12,866 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 09:02:12,866 log_run_info: Version: 7.16.0
2025-06-04 09:02:12,866 log_run_info: Time: Wed Jun 4 09:02:12 2025
2025-06-04 09:02:12,866 log_run_info: User: aldcroft
2025-06-04 09:02:12,866 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 09:02:12,866 log_run_info: Processing args:
2025-06-04 09:02:12,866 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 09:02:12,866 log_run_info: 'delete_from_start': False,
2025-06-04 09:02:12,866 log_run_info: 'log_level': 'INFO',
2025-06-04 09:02:12,866 log_run_info: 'loop_days': 100,
2025-06-04 09:02:12,866 log_run_info: 'maude': True,
2025-06-04 09:02:12,866 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 09:02:12,866 log_run_info: 'models': None,
2025-06-04 09:02:12,866 log_run_info: 'start': None,
2025-06-04 09:02:12,866 log_run_info: 'stop': '2025:155:13:02:12.836'}
2025-06-04 09:02:12,866 log_run_info: ******************************************
2025-06-04 09:02:12,867 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 09:02:12,867 main:
2025-06-04 09:02:15,053 check_maude_server_has_new_telemetry: New telemetry in MAUDE: update_model.date='2025:155:00:45:00.000' -> date_last_telemetry='2025:155:11:50:00.000'
2025-06-04 09:02:15,053 check_maude_server_has_new_telemetry: Updating Update.maude_latest_backorbit date to 2025:155:11:50:00.000
2025-06-04 09:02:15,069 main: Setting Obsid lookback to 7 days
2025-06-04 09:02:15,074 update_event_model: Updating Obsid events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:15,105 get_date_start_stop_for_maude: Using 2025:154:09:49:06.253 as start for Obsid (4 hours before last event)
2025-06-04 09:02:15,335 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for Obsid
2025-06-04 09:02:16,533 save_event_to_database: Added Obsid start=2025:155:00:08:04.055 dur=31734 obsid=30492
2025-06-04 09:02:16,861 delete_from_date: Deleting 30 PassPlan events after 2025:148:13:02:12.836
2025-06-04 09:02:17,071 update_event_model: Updating PassPlan events from 2025:134:03:02:16 to 2025:183:13:02:12
2025-06-04 09:02:18,068 save_event_to_database: Added PassPlan DSS-54 2025:148:20:35:00 05/28/25 04:35:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 09:02:18,069 save_event_to_database: Added PassPlan DSS-65 2025:149:00:10:00 05/28/25 08:10:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 09:02:18,070 save_event_to_database: Added PassPlan DSS-36 2025:149:12:50:00 05/29/25 08:50:00 AM OC:Craig Mahon CC:Ryan Hoover
2025-06-04 09:02:18,070 save_event_to_database: Added PassPlan DSS-54 2025:149:21:10:00 05/29/25 05:10:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 09:02:18,077 save_event_to_database: Added PassPlan DSS-65 2025:149:23:25:00 05/29/25 07:25:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 09:02:18,078 save_event_to_database: Added PassPlan DSS-26 2025:150:10:45:00 05/30/25 06:45:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 09:02:18,079 save_event_to_database: Added PassPlan DSS-34 2025:150:16:55:00 05/30/25 12:55:00 PM OC:Jay Wellington CC:Julia Zachary
2025-06-04 09:02:18,079 save_event_to_database: Added PassPlan DSS-65 2025:151:00:00:00 05/30/25 08:00:00 PM OC:Jay Wellington CC:Julia Zachary
2025-06-04 09:02:18,080 save_event_to_database: Added PassPlan DSS-24 2025:151:11:55:00 05/31/25 07:55:00 AM OC:Craig Mahon CC:Jay Wellington
2025-06-04 09:02:18,080 save_event_to_database: Added PassPlan DSS-54 2025:151:17:50:00 05/31/25 01:50:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 09:02:18,081 save_event_to_database: Added PassPlan DSS-65 2025:152:01:10:00 05/31/25 09:10:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 09:02:18,081 save_event_to_database: Added PassPlan DSS-24 2025:152:11:45:00 06/01/25 07:45:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 09:02:18,082 save_event_to_database: Added PassPlan DSS-34 2025:152:17:10:00 06/01/25 01:10:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 09:02:18,083 save_event_to_database: Added PassPlan DSS-65 2025:153:00:00:00 06/01/25 08:00:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 09:02:18,083 save_event_to_database: Added PassPlan DSS-26 2025:153:10:35:00 06/02/25 06:35:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 09:02:18,084 save_event_to_database: Added PassPlan DSS-54 2025:153:18:45:00 06/02/25 02:45:00 PM OC:Jay Wellington CC:Jake Aznavorian
2025-06-04 09:02:18,084 save_event_to_database: Added PassPlan DSS-65 2025:154:01:45:00 06/02/25 09:45:00 PM OC:Jay Wellington CC:Jake Aznavorian
2025-06-04 09:02:18,085 save_event_to_database: Added PassPlan DSS-24 2025:154:10:50:00 06/03/25 06:50:00 AM OC:Craig Mahon CC:Ryan Hoover
2025-06-04 09:02:18,085 save_event_to_database: Added PassPlan DSS-65 2025:155:00:00:00 06/03/25 08:00:00 PM OC:Jay Wellington CC:Jake Aznavorian
2025-06-04 09:02:18,086 save_event_to_database: Added PassPlan DSS-26 2025:155:11:05:00 06/04/25 07:05:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 09:02:18,087 save_event_to_database: Added PassPlan DSS-24 2025:156:06:10:00 06/05/25 02:10:00 AM OC: CC:
2025-06-04 09:02:18,087 save_event_to_database: Added PassPlan DSS-24 2025:156:11:30:00 06/05/25 07:30:00 AM OC: CC:
2025-06-04 09:02:18,088 save_event_to_database: Added PassPlan DSS-65 2025:157:01:30:00 06/05/25 09:30:00 PM OC: CC:
2025-06-04 09:02:18,088 save_event_to_database: Added PassPlan DSS-26 2025:157:09:35:00 06/06/25 05:35:00 AM OC: CC:
2025-06-04 09:02:18,089 save_event_to_database: Added PassPlan DSS-65 2025:157:19:00:00 06/06/25 03:00:00 PM OC: CC:
2025-06-04 09:02:18,089 save_event_to_database: Added PassPlan DSS-65 2025:158:01:25:00 06/06/25 09:25:00 PM OC: CC:
2025-06-04 09:02:18,090 save_event_to_database: Added PassPlan DSS-24 2025:158:11:20:00 06/07/25 07:20:00 AM OC: CC:
2025-06-04 09:02:18,090 save_event_to_database: Added PassPlan DSS-65 2025:159:01:15:00 06/07/25 09:15:00 PM OC: CC:
2025-06-04 09:02:18,091 save_event_to_database: Added PassPlan DSS-24 2025:159:11:15:00 06/08/25 07:15:00 AM OC: CC:
2025-06-04 09:02:18,092 save_event_to_database: Added PassPlan DSS-54 2025:159:17:05:00 06/08/25 01:05:00 PM OC: CC:
2025-06-04 09:02:18,109 main: Setting TscMove lookback to 7 days
2025-06-04 09:02:18,120 update_event_model: Updating TscMove events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:18,136 get_date_start_stop_for_maude: Using 2025:154:20:05:59.518 as start for TscMove (4 hours before last event)
2025-06-04 09:02:18,448 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for TscMove
2025-06-04 09:02:18,996 save_event_to_database: Added TscMove start=2025:155:08:55:09.920 dur=230 start_3tscpos=75624.0 stop_3tscpos=-99616.0
2025-06-04 09:02:19,027 main: Setting DarkCalReplica lookback to 7 days
2025-06-04 09:02:19,037 update_event_model: Updating DarkCalReplica events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:19,082 get_date_start_stop_for_maude: Using 2025:150:14:02:40.031 as start for DarkCalReplica (4 hours before last event)
2025-06-04 09:02:19,161 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for DarkCalReplica
2025-06-04 09:02:19,969 main: Setting DarkCal lookback to 7 days
2025-06-04 09:02:19,979 update_event_model: Updating DarkCal events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:20,081 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for DarkCal
2025-06-04 09:02:20,427 main: Setting Scs107 lookback to 7 days
2025-06-04 09:02:20,436 update_event_model: Updating Scs107 events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:20,456 get_date_start_stop_for_maude: Using 2025:152:01:51:37.608 as start for Scs107 (4 hours before last event)
2025-06-04 09:02:20,512 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for Scs107
2025-06-04 09:02:21,943 main: Setting FaMove lookback to 7 days
2025-06-04 09:02:21,948 update_event_model: Updating FaMove events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:21,990 get_date_start_stop_for_maude: Using 2025:154:09:57:00.315 as start for FaMove (4 hours before last event)
2025-06-04 09:02:22,233 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for FaMove
2025-06-04 09:02:22,995 save_event_to_database: Added FaMove start=2025:155:09:00:37.920 dur=33 start_3fapos=-467.0 stop_3fapos=-990.0
2025-06-04 09:02:23,016 main: Setting GratingMove lookback to 7 days
2025-06-04 09:02:23,030 update_event_model: Updating GratingMove events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:23,061 get_date_start_stop_for_maude: Using 2025:154:09:49:42.768 as start for GratingMove (4 hours before last event)
2025-06-04 09:02:23,239 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for GratingMove
2025-06-04 09:02:24,752 save_event_to_database: Added GratingMove start=2025:155:08:57:34.060 dur=183 grating=LETG direction=INSR
2025-06-04 09:02:24,761 main: Setting Dump lookback to 7 days
2025-06-04 09:02:24,767 update_event_model: Updating Dump events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:24,842 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for Dump
2025-06-04 09:02:27,668 main: Setting Eclipse lookback to 7 days
2025-06-04 09:02:27,676 update_event_model: Updating Eclipse events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:27,765 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for Eclipse
2025-06-04 09:02:30,462 main: Setting Manvr lookback to 7 days
2025-06-04 09:02:30,469 update_event_model: Updating Manvr events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:30,517 get_date_start_stop_for_maude: Using 2025:154:09:49:00.872 as start for Manvr (4 hours before last event)
2025-06-04 09:02:30,639 get_date_start_stop_for_maude: Using last backorbit date 2025:155:11:50:00.000 as stop for Manvr
2025-06-04 09:02:34,361 save_event_to_database: Added Manvr start=2025:155:00:05:14.674 dur=2143 n_dwell=1 template=normal
2025-06-04 09:02:34,517 main: Setting SafeSun lookback to 7 days
2025-06-04 09:02:34,522 update_event_model: Updating SafeSun events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:34,583 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for SafeSun
2025-06-04 09:02:38,313 main: Setting NormalSun lookback to 7 days
2025-06-04 09:02:38,319 update_event_model: Updating NormalSun events from 2025:148:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:38,657 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:10:00.000 as stop for NormalSun
2025-06-04 09:02:41,463 delete_from_date: Deleting 0 MajorEvent events after 2023:156:13:02:12.836
2025-06-04 09:02:41,466 update_event_model: Updating MajorEvent events from 2023:104:04:02:10 to 2025:155:13:02:12
2025-06-04 09:02:41,869 main: ERROR in processing MajorEvent
2025-06-04 09:02:42,156 main: Traceback:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 644, in convert
raise TypeError
TypeError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 601, in main
update_event_model(EventModel, date_stop, opt.maude)
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 216, in update_event_model
events_in_dates = EventModel.get_events(date_start, date_stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/events/models.py", line 2099, in get_events
events = scrape.get_fot_major_events() + scrape.get_fdb_major_events()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/events/scrape.py", line 123, in get_fot_major_events
caldate = start.caldate
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 814, in __getattr__
return convert(self.time_in,
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 647, in convert
return _convert(time_in, sys_in, fmt_in, sys_out, fmt_out)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 674, in _convert
raise ChandraTimeError("Invalid input format '%s'" % fmt_in)
chandra_time.Time.ChandraTimeError: Invalid input format 'None'

2025-06-04 09:02:42,159 update_event_model: Updating CAP events from 2025:134:03:02:16 to 2025:155:13:02:12
2025-06-04 09:02:42,294 save_event_to_database: Added CAP 425I: 2025:155:12:19:37 Sequencer-A Self Test
2025-06-04 09:02:42,295 save_event_to_database: Added CAP 563B: 2025:155:12:24:22 Diagnostic Dumps of the CPE
2025-06-04 09:02:42,326 delete_from_date: Deleting 33 LoadSegment events after 2025:135:13:02:12.836
2025-06-04 09:02:42,376 update_event_model: Updating LoadSegment events from 2025:115:03:02:16 to 2025:183:13:02:12
2025-06-04 09:02:43,080 save_event_to_database: Added LoadSegment CL136:1403: 2025:136:14:20:00 MAY1225A scs=131
2025-06-04 09:02:43,081 save_event_to_database: Added LoadSegment CL136:1403: 2025:136:14:20:00 MAY1225A scs=128
2025-06-04 09:02:43,081 save_event_to_database: Added LoadSegment CL138:0403: 2025:138:04:36:27 MAY1225A scs=132
2025-06-04 09:02:43,082 save_event_to_database: Added LoadSegment CL138:0403: 2025:138:04:36:27 MAY1225A scs=129
2025-06-04 09:02:43,082 save_event_to_database: Added LoadSegment CL138:2301: 2025:138:23:57:00 MAY1925A scs=133
2025-06-04 09:02:43,083 save_event_to_database: Added LoadSegment CL138:2301: 2025:138:23:57:00 MAY1925A scs=130
2025-06-04 09:02:43,083 save_event_to_database: Added LoadSegment CL140:1101: 2025:140:11:50:43 MAY1925A scs=131
2025-06-04 09:02:43,084 save_event_to_database: Added LoadSegment CL140:1101: 2025:140:11:50:43 MAY1925A scs=128
2025-06-04 09:02:43,084 save_event_to_database: Added LoadSegment CL142:0001: 2025:142:00:09:49 MAY1925A scs=132
2025-06-04 09:02:43,084 save_event_to_database: Added LoadSegment CL142:0001: 2025:142:00:09:49 MAY1925A scs=129
2025-06-04 09:02:43,085 save_event_to_database: Added LoadSegment CL143:1301: 2025:143:13:00:00 MAY1925A scs=133
2025-06-04 09:02:43,085 save_event_to_database: Added LoadSegment CL143:1301: 2025:143:13:00:00 MAY1925A scs=130
2025-06-04 09:02:43,086 save_event_to_database: Added LoadSegment CL145:0101: 2025:145:01:01:14 MAY1925A scs=131
2025-06-04 09:02:43,086 save_event_to_database: Added LoadSegment CL145:0101: 2025:145:01:01:14 MAY1925A scs=128
2025-06-04 09:02:43,086 save_event_to_database: Added LoadSegment CL146:0103: 2025:146:01:40:21 MAY2625B scs=132
2025-06-04 09:02:43,087 save_event_to_database: Added LoadSegment CL146:0103: 2025:146:01:40:21 MAY2625B scs=129
2025-06-04 09:02:43,087 save_event_to_database: Added LoadSegment CL147:1403: 2025:147:14:16:12 MAY2625B scs=133
2025-06-04 09:02:43,088 save_event_to_database: Added LoadSegment CL147:1403: 2025:147:14:16:12 MAY2625B scs=130
2025-06-04 09:02:43,088 save_event_to_database: Added LoadSegment CL149:0203: 2025:149:02:25:01 MAY2625B scs=131
2025-06-04 09:02:43,088 save_event_to_database: Added LoadSegment CL149:0203: 2025:149:02:25:01 MAY2625B scs=128
2025-06-04 09:02:43,089 save_event_to_database: Added LoadSegment CL150:1603: 2025:150:16:04:26 MAY2625B scs=132
2025-06-04 09:02:43,089 save_event_to_database: Added LoadSegment CL150:1603: 2025:150:16:04:26 MAY2625B scs=129
2025-06-04 09:02:43,090 save_event_to_database: Added LoadSegment CL152:0503: 2025:152:05:04:11 MAY2625B scs=133
2025-06-04 09:02:43,090 save_event_to_database: Added LoadSegment CL152:0503: 2025:152:05:04:11 MAY2625B scs=130
2025-06-04 09:02:43,090 save_event_to_database: Added LoadSegment CL152:2301: 2025:152:23:51:14 JUN0225A scs=128
2025-06-04 09:02:43,091 save_event_to_database: Added LoadSegment CL153:1902: 2025:153:19:52:00 JUN0225B scs=133
2025-06-04 09:02:43,091 save_event_to_database: Added LoadSegment CL153:1902: 2025:153:19:52:00 JUN0225B scs=130
2025-06-04 09:02:43,092 save_event_to_database: Added LoadSegment CL155:0802: 2025:155:08:50:57 JUN0225B scs=131
2025-06-04 09:02:43,092 save_event_to_database: Added LoadSegment CL155:0802: 2025:155:08:50:57 JUN0225B scs=128
2025-06-04 09:02:43,092 save_event_to_database: Added LoadSegment CL156:2102: 2025:156:21:39:43 JUN0225B scs=132
2025-06-04 09:02:43,093 save_event_to_database: Added LoadSegment CL156:2102: 2025:156:21:39:43 JUN0225B scs=129
2025-06-04 09:02:43,093 save_event_to_database: Added LoadSegment CL158:1202: 2025:158:12:05:00 JUN0225B scs=133
2025-06-04 09:02:43,094 save_event_to_database: Added LoadSegment CL158:1202: 2025:158:12:05:00 JUN0225B scs=130
2025-06-04 09:02:43,119 delete_from_date: Deleting 40 DsnComm events after 2025:148:13:02:12.836
2025-06-04 09:02:43,177 update_event_model: Updating DsnComm events from 2025:134:03:02:16 to 2025:183:13:02:12
2025-06-04 09:02:44,445 save_event_to_database: Added DsnComm DSS-54: 2025:148:20:35:00 2120-2220 TKG PASS
2025-06-04 09:02:44,445 save_event_to_database: Added DsnComm DSS-65: 2025:149:00:10:00 0055-0155 TKG PASS
2025-06-04 09:02:44,446 save_event_to_database: Added DsnComm DSS-36: 2025:149:12:50:00 1335-1435 TKG PASS
2025-06-04 09:02:44,447 save_event_to_database: Added DsnComm DSS-54: 2025:149:21:10:00 2145-2230 SHORT TKG N/R
2025-06-04 09:02:44,447 save_event_to_database: Added DsnComm DSS-65: 2025:149:23:25:00 0010-0110 TKG PASS
2025-06-04 09:02:44,448 save_event_to_database: Added DsnComm DSS-26: 2025:150:10:45:00 1130-1230 TKG PASS
2025-06-04 09:02:44,448 save_event_to_database: Added DsnComm DSS-34: 2025:150:16:55:00 1740-1835 SHORT/SRDC
2025-06-04 09:02:44,449 save_event_to_database: Added DsnComm DSS-65: 2025:151:00:00:00 0045-0145 TKG PASS
2025-06-04 09:02:44,450 save_event_to_database: Added DsnComm DSS-24: 2025:151:11:55:00 1240-1340 TKG PASS
2025-06-04 09:02:44,450 save_event_to_database: Added DsnComm DSS-54: 2025:151:17:50:00 1835-1935 TKG PASS
2025-06-04 09:02:44,451 save_event_to_database: Added DsnComm DSS-65: 2025:152:01:10:00 0155-0255 TKG PASS
2025-06-04 09:02:44,451 save_event_to_database: Added DsnComm DSS-24: 2025:152:11:45:00 1230-1330 TKG PASS
2025-06-04 09:02:44,452 save_event_to_database: Added DsnComm DSS-34: 2025:152:17:10:00 1755-1855 TKG PASS
2025-06-04 09:02:44,453 save_event_to_database: Added DsnComm DSS-65: 2025:153:00:00:00 0045-0145 TKG PASS
2025-06-04 09:02:44,453 save_event_to_database: Added DsnComm DSS-26: 2025:153:10:35:00 1120-1220 TKG PASS
2025-06-04 09:02:44,454 save_event_to_database: Added DsnComm DSS-54: 2025:153:18:45:00 1930-2030 TKG PASS
2025-06-04 09:02:44,454 save_event_to_database: Added DsnComm DSS-65: 2025:154:01:45:00 0230-0330 TKG PASS
2025-06-04 09:02:44,455 save_event_to_database: Added DsnComm DSS-24: 2025:154:10:50:00 1135-1235 TKG PASS
2025-06-04 09:02:44,455 save_event_to_database: Added DsnComm DSS-65: 2025:155:00:00:00 0045-0145 TKG PASS
2025-06-04 09:02:44,456 save_event_to_database: Added DsnComm DSS-26: 2025:155:11:05:00 1150-1250 TKG PASS
2025-06-04 09:02:44,457 save_event_to_database: Added DsnComm DSS-24: 2025:156:06:10:00 0645-0730 SHORT TKG N/R
2025-06-04 09:02:44,465 save_event_to_database: Added DsnComm DSS-24: 2025:156:11:30:00 1215-1300 SHORT TKG PASS
2025-06-04 09:02:44,466 save_event_to_database: Added DsnComm DSS-65: 2025:157:01:30:00 0215-0315 TKG PASS
2025-06-04 09:02:44,466 save_event_to_database: Added DsnComm DSS-26: 2025:157:09:35:00 1020-1120 TKG PASS
2025-06-04 09:02:44,467 save_event_to_database: Added DsnComm DSS-65: 2025:157:19:00:00 1945-2045 TKG PASS
2025-06-04 09:02:44,467 save_event_to_database: Added DsnComm DSS-65: 2025:158:01:25:00 0210-0310 TKG PASS
2025-06-04 09:02:44,468 save_event_to_database: Added DsnComm DSS-24: 2025:158:11:20:00 1205-1305 TKG PASS
2025-06-04 09:02:44,468 save_event_to_database: Added DsnComm DSS-65: 2025:159:01:15:00 0200-0300 TKG PASS
2025-06-04 09:02:44,469 save_event_to_database: Added DsnComm DSS-24: 2025:159:11:15:00 1200-1300 TKG PASS
2025-06-04 09:02:44,469 save_event_to_database: Added DsnComm DSS-54: 2025:159:17:05:00 1750-1850 TKG PASS
2025-06-04 09:02:44,470 save_event_to_database: Added DsnComm DSS-65: 2025:160:01:25:00 0210-0310 TKG PASS
2025-06-04 09:02:44,470 save_event_to_database: Added DsnComm DSS-24: 2025:160:11:15:00 1200-1300 TKG PASS
2025-06-04 09:02:44,471 save_event_to_database: Added DsnComm DSS-65: 2025:160:19:05:00 1950-2050 TKG PASS
2025-06-04 09:02:44,472 save_event_to_database: Added DsnComm DSS-65: 2025:161:01:45:00 0230-0330 TKG PASS
2025-06-04 09:02:44,472 save_event_to_database: Added DsnComm DSS-54: 2025:161:13:20:00 1405-1505 TKG PASS
2025-06-04 09:02:44,473 save_event_to_database: Added DsnComm DSS-65: 2025:161:18:05:00 1850-1950 TKG PASS
2025-06-04 09:02:44,473 save_event_to_database: Added DsnComm DSS-56: 2025:161:22:55:00 2340-0040 RTS DEMO
2025-06-04 09:02:44,474 save_event_to_database: Added DsnComm DSS-24: 2025:162:01:35:00 0220-0320 TKG PASS
2025-06-04 09:02:44,474 save_event_to_database: Added DsnComm DSS-24: 2025:162:08:00:00 0835-0855 SHORT TKG N/R
2025-06-04 09:02:44,475 save_event_to_database: Added DsnComm DSS-65: 2025:162:19:50:00 2025-2050 SHORT TKG N/R
2025-06-04 09:02:44,475 save_event_to_database: Added DsnComm DSS-65: 2025:163:03:10:00 0355-0525 TKG PASS
2025-06-04 09:02:44,476 save_event_to_database: Added DsnComm DSS-65: 2025:163:21:15:00 2200-2330 TKG PASS
2025-06-04 09:02:44,476 save_event_to_database: Added DsnComm DSS-26: 2025:164:09:55:00 1030-1115 TKG N/R
2025-06-04 09:02:44,477 save_event_to_database: Added DsnComm DSS-54: 2025:164:20:20:00 2105-2155 SHORT TKG PASS
2025-06-04 09:02:44,477 save_event_to_database: Added DsnComm DSS-24: 2025:165:01:45:00 0230-0330 TKG PASS
2025-06-04 09:02:44,478 save_event_to_database: Added DsnComm DSS-24: 2025:165:12:30:00 1315-1415 TKG PASS
2025-06-04 09:02:44,478 save_event_to_database: Added DsnComm DSS-54: 2025:165:17:50:00 1835-1935 TKG PASS
2025-06-04 09:02:44,479 save_event_to_database: Added DsnComm DSS-54: 2025:166:02:10:00 0255-0350 SHORT TKG PASS
2025-06-04 09:02:44,480 save_event_to_database: Added DsnComm DSS-26: 2025:166:12:30:00 1315-1415 TKG PASS
2025-06-04 09:02:44,480 save_event_to_database: Added DsnComm DSS-65: 2025:166:21:40:00 2225-2325 TKG PASS
2025-06-04 09:02:44,481 save_event_to_database: Added DsnComm DSS-65: 2025:167:01:15:00 0200-0300 TKG PASS
2025-06-04 09:02:44,481 save_event_to_database: Added DsnComm DSS-65: 2025:167:17:40:00 1825-1925 TKG PASS
2025-06-04 09:02:44,482 save_event_to_database: Added DsnComm DSS-26: 2025:168:01:05:00 0150-0250 TKG PASS
2025-06-04 09:02:44,482 save_event_to_database: Added DsnComm DSS-24: 2025:168:10:40:00 1125-1225 TKG PASS
2025-06-04 09:02:44,483 save_event_to_database: Added DsnComm DSS-36: 2025:168:16:25:00 1710-1800 SHORT TKG PASS
2025-06-04 09:02:44,483 save_event_to_database: Added DsnComm DSS-65: 2025:168:23:45:00 0030-0130 TKG PASS
2025-06-04 09:02:44,484 save_event_to_database: Added DsnComm DSS-54: 2025:169:11:50:00 1225-1255 SHORT TKG N/R
2025-06-04 09:02:44,484 save_event_to_database: Added DsnComm DSS-65: 2025:169:23:00:00 2335-0025 SHORT TKG N/R
2025-06-04 09:02:44,485 save_event_to_database: Added DsnComm DSS-54: 2025:170:02:10:00 0255-0350 SHORT TKG PASS
2025-06-04 09:02:44,485 save_event_to_database: Added DsnComm DSS-24: 2025:170:12:40:00 1325-1425 TKG PASS
2025-06-04 09:02:44,486 save_event_to_database: Added DsnComm DSS-65: 2025:170:22:15:00 2300-0000 TKG PASS
2025-06-04 09:02:44,486 save_event_to_database: Added DsnComm DSS-26: 2025:171:01:45:00 0230-0330 TKG PASS
2025-06-04 09:02:44,487 save_event_to_database: Added DsnComm DSS-26: 2025:171:09:30:00 1015-1115 TKG PASS
2025-06-04 09:02:44,488 save_event_to_database: Added DsnComm DSS-34: 2025:171:14:20:00 1505-1605 TKG PASS
2025-06-04 09:02:44,488 save_event_to_database: Added DsnComm DSS-36: 2025:172:00:45:00 0130-0215 SHORT TKG PASS
2025-06-04 09:02:44,489 save_event_to_database: Added DsnComm DSS-24: 2025:172:10:25:00 1110-1210 TKG PASS
2025-06-04 09:02:44,489 save_event_to_database: Added DsnComm DSS-65: 2025:172:15:45:00 1630-1730 TKG PASS
2025-06-04 09:02:44,490 save_event_to_database: Added DsnComm DSS-65: 2025:172:23:45:00 0030-0130 TKG PASS
2025-06-04 09:02:44,490 save_event_to_database: Added DsnComm DSS-26: 2025:173:09:30:00 1015-1115 TKG PASS
2025-06-04 09:02:44,491 save_event_to_database: Added DsnComm DSS-65: 2025:173:19:00:00 1945-2045 TKG PASS
2025-06-04 09:02:44,512 update_event_model: Updating Orbit events from 2025:134:03:02:16 to 2025:183:13:02:12
2025-06-04 09:02:45,299 update_event_model: Updating LttBad events from 2025:134:03:02:16 to 2025:155:13:02:12
2025-06-04 10:02:12,079 log_run_info: ******************************************
2025-06-04 10:02:12,079 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 10:02:12,079 log_run_info: Version: 7.16.0
2025-06-04 10:02:12,079 log_run_info: Time: Wed Jun 4 10:02:12 2025
2025-06-04 10:02:12,079 log_run_info: User: aldcroft
2025-06-04 10:02:12,079 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 10:02:12,079 log_run_info: Processing args:
2025-06-04 10:02:12,079 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 10:02:12,079 log_run_info: 'delete_from_start': False,
2025-06-04 10:02:12,079 log_run_info: 'log_level': 'INFO',
2025-06-04 10:02:12,079 log_run_info: 'loop_days': 100,
2025-06-04 10:02:12,079 log_run_info: 'maude': True,
2025-06-04 10:02:12,079 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 10:02:12,079 log_run_info: 'models': None,
2025-06-04 10:02:12,079 log_run_info: 'start': None,
2025-06-04 10:02:12,079 log_run_info: 'stop': '2025:155:14:02:12.050'}
2025-06-04 10:02:12,079 log_run_info: ******************************************
2025-06-04 10:02:12,080 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 10:02:12,080 main:
2025-06-04 10:02:13,285 check_maude_server_has_new_telemetry: New telemetry in MAUDE: update_model.date='2025:155:11:50:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 10:02:13,285 check_maude_server_has_new_telemetry: Updating Update.maude_latest_backorbit date to 2025:155:12:40:00.000
2025-06-04 10:02:13,292 main: Setting Obsid lookback to 7 days
2025-06-04 10:02:13,294 update_event_model: Updating Obsid events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:13,299 get_date_start_stop_for_maude: Using 2025:154:20:08:04.055 as start for Obsid (4 hours before last event)
2025-06-04 10:02:13,340 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for Obsid
2025-06-04 10:02:13,581 save_event_to_database: Added Obsid start=2025:155:08:56:58.057 dur=12558 obsid=30960
2025-06-04 10:02:13,591 delete_from_date: Deleting 30 PassPlan events after 2025:148:14:02:12.050
2025-06-04 10:02:13,614 update_event_model: Updating PassPlan events from 2025:134:13:02:12 to 2025:183:14:02:12
2025-06-04 10:02:14,007 save_event_to_database: Added PassPlan DSS-54 2025:148:20:35:00 05/28/25 04:35:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 10:02:14,008 save_event_to_database: Added PassPlan DSS-65 2025:149:00:10:00 05/28/25 08:10:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 10:02:14,008 save_event_to_database: Added PassPlan DSS-36 2025:149:12:50:00 05/29/25 08:50:00 AM OC:Craig Mahon CC:Ryan Hoover
2025-06-04 10:02:14,008 save_event_to_database: Added PassPlan DSS-54 2025:149:21:10:00 05/29/25 05:10:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 10:02:14,009 save_event_to_database: Added PassPlan DSS-65 2025:149:23:25:00 05/29/25 07:25:00 PM OC:William Rios CC:Kyle Curenton
2025-06-04 10:02:14,010 save_event_to_database: Added PassPlan DSS-26 2025:150:10:45:00 05/30/25 06:45:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 10:02:14,010 save_event_to_database: Added PassPlan DSS-34 2025:150:16:55:00 05/30/25 12:55:00 PM OC:Jay Wellington CC:Julia Zachary
2025-06-04 10:02:14,011 save_event_to_database: Added PassPlan DSS-65 2025:151:00:00:00 05/30/25 08:00:00 PM OC:Jay Wellington CC:Julia Zachary
2025-06-04 10:02:14,011 save_event_to_database: Added PassPlan DSS-24 2025:151:11:55:00 05/31/25 07:55:00 AM OC:Craig Mahon CC:Jay Wellington
2025-06-04 10:02:14,012 save_event_to_database: Added PassPlan DSS-54 2025:151:17:50:00 05/31/25 01:50:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 10:02:14,012 save_event_to_database: Added PassPlan DSS-65 2025:152:01:10:00 05/31/25 09:10:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 10:02:14,013 save_event_to_database: Added PassPlan DSS-24 2025:152:11:45:00 06/01/25 07:45:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 10:02:14,013 save_event_to_database: Added PassPlan DSS-34 2025:152:17:10:00 06/01/25 01:10:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 10:02:14,014 save_event_to_database: Added PassPlan DSS-65 2025:153:00:00:00 06/01/25 08:00:00 PM OC:Jay Wellington CC:Frank Schackart
2025-06-04 10:02:14,014 save_event_to_database: Added PassPlan DSS-26 2025:153:10:35:00 06/02/25 06:35:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 10:02:14,014 save_event_to_database: Added PassPlan DSS-54 2025:153:18:45:00 06/02/25 02:45:00 PM OC:Jay Wellington CC:Jake Aznavorian
2025-06-04 10:02:14,015 save_event_to_database: Added PassPlan DSS-65 2025:154:01:45:00 06/02/25 09:45:00 PM OC:Jay Wellington CC:Jake Aznavorian
2025-06-04 10:02:14,015 save_event_to_database: Added PassPlan DSS-24 2025:154:10:50:00 06/03/25 06:50:00 AM OC:Craig Mahon CC:Ryan Hoover
2025-06-04 10:02:14,016 save_event_to_database: Added PassPlan DSS-65 2025:155:00:00:00 06/03/25 08:00:00 PM OC:Jay Wellington CC:Jake Aznavorian
2025-06-04 10:02:14,016 save_event_to_database: Added PassPlan DSS-26 2025:155:11:05:00 06/04/25 07:05:00 AM OC:Craig Mahon CC:Hannah Gallagher
2025-06-04 10:02:14,017 save_event_to_database: Added PassPlan DSS-24 2025:156:06:10:00 06/05/25 02:10:00 AM OC: CC:
2025-06-04 10:02:14,017 save_event_to_database: Added PassPlan DSS-24 2025:156:11:30:00 06/05/25 07:30:00 AM OC: CC:
2025-06-04 10:02:14,018 save_event_to_database: Added PassPlan DSS-65 2025:157:01:30:00 06/05/25 09:30:00 PM OC: CC:
2025-06-04 10:02:14,018 save_event_to_database: Added PassPlan DSS-26 2025:157:09:35:00 06/06/25 05:35:00 AM OC: CC:
2025-06-04 10:02:14,019 save_event_to_database: Added PassPlan DSS-65 2025:157:19:00:00 06/06/25 03:00:00 PM OC: CC:
2025-06-04 10:02:14,019 save_event_to_database: Added PassPlan DSS-65 2025:158:01:25:00 06/06/25 09:25:00 PM OC: CC:
2025-06-04 10:02:14,020 save_event_to_database: Added PassPlan DSS-24 2025:158:11:20:00 06/07/25 07:20:00 AM OC: CC:
2025-06-04 10:02:14,020 save_event_to_database: Added PassPlan DSS-65 2025:159:01:15:00 06/07/25 09:15:00 PM OC: CC:
2025-06-04 10:02:14,020 save_event_to_database: Added PassPlan DSS-24 2025:159:11:15:00 06/08/25 07:15:00 AM OC: CC:
2025-06-04 10:02:14,021 save_event_to_database: Added PassPlan DSS-54 2025:159:17:05:00 06/08/25 01:05:00 PM OC: CC:
2025-06-04 10:02:14,025 main: Setting TscMove lookback to 7 days
2025-06-04 10:02:14,028 update_event_model: Updating TscMove events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:14,033 get_date_start_stop_for_maude: Using 2025:155:04:55:09.920 as start for TscMove (4 hours before last event)
2025-06-04 10:02:14,091 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for TscMove
2025-06-04 10:02:14,432 save_event_to_database: Added TscMove start=2025:155:12:27:16.321 dur=262 start_3tscpos=-99616.0 stop_3tscpos=91311.0
2025-06-04 10:02:14,435 main: Setting DarkCalReplica lookback to 7 days
2025-06-04 10:02:14,438 update_event_model: Updating DarkCalReplica events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:14,442 get_date_start_stop_for_maude: Using 2025:150:14:02:40.031 as start for DarkCalReplica (4 hours before last event)
2025-06-04 10:02:14,486 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for DarkCalReplica
2025-06-04 10:02:14,758 main: Setting DarkCal lookback to 7 days
2025-06-04 10:02:14,760 update_event_model: Updating DarkCal events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:14,809 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for DarkCal
2025-06-04 10:02:15,103 main: Setting Scs107 lookback to 7 days
2025-06-04 10:02:15,105 update_event_model: Updating Scs107 events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:15,109 get_date_start_stop_for_maude: Using 2025:152:01:51:37.608 as start for Scs107 (4 hours before last event)
2025-06-04 10:02:15,155 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for Scs107
2025-06-04 10:02:16,252 main: Setting FaMove lookback to 7 days
2025-06-04 10:02:16,255 update_event_model: Updating FaMove events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:16,259 get_date_start_stop_for_maude: Using 2025:155:05:00:37.920 as start for FaMove (4 hours before last event)
2025-06-04 10:02:16,310 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for FaMove
2025-06-04 10:02:16,533 main: Setting GratingMove lookback to 7 days
2025-06-04 10:02:16,535 update_event_model: Updating GratingMove events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:16,564 get_date_start_stop_for_maude: Using 2025:155:04:57:34.060 as start for GratingMove (4 hours before last event)
2025-06-04 10:02:16,632 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for GratingMove
2025-06-04 10:02:17,070 save_event_to_database: Added GratingMove start=2025:155:12:26:53.899 dur=165 grating=LETG direction=RETR
2025-06-04 10:02:17,074 main: Setting Dump lookback to 7 days
2025-06-04 10:02:17,076 update_event_model: Updating Dump events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:17,128 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for Dump
2025-06-04 10:02:18,914 main: Setting Eclipse lookback to 7 days
2025-06-04 10:02:18,917 update_event_model: Updating Eclipse events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:18,992 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for Eclipse
2025-06-04 10:02:20,947 main: Setting Manvr lookback to 7 days
2025-06-04 10:02:20,949 update_event_model: Updating Manvr events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:20,955 get_date_start_stop_for_maude: Using 2025:154:20:05:14.674 as start for Manvr (4 hours before last event)
2025-06-04 10:02:21,050 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for Manvr
2025-06-04 10:02:23,013 save_event_to_database: Added Manvr start=2025:155:08:54:07.651 dur=2455 n_dwell=2 template=two_acq
2025-06-04 10:02:23,043 main: Setting SafeSun lookback to 7 days
2025-06-04 10:02:23,045 update_event_model: Updating SafeSun events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:23,222 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for SafeSun
2025-06-04 10:02:26,031 main: Setting NormalSun lookback to 7 days
2025-06-04 10:02:26,033 update_event_model: Updating NormalSun events from 2025:148:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:26,094 get_date_start_stop_for_maude: Using last backorbit date 2025:155:12:40:00.000 as stop for NormalSun
2025-06-04 10:02:27,991 delete_from_date: Deleting 0 MajorEvent events after 2023:156:14:02:12.050
2025-06-04 10:02:27,995 update_event_model: Updating MajorEvent events from 2023:104:04:02:10 to 2025:155:14:02:12
2025-06-04 10:02:28,579 main: ERROR in processing MajorEvent
2025-06-04 10:02:28,582 main: Traceback:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 644, in convert
raise TypeError
TypeError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 601, in main
update_event_model(EventModel, date_stop, opt.maude)
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 216, in update_event_model
events_in_dates = EventModel.get_events(date_start, date_stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/events/models.py", line 2099, in get_events
events = scrape.get_fot_major_events() + scrape.get_fdb_major_events()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/events/scrape.py", line 123, in get_fot_major_events
caldate = start.caldate
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 814, in __getattr__
return convert(self.time_in,
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 647, in convert
return _convert(time_in, sys_in, fmt_in, sys_out, fmt_out)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/chandra_time/Time.py", line 674, in _convert
raise ChandraTimeError("Invalid input format '%s'" % fmt_in)
chandra_time.Time.ChandraTimeError: Invalid input format 'None'

2025-06-04 10:02:28,585 update_event_model: Updating CAP events from 2025:134:13:02:12 to 2025:155:14:02:12
2025-06-04 10:02:29,021 delete_from_date: Deleting 33 LoadSegment events after 2025:135:14:02:12.050
2025-06-04 10:02:29,086 update_event_model: Updating LoadSegment events from 2025:115:13:02:12 to 2025:183:14:02:12
2025-06-04 10:02:29,324 save_event_to_database: Added LoadSegment CL136:1403: 2025:136:14:20:00 MAY1225A scs=131
2025-06-04 10:02:29,324 save_event_to_database: Added LoadSegment CL136:1403: 2025:136:14:20:00 MAY1225A scs=128
2025-06-04 10:02:29,325 save_event_to_database: Added LoadSegment CL138:0403: 2025:138:04:36:27 MAY1225A scs=132
2025-06-04 10:02:29,325 save_event_to_database: Added LoadSegment CL138:0403: 2025:138:04:36:27 MAY1225A scs=129
2025-06-04 10:02:29,325 save_event_to_database: Added LoadSegment CL138:2301: 2025:138:23:57:00 MAY1925A scs=133
2025-06-04 10:02:29,326 save_event_to_database: Added LoadSegment CL138:2301: 2025:138:23:57:00 MAY1925A scs=130
2025-06-04 10:02:29,326 save_event_to_database: Added LoadSegment CL140:1101: 2025:140:11:50:43 MAY1925A scs=131
2025-06-04 10:02:29,327 save_event_to_database: Added LoadSegment CL140:1101: 2025:140:11:50:43 MAY1925A scs=128
2025-06-04 10:02:29,327 save_event_to_database: Added LoadSegment CL142:0001: 2025:142:00:09:49 MAY1925A scs=132
2025-06-04 10:02:29,328 save_event_to_database: Added LoadSegment CL142:0001: 2025:142:00:09:49 MAY1925A scs=129
2025-06-04 10:02:29,328 save_event_to_database: Added LoadSegment CL143:1301: 2025:143:13:00:00 MAY1925A scs=133
2025-06-04 10:02:29,328 save_event_to_database: Added LoadSegment CL143:1301: 2025:143:13:00:00 MAY1925A scs=130
2025-06-04 10:02:29,329 save_event_to_database: Added LoadSegment CL145:0101: 2025:145:01:01:14 MAY1925A scs=131
2025-06-04 10:02:29,329 save_event_to_database: Added LoadSegment CL145:0101: 2025:145:01:01:14 MAY1925A scs=128
2025-06-04 10:02:29,330 save_event_to_database: Added LoadSegment CL146:0103: 2025:146:01:40:21 MAY2625B scs=132
2025-06-04 10:02:29,330 save_event_to_database: Added LoadSegment CL146:0103: 2025:146:01:40:21 MAY2625B scs=129
2025-06-04 10:02:29,330 save_event_to_database: Added LoadSegment CL147:1403: 2025:147:14:16:12 MAY2625B scs=133
2025-06-04 10:02:29,331 save_event_to_database: Added LoadSegment CL147:1403: 2025:147:14:16:12 MAY2625B scs=130
2025-06-04 10:02:29,331 save_event_to_database: Added LoadSegment CL149:0203: 2025:149:02:25:01 MAY2625B scs=131
2025-06-04 10:02:29,332 save_event_to_database: Added LoadSegment CL149:0203: 2025:149:02:25:01 MAY2625B scs=128
2025-06-04 10:02:29,332 save_event_to_database: Added LoadSegment CL150:1603: 2025:150:16:04:26 MAY2625B scs=132
2025-06-04 10:02:29,332 save_event_to_database: Added LoadSegment CL150:1603: 2025:150:16:04:26 MAY2625B scs=129
2025-06-04 10:02:29,333 save_event_to_database: Added LoadSegment CL152:0503: 2025:152:05:04:11 MAY2625B scs=133
2025-06-04 10:02:29,333 save_event_to_database: Added LoadSegment CL152:0503: 2025:152:05:04:11 MAY2625B scs=130
2025-06-04 10:02:29,334 save_event_to_database: Added LoadSegment CL152:2301: 2025:152:23:51:14 JUN0225A scs=128
2025-06-04 10:02:29,334 save_event_to_database: Added LoadSegment CL153:1902: 2025:153:19:52:00 JUN0225B scs=133
2025-06-04 10:02:29,334 save_event_to_database: Added LoadSegment CL153:1902: 2025:153:19:52:00 JUN0225B scs=130
2025-06-04 10:02:29,335 save_event_to_database: Added LoadSegment CL155:0802: 2025:155:08:50:57 JUN0225B scs=131
2025-06-04 10:02:29,335 save_event_to_database: Added LoadSegment CL155:0802: 2025:155:08:50:57 JUN0225B scs=128
2025-06-04 10:02:29,336 save_event_to_database: Added LoadSegment CL156:2102: 2025:156:21:39:43 JUN0225B scs=132
2025-06-04 10:02:29,336 save_event_to_database: Added LoadSegment CL156:2102: 2025:156:21:39:43 JUN0225B scs=129
2025-06-04 10:02:29,336 save_event_to_database: Added LoadSegment CL158:1202: 2025:158:12:05:00 JUN0225B scs=133
2025-06-04 10:02:29,337 save_event_to_database: Added LoadSegment CL158:1202: 2025:158:12:05:00 JUN0225B scs=130
2025-06-04 10:02:29,344 delete_from_date: Deleting 40 DsnComm events after 2025:148:14:02:12.050
2025-06-04 10:02:29,384 update_event_model: Updating DsnComm events from 2025:134:13:02:12 to 2025:183:14:02:12
2025-06-04 10:02:30,078 save_event_to_database: Added DsnComm DSS-54: 2025:148:20:35:00 2120-2220 TKG PASS
2025-06-04 10:02:30,079 save_event_to_database: Added DsnComm DSS-65: 2025:149:00:10:00 0055-0155 TKG PASS
2025-06-04 10:02:30,079 save_event_to_database: Added DsnComm DSS-36: 2025:149:12:50:00 1335-1435 TKG PASS
2025-06-04 10:02:30,080 save_event_to_database: Added DsnComm DSS-54: 2025:149:21:10:00 2145-2230 SHORT TKG N/R
2025-06-04 10:02:30,080 save_event_to_database: Added DsnComm DSS-65: 2025:149:23:25:00 0010-0110 TKG PASS
2025-06-04 10:02:30,081 save_event_to_database: Added DsnComm DSS-26: 2025:150:10:45:00 1130-1230 TKG PASS
2025-06-04 10:02:30,081 save_event_to_database: Added DsnComm DSS-34: 2025:150:16:55:00 1740-1835 SHORT/SRDC
2025-06-04 10:02:30,082 save_event_to_database: Added DsnComm DSS-65: 2025:151:00:00:00 0045-0145 TKG PASS
2025-06-04 10:02:30,082 save_event_to_database: Added DsnComm DSS-24: 2025:151:11:55:00 1240-1340 TKG PASS
2025-06-04 10:02:30,082 save_event_to_database: Added DsnComm DSS-54: 2025:151:17:50:00 1835-1935 TKG PASS
2025-06-04 10:02:30,083 save_event_to_database: Added DsnComm DSS-65: 2025:152:01:10:00 0155-0255 TKG PASS
2025-06-04 10:02:30,083 save_event_to_database: Added DsnComm DSS-24: 2025:152:11:45:00 1230-1330 TKG PASS
2025-06-04 10:02:30,084 save_event_to_database: Added DsnComm DSS-34: 2025:152:17:10:00 1755-1855 TKG PASS
2025-06-04 10:02:30,084 save_event_to_database: Added DsnComm DSS-65: 2025:153:00:00:00 0045-0145 TKG PASS
2025-06-04 10:02:30,085 save_event_to_database: Added DsnComm DSS-26: 2025:153:10:35:00 1120-1220 TKG PASS
2025-06-04 10:02:30,085 save_event_to_database: Added DsnComm DSS-54: 2025:153:18:45:00 1930-2030 TKG PASS
2025-06-04 10:02:30,086 save_event_to_database: Added DsnComm DSS-65: 2025:154:01:45:00 0230-0330 TKG PASS
2025-06-04 10:02:30,086 save_event_to_database: Added DsnComm DSS-24: 2025:154:10:50:00 1135-1235 TKG PASS
2025-06-04 10:02:30,087 save_event_to_database: Added DsnComm DSS-65: 2025:155:00:00:00 0045-0145 TKG PASS
2025-06-04 10:02:30,087 save_event_to_database: Added DsnComm DSS-26: 2025:155:11:05:00 1150-1250 TKG PASS
2025-06-04 10:02:30,088 save_event_to_database: Added DsnComm DSS-24: 2025:156:06:10:00 0645-0730 SHORT TKG N/R
2025-06-04 10:02:30,095 save_event_to_database: Added DsnComm DSS-24: 2025:156:11:30:00 1215-1300 SHORT TKG PASS
2025-06-04 10:02:30,096 save_event_to_database: Added DsnComm DSS-65: 2025:157:01:30:00 0215-0315 TKG PASS
2025-06-04 10:02:30,096 save_event_to_database: Added DsnComm DSS-26: 2025:157:09:35:00 1020-1120 TKG PASS
2025-06-04 10:02:30,096 save_event_to_database: Added DsnComm DSS-65: 2025:157:19:00:00 1945-2045 TKG PASS
2025-06-04 10:02:30,097 save_event_to_database: Added DsnComm DSS-65: 2025:158:01:25:00 0210-0310 TKG PASS
2025-06-04 10:02:30,097 save_event_to_database: Added DsnComm DSS-24: 2025:158:11:20:00 1205-1305 TKG PASS
2025-06-04 10:02:30,098 save_event_to_database: Added DsnComm DSS-65: 2025:159:01:15:00 0200-0300 TKG PASS
2025-06-04 10:02:30,098 save_event_to_database: Added DsnComm DSS-24: 2025:159:11:15:00 1200-1300 TKG PASS
2025-06-04 10:02:30,099 save_event_to_database: Added DsnComm DSS-54: 2025:159:17:05:00 1750-1850 TKG PASS
2025-06-04 10:02:30,099 save_event_to_database: Added DsnComm DSS-65: 2025:160:01:25:00 0210-0310 TKG PASS
2025-06-04 10:02:30,100 save_event_to_database: Added DsnComm DSS-24: 2025:160:11:15:00 1200-1300 TKG PASS
2025-06-04 10:02:30,100 save_event_to_database: Added DsnComm DSS-65: 2025:160:19:05:00 1950-2050 TKG PASS
2025-06-04 10:02:30,101 save_event_to_database: Added DsnComm DSS-65: 2025:161:01:45:00 0230-0330 TKG PASS
2025-06-04 10:02:30,101 save_event_to_database: Added DsnComm DSS-54: 2025:161:13:20:00 1405-1505 TKG PASS
2025-06-04 10:02:30,101 save_event_to_database: Added DsnComm DSS-65: 2025:161:18:05:00 1850-1950 TKG PASS
2025-06-04 10:02:30,102 save_event_to_database: Added DsnComm DSS-56: 2025:161:22:55:00 2340-0040 RTS DEMO
2025-06-04 10:02:30,102 save_event_to_database: Added DsnComm DSS-24: 2025:162:01:35:00 0220-0320 TKG PASS
2025-06-04 10:02:30,103 save_event_to_database: Added DsnComm DSS-24: 2025:162:08:00:00 0835-0855 SHORT TKG N/R
2025-06-04 10:02:30,103 save_event_to_database: Added DsnComm DSS-65: 2025:162:19:50:00 2025-2050 SHORT TKG N/R
2025-06-04 10:02:30,104 save_event_to_database: Added DsnComm DSS-65: 2025:163:03:10:00 0355-0525 TKG PASS
2025-06-04 10:02:30,104 save_event_to_database: Added DsnComm DSS-65: 2025:163:21:15:00 2200-2330 TKG PASS
2025-06-04 10:02:30,104 save_event_to_database: Added DsnComm DSS-26: 2025:164:09:55:00 1030-1115 TKG N/R
2025-06-04 10:02:30,105 save_event_to_database: Added DsnComm DSS-54: 2025:164:20:20:00 2105-2155 SHORT TKG PASS
2025-06-04 10:02:30,105 save_event_to_database: Added DsnComm DSS-24: 2025:165:01:45:00 0230-0330 TKG PASS
2025-06-04 10:02:30,106 save_event_to_database: Added DsnComm DSS-24: 2025:165:12:30:00 1315-1415 TKG PASS
2025-06-04 10:02:30,106 save_event_to_database: Added DsnComm DSS-54: 2025:165:17:50:00 1835-1935 TKG PASS
2025-06-04 10:02:30,107 save_event_to_database: Added DsnComm DSS-54: 2025:166:02:10:00 0255-0350 SHORT TKG PASS
2025-06-04 10:02:30,107 save_event_to_database: Added DsnComm DSS-26: 2025:166:12:30:00 1315-1415 TKG PASS
2025-06-04 10:02:30,108 save_event_to_database: Added DsnComm DSS-65: 2025:166:21:40:00 2225-2325 TKG PASS
2025-06-04 10:02:30,108 save_event_to_database: Added DsnComm DSS-65: 2025:167:01:15:00 0200-0300 TKG PASS
2025-06-04 10:02:30,108 save_event_to_database: Added DsnComm DSS-65: 2025:167:17:40:00 1825-1925 TKG PASS
2025-06-04 10:02:30,109 save_event_to_database: Added DsnComm DSS-26: 2025:168:01:05:00 0150-0250 TKG PASS
2025-06-04 10:02:30,109 save_event_to_database: Added DsnComm DSS-24: 2025:168:10:40:00 1125-1225 TKG PASS
2025-06-04 10:02:30,110 save_event_to_database: Added DsnComm DSS-36: 2025:168:16:25:00 1710-1800 SHORT TKG PASS
2025-06-04 10:02:30,110 save_event_to_database: Added DsnComm DSS-65: 2025:168:23:45:00 0030-0130 TKG PASS
2025-06-04 10:02:30,111 save_event_to_database: Added DsnComm DSS-54: 2025:169:11:50:00 1225-1255 SHORT TKG N/R
2025-06-04 10:02:30,111 save_event_to_database: Added DsnComm DSS-65: 2025:169:23:00:00 2335-0025 SHORT TKG N/R
2025-06-04 10:02:30,111 save_event_to_database: Added DsnComm DSS-54: 2025:170:02:10:00 0255-0350 SHORT TKG PASS
2025-06-04 10:02:30,112 save_event_to_database: Added DsnComm DSS-24: 2025:170:12:40:00 1325-1425 TKG PASS
2025-06-04 10:02:30,112 save_event_to_database: Added DsnComm DSS-65: 2025:170:22:15:00 2300-0000 TKG PASS
2025-06-04 10:02:30,113 save_event_to_database: Added DsnComm DSS-26: 2025:171:01:45:00 0230-0330 TKG PASS
2025-06-04 10:02:30,113 save_event_to_database: Added DsnComm DSS-26: 2025:171:09:30:00 1015-1115 TKG PASS
2025-06-04 10:02:30,114 save_event_to_database: Added DsnComm DSS-34: 2025:171:14:20:00 1505-1605 TKG PASS
2025-06-04 10:02:30,114 save_event_to_database: Added DsnComm DSS-36: 2025:172:00:45:00 0130-0215 SHORT TKG PASS
2025-06-04 10:02:30,114 save_event_to_database: Added DsnComm DSS-24: 2025:172:10:25:00 1110-1210 TKG PASS
2025-06-04 10:02:30,115 save_event_to_database: Added DsnComm DSS-65: 2025:172:15:45:00 1630-1730 TKG PASS
2025-06-04 10:02:30,115 save_event_to_database: Added DsnComm DSS-65: 2025:172:23:45:00 0030-0130 TKG PASS
2025-06-04 10:02:30,116 save_event_to_database: Added DsnComm DSS-26: 2025:173:09:30:00 1015-1115 TKG PASS
2025-06-04 10:02:30,116 save_event_to_database: Added DsnComm DSS-65: 2025:173:19:00:00 1945-2045 TKG PASS
2025-06-04 10:02:30,123 update_event_model: Updating Orbit events from 2025:134:13:02:12 to 2025:183:14:02:12
2025-06-04 10:02:30,858 update_event_model: Updating LttBad events from 2025:134:13:02:12 to 2025:155:14:02:12
2025-06-04 11:02:09,425 log_run_info: ******************************************
2025-06-04 11:02:09,425 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 11:02:09,425 log_run_info: Version: 7.16.0
2025-06-04 11:02:09,425 log_run_info: Time: Wed Jun 4 11:02:09 2025
2025-06-04 11:02:09,425 log_run_info: User: aldcroft
2025-06-04 11:02:09,425 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 11:02:09,425 log_run_info: Processing args:
2025-06-04 11:02:09,425 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 11:02:09,425 log_run_info: 'delete_from_start': False,
2025-06-04 11:02:09,425 log_run_info: 'log_level': 'INFO',
2025-06-04 11:02:09,425 log_run_info: 'loop_days': 100,
2025-06-04 11:02:09,425 log_run_info: 'maude': True,
2025-06-04 11:02:09,425 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 11:02:09,425 log_run_info: 'models': None,
2025-06-04 11:02:09,425 log_run_info: 'start': None,
2025-06-04 11:02:09,425 log_run_info: 'stop': '2025:155:15:02:09.387'}
2025-06-04 11:02:09,425 log_run_info: ******************************************
2025-06-04 11:02:09,428 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 11:02:09,428 main:
2025-06-04 11:02:12,383 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 11:02:12,383 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 12:02:10,149 log_run_info: ******************************************
2025-06-04 12:02:10,150 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 12:02:10,150 log_run_info: Version: 7.16.0
2025-06-04 12:02:10,150 log_run_info: Time: Wed Jun 4 12:02:10 2025
2025-06-04 12:02:10,150 log_run_info: User: aldcroft
2025-06-04 12:02:10,150 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 12:02:10,150 log_run_info: Processing args:
2025-06-04 12:02:10,150 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 12:02:10,150 log_run_info: 'delete_from_start': False,
2025-06-04 12:02:10,150 log_run_info: 'log_level': 'INFO',
2025-06-04 12:02:10,150 log_run_info: 'loop_days': 100,
2025-06-04 12:02:10,150 log_run_info: 'maude': True,
2025-06-04 12:02:10,150 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 12:02:10,150 log_run_info: 'models': None,
2025-06-04 12:02:10,150 log_run_info: 'start': None,
2025-06-04 12:02:10,150 log_run_info: 'stop': '2025:155:16:02:10.110'}
2025-06-04 12:02:10,150 log_run_info: ******************************************
2025-06-04 12:02:10,152 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 12:02:10,152 main:
2025-06-04 12:02:12,550 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 12:02:12,550 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 13:02:09,485 log_run_info: ******************************************
2025-06-04 13:02:09,485 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 13:02:09,485 log_run_info: Version: 7.16.0
2025-06-04 13:02:09,485 log_run_info: Time: Wed Jun 4 13:02:09 2025
2025-06-04 13:02:09,485 log_run_info: User: aldcroft
2025-06-04 13:02:09,485 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 13:02:09,485 log_run_info: Processing args:
2025-06-04 13:02:09,485 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 13:02:09,485 log_run_info: 'delete_from_start': False,
2025-06-04 13:02:09,485 log_run_info: 'log_level': 'INFO',
2025-06-04 13:02:09,485 log_run_info: 'loop_days': 100,
2025-06-04 13:02:09,485 log_run_info: 'maude': True,
2025-06-04 13:02:09,485 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 13:02:09,485 log_run_info: 'models': None,
2025-06-04 13:02:09,485 log_run_info: 'start': None,
2025-06-04 13:02:09,485 log_run_info: 'stop': '2025:155:17:02:09.453'}
2025-06-04 13:02:09,485 log_run_info: ******************************************
2025-06-04 13:02:09,487 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 13:02:09,487 main:
2025-06-04 13:02:11,856 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 13:02:11,857 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 14:02:10,319 log_run_info: ******************************************
2025-06-04 14:02:10,319 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 14:02:10,319 log_run_info: Version: 7.16.0
2025-06-04 14:02:10,319 log_run_info: Time: Wed Jun 4 14:02:10 2025
2025-06-04 14:02:10,319 log_run_info: User: aldcroft
2025-06-04 14:02:10,319 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 14:02:10,319 log_run_info: Processing args:
2025-06-04 14:02:10,319 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 14:02:10,319 log_run_info: 'delete_from_start': False,
2025-06-04 14:02:10,319 log_run_info: 'log_level': 'INFO',
2025-06-04 14:02:10,319 log_run_info: 'loop_days': 100,
2025-06-04 14:02:10,319 log_run_info: 'maude': True,
2025-06-04 14:02:10,319 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 14:02:10,319 log_run_info: 'models': None,
2025-06-04 14:02:10,319 log_run_info: 'start': None,
2025-06-04 14:02:10,319 log_run_info: 'stop': '2025:155:18:02:10.276'}
2025-06-04 14:02:10,319 log_run_info: ******************************************
2025-06-04 14:02:10,322 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 14:02:10,323 main:
2025-06-04 14:02:13,445 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 14:02:13,445 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 15:02:09,346 log_run_info: ******************************************
2025-06-04 15:02:09,346 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 15:02:09,346 log_run_info: Version: 7.16.0
2025-06-04 15:02:09,346 log_run_info: Time: Wed Jun 4 15:02:09 2025
2025-06-04 15:02:09,346 log_run_info: User: aldcroft
2025-06-04 15:02:09,346 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 15:02:09,346 log_run_info: Processing args:
2025-06-04 15:02:09,346 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 15:02:09,346 log_run_info: 'delete_from_start': False,
2025-06-04 15:02:09,346 log_run_info: 'log_level': 'INFO',
2025-06-04 15:02:09,346 log_run_info: 'loop_days': 100,
2025-06-04 15:02:09,346 log_run_info: 'maude': True,
2025-06-04 15:02:09,346 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 15:02:09,346 log_run_info: 'models': None,
2025-06-04 15:02:09,346 log_run_info: 'start': None,
2025-06-04 15:02:09,346 log_run_info: 'stop': '2025:155:19:02:09.302'}
2025-06-04 15:02:09,346 log_run_info: ******************************************
2025-06-04 15:02:09,351 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 15:02:09,351 main:
2025-06-04 15:02:12,092 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 15:02:12,092 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 16:02:10,016 log_run_info: ******************************************
2025-06-04 16:02:10,016 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 16:02:10,016 log_run_info: Version: 7.16.0
2025-06-04 16:02:10,016 log_run_info: Time: Wed Jun 4 16:02:10 2025
2025-06-04 16:02:10,016 log_run_info: User: aldcroft
2025-06-04 16:02:10,016 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 16:02:10,016 log_run_info: Processing args:
2025-06-04 16:02:10,016 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 16:02:10,016 log_run_info: 'delete_from_start': False,
2025-06-04 16:02:10,016 log_run_info: 'log_level': 'INFO',
2025-06-04 16:02:10,016 log_run_info: 'loop_days': 100,
2025-06-04 16:02:10,016 log_run_info: 'maude': True,
2025-06-04 16:02:10,016 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 16:02:10,016 log_run_info: 'models': None,
2025-06-04 16:02:10,016 log_run_info: 'start': None,
2025-06-04 16:02:10,016 log_run_info: 'stop': '2025:155:20:02:09.979'}
2025-06-04 16:02:10,016 log_run_info: ******************************************
2025-06-04 16:02:10,019 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 16:02:10,019 main:
2025-06-04 16:02:12,994 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 16:02:12,994 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 17:02:09,232 log_run_info: ******************************************
2025-06-04 17:02:09,232 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 17:02:09,232 log_run_info: Version: 7.16.0
2025-06-04 17:02:09,232 log_run_info: Time: Wed Jun 4 17:02:09 2025
2025-06-04 17:02:09,233 log_run_info: User: aldcroft
2025-06-04 17:02:09,233 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 17:02:09,233 log_run_info: Processing args:
2025-06-04 17:02:09,233 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 17:02:09,233 log_run_info: 'delete_from_start': False,
2025-06-04 17:02:09,233 log_run_info: 'log_level': 'INFO',
2025-06-04 17:02:09,233 log_run_info: 'loop_days': 100,
2025-06-04 17:02:09,233 log_run_info: 'maude': True,
2025-06-04 17:02:09,233 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 17:02:09,233 log_run_info: 'models': None,
2025-06-04 17:02:09,233 log_run_info: 'start': None,
2025-06-04 17:02:09,233 log_run_info: 'stop': '2025:155:21:02:09.181'}
2025-06-04 17:02:09,233 log_run_info: ******************************************
2025-06-04 17:02:09,238 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 17:02:09,238 main:
2025-06-04 17:02:11,069 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 17:02:11,069 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 18:02:08,755 log_run_info: ******************************************
2025-06-04 18:02:08,755 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 18:02:08,755 log_run_info: Version: 7.16.0
2025-06-04 18:02:08,755 log_run_info: Time: Wed Jun 4 18:02:08 2025
2025-06-04 18:02:08,755 log_run_info: User: aldcroft
2025-06-04 18:02:08,755 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 18:02:08,756 log_run_info: Processing args:
2025-06-04 18:02:08,756 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 18:02:08,756 log_run_info: 'delete_from_start': False,
2025-06-04 18:02:08,756 log_run_info: 'log_level': 'INFO',
2025-06-04 18:02:08,756 log_run_info: 'loop_days': 100,
2025-06-04 18:02:08,756 log_run_info: 'maude': True,
2025-06-04 18:02:08,756 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 18:02:08,756 log_run_info: 'models': None,
2025-06-04 18:02:08,756 log_run_info: 'start': None,
2025-06-04 18:02:08,756 log_run_info: 'stop': '2025:155:22:02:08.725'}
2025-06-04 18:02:08,756 log_run_info: ******************************************
2025-06-04 18:02:08,759 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 18:02:08,759 main:
2025-06-04 18:02:10,756 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 18:02:10,756 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 19:02:08,980 log_run_info: ******************************************
2025-06-04 19:02:08,980 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 19:02:08,980 log_run_info: Version: 7.16.0
2025-06-04 19:02:08,980 log_run_info: Time: Wed Jun 4 19:02:08 2025
2025-06-04 19:02:08,980 log_run_info: User: aldcroft
2025-06-04 19:02:08,980 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 19:02:08,980 log_run_info: Processing args:
2025-06-04 19:02:08,980 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 19:02:08,980 log_run_info: 'delete_from_start': False,
2025-06-04 19:02:08,980 log_run_info: 'log_level': 'INFO',
2025-06-04 19:02:08,980 log_run_info: 'loop_days': 100,
2025-06-04 19:02:08,980 log_run_info: 'maude': True,
2025-06-04 19:02:08,980 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 19:02:08,980 log_run_info: 'models': None,
2025-06-04 19:02:08,980 log_run_info: 'start': None,
2025-06-04 19:02:08,980 log_run_info: 'stop': '2025:155:23:02:08.942'}
2025-06-04 19:02:08,980 log_run_info: ******************************************
2025-06-04 19:02:08,982 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 19:02:08,983 main:
2025-06-04 19:02:12,264 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 19:02:12,264 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 20:02:09,173 log_run_info: ******************************************
2025-06-04 20:02:09,173 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 20:02:09,173 log_run_info: Version: 7.16.0
2025-06-04 20:02:09,173 log_run_info: Time: Wed Jun 4 20:02:09 2025
2025-06-04 20:02:09,173 log_run_info: User: aldcroft
2025-06-04 20:02:09,173 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 20:02:09,173 log_run_info: Processing args:
2025-06-04 20:02:09,173 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 20:02:09,173 log_run_info: 'delete_from_start': False,
2025-06-04 20:02:09,173 log_run_info: 'log_level': 'INFO',
2025-06-04 20:02:09,173 log_run_info: 'loop_days': 100,
2025-06-04 20:02:09,173 log_run_info: 'maude': True,
2025-06-04 20:02:09,173 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 20:02:09,173 log_run_info: 'models': None,
2025-06-04 20:02:09,173 log_run_info: 'start': None,
2025-06-04 20:02:09,173 log_run_info: 'stop': '2025:156:00:02:09.144'}
2025-06-04 20:02:09,173 log_run_info: ******************************************
2025-06-04 20:02:09,174 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 20:02:09,174 main:
2025-06-04 20:02:11,795 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 20:02:11,796 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 21:02:10,506 log_run_info: ******************************************
2025-06-04 21:02:10,506 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 21:02:10,506 log_run_info: Version: 7.16.0
2025-06-04 21:02:10,506 log_run_info: Time: Wed Jun 4 21:02:10 2025
2025-06-04 21:02:10,506 log_run_info: User: aldcroft
2025-06-04 21:02:10,506 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 21:02:10,506 log_run_info: Processing args:
2025-06-04 21:02:10,506 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 21:02:10,506 log_run_info: 'delete_from_start': False,
2025-06-04 21:02:10,506 log_run_info: 'log_level': 'INFO',
2025-06-04 21:02:10,506 log_run_info: 'loop_days': 100,
2025-06-04 21:02:10,506 log_run_info: 'maude': True,
2025-06-04 21:02:10,506 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 21:02:10,506 log_run_info: 'models': None,
2025-06-04 21:02:10,506 log_run_info: 'start': None,
2025-06-04 21:02:10,506 log_run_info: 'stop': '2025:156:01:02:10.466'}
2025-06-04 21:02:10,506 log_run_info: ******************************************
2025-06-04 21:02:10,509 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 21:02:10,509 main:
2025-06-04 21:02:13,281 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 21:02:13,281 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 22:02:09,482 log_run_info: ******************************************
2025-06-04 22:02:09,482 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 22:02:09,482 log_run_info: Version: 7.16.0
2025-06-04 22:02:09,482 log_run_info: Time: Wed Jun 4 22:02:09 2025
2025-06-04 22:02:09,482 log_run_info: User: aldcroft
2025-06-04 22:02:09,482 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 22:02:09,482 log_run_info: Processing args:
2025-06-04 22:02:09,482 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 22:02:09,482 log_run_info: 'delete_from_start': False,
2025-06-04 22:02:09,482 log_run_info: 'log_level': 'INFO',
2025-06-04 22:02:09,482 log_run_info: 'loop_days': 100,
2025-06-04 22:02:09,482 log_run_info: 'maude': True,
2025-06-04 22:02:09,482 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 22:02:09,482 log_run_info: 'models': None,
2025-06-04 22:02:09,482 log_run_info: 'start': None,
2025-06-04 22:02:09,482 log_run_info: 'stop': '2025:156:02:02:09.449'}
2025-06-04 22:02:09,482 log_run_info: ******************************************
2025-06-04 22:02:09,483 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 22:02:09,483 main:
2025-06-04 22:02:12,577 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 22:02:12,577 main: No new telemetry in MAUDE, skipping event updates
2025-06-04 23:02:09,269 log_run_info: ******************************************
2025-06-04 23:02:09,269 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-04 23:02:09,269 log_run_info: Version: 7.16.0
2025-06-04 23:02:09,269 log_run_info: Time: Wed Jun 4 23:02:09 2025
2025-06-04 23:02:09,269 log_run_info: User: aldcroft
2025-06-04 23:02:09,269 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-04 23:02:09,269 log_run_info: Processing args:
2025-06-04 23:02:09,269 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-04 23:02:09,269 log_run_info: 'delete_from_start': False,
2025-06-04 23:02:09,269 log_run_info: 'log_level': 'INFO',
2025-06-04 23:02:09,269 log_run_info: 'loop_days': 100,
2025-06-04 23:02:09,269 log_run_info: 'maude': True,
2025-06-04 23:02:09,269 log_run_info: 'maude_tlm_lookback': 7,
2025-06-04 23:02:09,269 log_run_info: 'models': None,
2025-06-04 23:02:09,269 log_run_info: 'start': None,
2025-06-04 23:02:09,269 log_run_info: 'stop': '2025:156:03:02:09.228'}
2025-06-04 23:02:09,270 log_run_info: ******************************************
2025-06-04 23:02:09,271 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-04 23:02:09,271 main:
2025-06-04 23:02:12,902 check_maude_server_has_new_telemetry: No new telemetry in MAUDE: update_model.date='2025:155:12:40:00.000' -> date_last_telemetry='2025:155:12:40:00.000'
2025-06-04 23:02:12,902 main: No new telemetry in MAUDE, skipping event updates
2025-06-05 00:02:06,362 log_run_info: ******************************************
2025-06-05 00:02:06,362 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 00:02:06,362 log_run_info: Version: 7.16.0
2025-06-05 00:02:06,362 log_run_info: Time: Thu Jun 5 00:02:06 2025
2025-06-05 00:02:06,362 log_run_info: User: aldcroft
2025-06-05 00:02:06,362 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 00:02:06,362 log_run_info: Processing args:
2025-06-05 00:02:06,362 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 00:02:06,362 log_run_info: 'delete_from_start': False,
2025-06-05 00:02:06,362 log_run_info: 'log_level': 'INFO',
2025-06-05 00:02:06,362 log_run_info: 'loop_days': 100,
2025-06-05 00:02:06,362 log_run_info: 'maude': True,
2025-06-05 00:02:06,362 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 00:02:06,362 log_run_info: 'models': None,
2025-06-05 00:02:06,362 log_run_info: 'start': None,
2025-06-05 00:02:06,362 log_run_info: 'stop': '2025:156:04:02:06.333'}
2025-06-05 00:02:06,362 log_run_info: ******************************************
2025-06-05 00:02:06,363 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 00:02:06,363 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 01:02:05,611 log_run_info: ******************************************
2025-06-05 01:02:05,611 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 01:02:05,611 log_run_info: Version: 7.16.0
2025-06-05 01:02:05,611 log_run_info: Time: Thu Jun 5 01:02:05 2025
2025-06-05 01:02:05,611 log_run_info: User: aldcroft
2025-06-05 01:02:05,611 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 01:02:05,611 log_run_info: Processing args:
2025-06-05 01:02:05,611 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 01:02:05,611 log_run_info: 'delete_from_start': False,
2025-06-05 01:02:05,611 log_run_info: 'log_level': 'INFO',
2025-06-05 01:02:05,611 log_run_info: 'loop_days': 100,
2025-06-05 01:02:05,611 log_run_info: 'maude': True,
2025-06-05 01:02:05,611 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 01:02:05,611 log_run_info: 'models': None,
2025-06-05 01:02:05,611 log_run_info: 'start': None,
2025-06-05 01:02:05,611 log_run_info: 'stop': '2025:156:05:02:05.582'}
2025-06-05 01:02:05,611 log_run_info: ******************************************
2025-06-05 01:02:05,612 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 01:02:05,612 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 02:02:07,222 log_run_info: ******************************************
2025-06-05 02:02:07,222 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 02:02:07,222 log_run_info: Version: 7.16.0
2025-06-05 02:02:07,222 log_run_info: Time: Thu Jun 5 02:02:07 2025
2025-06-05 02:02:07,222 log_run_info: User: aldcroft
2025-06-05 02:02:07,222 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 02:02:07,222 log_run_info: Processing args:
2025-06-05 02:02:07,222 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 02:02:07,222 log_run_info: 'delete_from_start': False,
2025-06-05 02:02:07,222 log_run_info: 'log_level': 'INFO',
2025-06-05 02:02:07,222 log_run_info: 'loop_days': 100,
2025-06-05 02:02:07,222 log_run_info: 'maude': True,
2025-06-05 02:02:07,222 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 02:02:07,222 log_run_info: 'models': None,
2025-06-05 02:02:07,222 log_run_info: 'start': None,
2025-06-05 02:02:07,222 log_run_info: 'stop': '2025:156:06:02:07.193'}
2025-06-05 02:02:07,223 log_run_info: ******************************************
2025-06-05 02:02:07,223 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 02:02:07,224 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 03:02:05,437 log_run_info: ******************************************
2025-06-05 03:02:05,437 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 03:02:05,437 log_run_info: Version: 7.16.0
2025-06-05 03:02:05,438 log_run_info: Time: Thu Jun 5 03:02:05 2025
2025-06-05 03:02:05,438 log_run_info: User: aldcroft
2025-06-05 03:02:05,438 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 03:02:05,438 log_run_info: Processing args:
2025-06-05 03:02:05,438 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 03:02:05,438 log_run_info: 'delete_from_start': False,
2025-06-05 03:02:05,438 log_run_info: 'log_level': 'INFO',
2025-06-05 03:02:05,438 log_run_info: 'loop_days': 100,
2025-06-05 03:02:05,438 log_run_info: 'maude': True,
2025-06-05 03:02:05,438 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 03:02:05,438 log_run_info: 'models': None,
2025-06-05 03:02:05,438 log_run_info: 'start': None,
2025-06-05 03:02:05,438 log_run_info: 'stop': '2025:156:07:02:05.410'}
2025-06-05 03:02:05,438 log_run_info: ******************************************
2025-06-05 03:02:05,439 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 03:02:05,439 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 04:02:06,575 log_run_info: ******************************************
2025-06-05 04:02:06,575 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 04:02:06,575 log_run_info: Version: 7.16.0
2025-06-05 04:02:06,575 log_run_info: Time: Thu Jun 5 04:02:06 2025
2025-06-05 04:02:06,575 log_run_info: User: aldcroft
2025-06-05 04:02:06,575 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 04:02:06,575 log_run_info: Processing args:
2025-06-05 04:02:06,575 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 04:02:06,575 log_run_info: 'delete_from_start': False,
2025-06-05 04:02:06,575 log_run_info: 'log_level': 'INFO',
2025-06-05 04:02:06,575 log_run_info: 'loop_days': 100,
2025-06-05 04:02:06,575 log_run_info: 'maude': True,
2025-06-05 04:02:06,575 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 04:02:06,575 log_run_info: 'models': None,
2025-06-05 04:02:06,575 log_run_info: 'start': None,
2025-06-05 04:02:06,575 log_run_info: 'stop': '2025:156:08:02:06.546'}
2025-06-05 04:02:06,575 log_run_info: ******************************************
2025-06-05 04:02:06,576 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 04:02:06,576 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 05:02:05,145 log_run_info: ******************************************
2025-06-05 05:02:05,146 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 05:02:05,146 log_run_info: Version: 7.16.0
2025-06-05 05:02:05,146 log_run_info: Time: Thu Jun 5 05:02:05 2025
2025-06-05 05:02:05,146 log_run_info: User: aldcroft
2025-06-05 05:02:05,146 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 05:02:05,146 log_run_info: Processing args:
2025-06-05 05:02:05,146 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 05:02:05,146 log_run_info: 'delete_from_start': False,
2025-06-05 05:02:05,146 log_run_info: 'log_level': 'INFO',
2025-06-05 05:02:05,146 log_run_info: 'loop_days': 100,
2025-06-05 05:02:05,146 log_run_info: 'maude': True,
2025-06-05 05:02:05,146 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 05:02:05,146 log_run_info: 'models': None,
2025-06-05 05:02:05,146 log_run_info: 'start': None,
2025-06-05 05:02:05,146 log_run_info: 'stop': '2025:156:09:02:05.118'}
2025-06-05 05:02:05,146 log_run_info: ******************************************
2025-06-05 05:02:05,146 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 05:02:05,147 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 06:02:05,494 log_run_info: ******************************************
2025-06-05 06:02:05,494 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 06:02:05,494 log_run_info: Version: 7.16.0
2025-06-05 06:02:05,494 log_run_info: Time: Thu Jun 5 06:02:05 2025
2025-06-05 06:02:05,494 log_run_info: User: aldcroft
2025-06-05 06:02:05,494 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 06:02:05,494 log_run_info: Processing args:
2025-06-05 06:02:05,494 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 06:02:05,494 log_run_info: 'delete_from_start': False,
2025-06-05 06:02:05,494 log_run_info: 'log_level': 'INFO',
2025-06-05 06:02:05,494 log_run_info: 'loop_days': 100,
2025-06-05 06:02:05,494 log_run_info: 'maude': True,
2025-06-05 06:02:05,494 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 06:02:05,494 log_run_info: 'models': None,
2025-06-05 06:02:05,494 log_run_info: 'start': None,
2025-06-05 06:02:05,494 log_run_info: 'stop': '2025:156:10:02:05.466'}
2025-06-05 06:02:05,494 log_run_info: ******************************************
2025-06-05 06:02:05,495 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 06:02:05,495 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 07:02:04,726 log_run_info: ******************************************
2025-06-05 07:02:04,726 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 07:02:04,726 log_run_info: Version: 7.16.0
2025-06-05 07:02:04,726 log_run_info: Time: Thu Jun 5 07:02:04 2025
2025-06-05 07:02:04,726 log_run_info: User: aldcroft
2025-06-05 07:02:04,726 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 07:02:04,726 log_run_info: Processing args:
2025-06-05 07:02:04,726 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 07:02:04,726 log_run_info: 'delete_from_start': False,
2025-06-05 07:02:04,726 log_run_info: 'log_level': 'INFO',
2025-06-05 07:02:04,726 log_run_info: 'loop_days': 100,
2025-06-05 07:02:04,726 log_run_info: 'maude': True,
2025-06-05 07:02:04,726 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 07:02:04,726 log_run_info: 'models': None,
2025-06-05 07:02:04,726 log_run_info: 'start': None,
2025-06-05 07:02:04,726 log_run_info: 'stop': '2025:156:11:02:04.698'}
2025-06-05 07:02:04,726 log_run_info: ******************************************
2025-06-05 07:02:04,727 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 07:02:04,727 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))
2025-06-05 08:02:07,409 log_run_info: ******************************************
2025-06-05 08:02:07,409 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py
2025-06-05 08:02:07,409 log_run_info: Version: 7.16.0
2025-06-05 08:02:07,409 log_run_info: Time: Thu Jun 5 08:02:07 2025
2025-06-05 08:02:07,409 log_run_info: User: aldcroft
2025-06-05 08:02:07,409 log_run_info: Machine: kady.cfa.harvard.edu
2025-06-05 08:02:07,410 log_run_info: Processing args:
2025-06-05 08:02:07,410 log_run_info: {'data_root': '/proj/sot/ska3/flight/data/kadi/update_events',
2025-06-05 08:02:07,410 log_run_info: 'delete_from_start': False,
2025-06-05 08:02:07,410 log_run_info: 'log_level': 'INFO',
2025-06-05 08:02:07,410 log_run_info: 'loop_days': 100,
2025-06-05 08:02:07,410 log_run_info: 'maude': True,
2025-06-05 08:02:07,410 log_run_info: 'maude_tlm_lookback': 7,
2025-06-05 08:02:07,410 log_run_info: 'models': None,
2025-06-05 08:02:07,410 log_run_info: 'start': None,
2025-06-05 08:02:07,410 log_run_info: 'stop': '2025:156:12:02:07.382'}
2025-06-05 08:02:07,410 log_run_info: ******************************************
2025-06-05 08:02:07,414 main: Event database : /proj/sot/ska3/flight/data/kadi/update_events/events3.db3
2025-06-05 08:02:07,414 main:
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 199, in __getitem__
return super().__getitem__(item)
^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'version'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 445, in request
self.endheaders()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1331, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1091, in _send_output
self.send(msg)
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1035, in send
self.connect()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 276, in connect
self.sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kadi_update_events", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 539, in main
and not check_maude_server_has_new_telemetry(opt.stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/scripts/update_events.py", line 482, in check_maude_server_has_new_telemetry
date_last_telemetry = maude.get_last_backorbit_date(msids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 1269, in get_last_backorbit_date
dat = get_msids(msids_5min)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 707, in get_msids
if msid.upper() not in MSIDS:
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 127, in load_msids
msids = {msid: index for index, msid in MSID_FROM_INDEX.items()}
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 87, in wrapper
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 114, in load_msid_index
with open(get_data_filename("MSIDIDX", "txt"), "r") as fh:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 89, in get_data_filename
version = MAUDE_SYSINFO["version"]
~~~~~~~~~~~~~^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 201, in __getitem__
self._load()
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/ska_helpers/utils.py", line 189, in _load
self.update(self._load_func(*self._args, **self._kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 151, in get_maude_sysinfo
r = get_request(url, user, password)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 516, in get_request
req = func(url, user, password, gzip=gzip, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/maude/maude.py", line 525, in _get_request
req = requests.get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='telemetry.cfa.harvard.edu', port=80): Max retries exceeded with url: /maude/mrest/sysinfo.json (Caused by ConnectTimeoutError(, 'Connection to telemetry.cfa.harvard.edu timed out. (connect timeout=None)'))