Prev Index Next

arc: Fri Apr 18 05:25:27 2025

File: /proj/sot/ska/data/arc/Logs/daily.0/arc.log

Task	Status	Age	MaxAge	Last Date
arc	NOT OK	0.22	2.0	Fri Apr 18 05:25:27 2025

Errors:

Line 0: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:06:00 2025
Line 18: <<2025-Apr-17 06:08>> TimeoutError: timed out
Line 36: <<2025-Apr-17 06:08>> raise ConnectTimeoutError(
Line 37: <<2025-Apr-17 06:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 49: <<2025-Apr-17 06:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 51: <<2025-Apr-17 06:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 93: <<2025-Apr-17 06:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 94: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:16:00 2025
Line 112: <<2025-Apr-17 06:18>> TimeoutError: timed out
Line 130: <<2025-Apr-17 06:18>> raise ConnectTimeoutError(
Line 131: <<2025-Apr-17 06:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 143: <<2025-Apr-17 06:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 145: <<2025-Apr-17 06:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 187: <<2025-Apr-17 06:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 188: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:26:00 2025
Line 206: <<2025-Apr-17 06:28>> TimeoutError: timed out
Line 224: <<2025-Apr-17 06:28>> raise ConnectTimeoutError(
Line 225: <<2025-Apr-17 06:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 237: <<2025-Apr-17 06:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 239: <<2025-Apr-17 06:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 281: <<2025-Apr-17 06:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 282: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:36:00 2025
Line 300: <<2025-Apr-17 06:38>> TimeoutError: timed out
Line 318: <<2025-Apr-17 06:38>> raise ConnectTimeoutError(
Line 319: <<2025-Apr-17 06:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 331: <<2025-Apr-17 06:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 333: <<2025-Apr-17 06:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 375: <<2025-Apr-17 06:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 376: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:46:00 2025
Line 394: <<2025-Apr-17 06:48>> TimeoutError: timed out
Line 412: <<2025-Apr-17 06:48>> raise ConnectTimeoutError(
Line 413: <<2025-Apr-17 06:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 425: <<2025-Apr-17 06:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 427: <<2025-Apr-17 06:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 469: <<2025-Apr-17 06:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 470: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:56:00 2025
Line 488: <<2025-Apr-17 06:58>> TimeoutError: timed out
Line 506: <<2025-Apr-17 06:58>> raise ConnectTimeoutError(
Line 507: <<2025-Apr-17 06:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 519: <<2025-Apr-17 06:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 521: <<2025-Apr-17 06:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 563: <<2025-Apr-17 06:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 564: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:06:00 2025
Line 582: <<2025-Apr-17 07:08>> TimeoutError: timed out
Line 600: <<2025-Apr-17 07:08>> raise ConnectTimeoutError(
Line 601: <<2025-Apr-17 07:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 613: <<2025-Apr-17 07:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 615: <<2025-Apr-17 07:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 657: <<2025-Apr-17 07:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 658: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:16:00 2025
Line 676: <<2025-Apr-17 07:18>> TimeoutError: timed out
Line 694: <<2025-Apr-17 07:18>> raise ConnectTimeoutError(
Line 695: <<2025-Apr-17 07:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 707: <<2025-Apr-17 07:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 709: <<2025-Apr-17 07:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 751: <<2025-Apr-17 07:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 752: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:26:00 2025
Line 770: <<2025-Apr-17 07:28>> TimeoutError: timed out
Line 788: <<2025-Apr-17 07:28>> raise ConnectTimeoutError(
Line 789: <<2025-Apr-17 07:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 801: <<2025-Apr-17 07:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 803: <<2025-Apr-17 07:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 845: <<2025-Apr-17 07:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 846: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:36:00 2025
Line 864: <<2025-Apr-17 07:38>> TimeoutError: timed out
Line 882: <<2025-Apr-17 07:38>> raise ConnectTimeoutError(
Line 883: <<2025-Apr-17 07:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 895: <<2025-Apr-17 07:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 897: <<2025-Apr-17 07:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 939: <<2025-Apr-17 07:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 940: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:46:00 2025
Line 958: <<2025-Apr-17 07:48>> TimeoutError: timed out
Line 976: <<2025-Apr-17 07:48>> raise ConnectTimeoutError(
Line 977: <<2025-Apr-17 07:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 989: <<2025-Apr-17 07:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 991: <<2025-Apr-17 07:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1033: <<2025-Apr-17 07:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1034: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:56:00 2025
Line 1052: <<2025-Apr-17 07:58>> TimeoutError: timed out
Line 1070: <<2025-Apr-17 07:58>> raise ConnectTimeoutError(
Line 1071: <<2025-Apr-17 07:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1083: <<2025-Apr-17 07:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1085: <<2025-Apr-17 07:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1127: <<2025-Apr-17 07:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1128: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:06:00 2025
Line 1146: <<2025-Apr-17 08:08>> TimeoutError: timed out
Line 1164: <<2025-Apr-17 08:08>> raise ConnectTimeoutError(
Line 1165: <<2025-Apr-17 08:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1177: <<2025-Apr-17 08:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1179: <<2025-Apr-17 08:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1221: <<2025-Apr-17 08:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1222: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:16:00 2025
Line 1240: <<2025-Apr-17 08:18>> TimeoutError: timed out
Line 1258: <<2025-Apr-17 08:18>> raise ConnectTimeoutError(
Line 1259: <<2025-Apr-17 08:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1271: <<2025-Apr-17 08:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1273: <<2025-Apr-17 08:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1315: <<2025-Apr-17 08:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1316: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:26:00 2025
Line 1334: <<2025-Apr-17 08:28>> TimeoutError: timed out
Line 1352: <<2025-Apr-17 08:28>> raise ConnectTimeoutError(
Line 1353: <<2025-Apr-17 08:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1365: <<2025-Apr-17 08:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1367: <<2025-Apr-17 08:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1409: <<2025-Apr-17 08:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1410: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:36:00 2025
Line 1428: <<2025-Apr-17 08:38>> TimeoutError: timed out
Line 1446: <<2025-Apr-17 08:38>> raise ConnectTimeoutError(
Line 1447: <<2025-Apr-17 08:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1459: <<2025-Apr-17 08:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1461: <<2025-Apr-17 08:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1503: <<2025-Apr-17 08:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1504: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:46:00 2025
Line 1522: <<2025-Apr-17 08:48>> TimeoutError: timed out
Line 1540: <<2025-Apr-17 08:48>> raise ConnectTimeoutError(
Line 1541: <<2025-Apr-17 08:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1553: <<2025-Apr-17 08:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1555: <<2025-Apr-17 08:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1597: <<2025-Apr-17 08:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1598: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:56:00 2025
Line 1616: <<2025-Apr-17 08:58>> TimeoutError: timed out
Line 1634: <<2025-Apr-17 08:58>> raise ConnectTimeoutError(
Line 1635: <<2025-Apr-17 08:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1647: <<2025-Apr-17 08:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1649: <<2025-Apr-17 08:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1691: <<2025-Apr-17 08:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1692: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:06:00 2025
Line 1710: <<2025-Apr-17 09:08>> TimeoutError: timed out
Line 1728: <<2025-Apr-17 09:08>> raise ConnectTimeoutError(
Line 1729: <<2025-Apr-17 09:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1741: <<2025-Apr-17 09:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1743: <<2025-Apr-17 09:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1785: <<2025-Apr-17 09:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1786: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:16:00 2025
Line 1804: <<2025-Apr-17 09:18>> TimeoutError: timed out
Line 1822: <<2025-Apr-17 09:18>> raise ConnectTimeoutError(
Line 1823: <<2025-Apr-17 09:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1835: <<2025-Apr-17 09:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1837: <<2025-Apr-17 09:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1879: <<2025-Apr-17 09:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1880: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:26:00 2025
Line 1898: <<2025-Apr-17 09:28>> TimeoutError: timed out
Line 1916: <<2025-Apr-17 09:28>> raise ConnectTimeoutError(
Line 1917: <<2025-Apr-17 09:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1929: <<2025-Apr-17 09:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1931: <<2025-Apr-17 09:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1973: <<2025-Apr-17 09:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1974: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:36:00 2025
Line 1992: <<2025-Apr-17 09:38>> TimeoutError: timed out
Line 2010: <<2025-Apr-17 09:38>> raise ConnectTimeoutError(
Line 2011: <<2025-Apr-17 09:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2023: <<2025-Apr-17 09:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2025: <<2025-Apr-17 09:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2067: <<2025-Apr-17 09:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2068: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:46:00 2025
Line 2086: <<2025-Apr-17 09:48>> TimeoutError: timed out
Line 2104: <<2025-Apr-17 09:48>> raise ConnectTimeoutError(
Line 2105: <<2025-Apr-17 09:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2117: <<2025-Apr-17 09:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2119: <<2025-Apr-17 09:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2161: <<2025-Apr-17 09:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2162: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:05:00 2025
Line 2168: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:15:00 2025
Line 2174: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:25:00 2025
Line 2180: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:35:00 2025
Line 2186: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:45:00 2025
Line 2192: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:55:00 2025
Line 2198: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:05:00 2025
Line 2204: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:15:00 2025
Line 2210: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:25:00 2025
Line 2216: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:35:00 2025
Line 2222: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:45:00 2025
Line 2228: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:55:00 2025
Line 2234: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:05:00 2025
Line 2240: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:15:00 2025
Line 2246: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:25:00 2025
Line 2252: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:35:00 2025
Line 2258: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:45:00 2025
Line 2264: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:55:00 2025
Line 2270: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:05:00 2025
Line 2276: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:15:00 2025
Line 2282: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:25:00 2025
Line 2288: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:35:00 2025
Line 2294: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:45:00 2025
Line 2300: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:55:00 2025
Line 2306: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:05:00 2025
Line 2312: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:15:00 2025
Line 2318: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:25:00 2025
Line 2324: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:35:00 2025
Line 2330: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:45:00 2025
Line 2336: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:55:00 2025
Line 2342: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:05:00 2025
Line 2348: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:15:00 2025
Line 2354: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:25:00 2025
Line 2360: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:35:00 2025
Line 2366: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:45:00 2025
Line 2372: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:55:00 2025
Line 2378: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:05:00 2025
Line 2384: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:15:00 2025
Line 2390: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:25:00 2025
Line 2396: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:35:00 2025
Line 2402: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:45:00 2025
Line 2408: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:55:01 2025
Line 2414: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 17:05:00 2025
Line 2420: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 17:15:00 2025

File contents:

WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 06:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:10:06:00.000&tstop=2025:110:01:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 06:08>> Traceback (most recent call last):
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 06:08>> sock = connection.create_connection(
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 06:08>> raise err
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 06:08>> sock.connect(sa)
<<2025-Apr-17 06:08>> TimeoutError: timed out
<<2025-Apr-17 06:08>>
<<2025-Apr-17 06:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:08>>
<<2025-Apr-17 06:08>> Traceback (most recent call last):
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 06:08>> response = self._make_request(
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 06:08>> raise new_e
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 06:08>> self._validate_conn(conn)
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 06:08>> conn.connect()
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 06:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 06:08>> raise ConnectTimeoutError(
<<2025-Apr-17 06:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 06:08>>
<<2025-Apr-17 06:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:08>>
<<2025-Apr-17 06:08>> Traceback (most recent call last):
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 06:08>> resp = conn.urlopen(
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 06:08>> retries = retries.increment(
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 06:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 06:08>>
<<2025-Apr-17 06:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 06:08>>
<<2025-Apr-17 06:08>> Traceback (most recent call last):
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 06:08>> main()
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 06:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 06:08>> cmds = commands.get_cmds(
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 06:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 06:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 06:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 06:08>> html = get_occweb_page(
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 06:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 06:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 06:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 06:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 06:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 06:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 06:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 06:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 06:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:10:16:00.000&tstop=2025:110:01:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 06:18>> Traceback (most recent call last):
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 06:18>> sock = connection.create_connection(
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 06:18>> raise err
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 06:18>> sock.connect(sa)
<<2025-Apr-17 06:18>> TimeoutError: timed out
<<2025-Apr-17 06:18>>
<<2025-Apr-17 06:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:18>>
<<2025-Apr-17 06:18>> Traceback (most recent call last):
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 06:18>> response = self._make_request(
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 06:18>> raise new_e
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 06:18>> self._validate_conn(conn)
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 06:18>> conn.connect()
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 06:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 06:18>> raise ConnectTimeoutError(
<<2025-Apr-17 06:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 06:18>>
<<2025-Apr-17 06:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:18>>
<<2025-Apr-17 06:18>> Traceback (most recent call last):
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 06:18>> resp = conn.urlopen(
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 06:18>> retries = retries.increment(
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 06:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 06:18>>
<<2025-Apr-17 06:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 06:18>>
<<2025-Apr-17 06:18>> Traceback (most recent call last):
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 06:18>> main()
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 06:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 06:18>> cmds = commands.get_cmds(
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 06:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 06:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 06:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 06:18>> html = get_occweb_page(
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 06:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 06:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 06:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 06:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 06:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 06:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 06:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 06:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 06:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:10:26:00.000&tstop=2025:110:01:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 06:28>> Traceback (most recent call last):
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 06:28>> sock = connection.create_connection(
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 06:28>> raise err
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 06:28>> sock.connect(sa)
<<2025-Apr-17 06:28>> TimeoutError: timed out
<<2025-Apr-17 06:28>>
<<2025-Apr-17 06:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:28>>
<<2025-Apr-17 06:28>> Traceback (most recent call last):
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 06:28>> response = self._make_request(
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 06:28>> raise new_e
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 06:28>> self._validate_conn(conn)
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 06:28>> conn.connect()
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 06:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 06:28>> raise ConnectTimeoutError(
<<2025-Apr-17 06:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 06:28>>
<<2025-Apr-17 06:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:28>>
<<2025-Apr-17 06:28>> Traceback (most recent call last):
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 06:28>> resp = conn.urlopen(
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 06:28>> retries = retries.increment(
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 06:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 06:28>>
<<2025-Apr-17 06:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 06:28>>
<<2025-Apr-17 06:28>> Traceback (most recent call last):
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 06:28>> main()
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 06:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 06:28>> cmds = commands.get_cmds(
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 06:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 06:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 06:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 06:28>> html = get_occweb_page(
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 06:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 06:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 06:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 06:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 06:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 06:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 06:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 06:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 06:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:10:36:00.000&tstop=2025:110:02:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 06:38>> Traceback (most recent call last):
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 06:38>> sock = connection.create_connection(
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 06:38>> raise err
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 06:38>> sock.connect(sa)
<<2025-Apr-17 06:38>> TimeoutError: timed out
<<2025-Apr-17 06:38>>
<<2025-Apr-17 06:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:38>>
<<2025-Apr-17 06:38>> Traceback (most recent call last):
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 06:38>> response = self._make_request(
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 06:38>> raise new_e
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 06:38>> self._validate_conn(conn)
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 06:38>> conn.connect()
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 06:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 06:38>> raise ConnectTimeoutError(
<<2025-Apr-17 06:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 06:38>>
<<2025-Apr-17 06:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:38>>
<<2025-Apr-17 06:38>> Traceback (most recent call last):
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 06:38>> resp = conn.urlopen(
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 06:38>> retries = retries.increment(
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 06:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 06:38>>
<<2025-Apr-17 06:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 06:38>>
<<2025-Apr-17 06:38>> Traceback (most recent call last):
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 06:38>> main()
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 06:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 06:38>> cmds = commands.get_cmds(
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 06:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 06:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 06:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 06:38>> html = get_occweb_page(
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 06:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 06:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 06:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 06:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 06:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 06:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 06:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 06:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 06:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:10:46:00.000&tstop=2025:110:02:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 06:48>> Traceback (most recent call last):
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 06:48>> sock = connection.create_connection(
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 06:48>> raise err
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 06:48>> sock.connect(sa)
<<2025-Apr-17 06:48>> TimeoutError: timed out
<<2025-Apr-17 06:48>>
<<2025-Apr-17 06:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:48>>
<<2025-Apr-17 06:48>> Traceback (most recent call last):
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 06:48>> response = self._make_request(
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 06:48>> raise new_e
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 06:48>> self._validate_conn(conn)
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 06:48>> conn.connect()
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 06:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 06:48>> raise ConnectTimeoutError(
<<2025-Apr-17 06:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 06:48>>
<<2025-Apr-17 06:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:48>>
<<2025-Apr-17 06:48>> Traceback (most recent call last):
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 06:48>> resp = conn.urlopen(
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 06:48>> retries = retries.increment(
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 06:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 06:48>>
<<2025-Apr-17 06:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 06:48>>
<<2025-Apr-17 06:48>> Traceback (most recent call last):
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 06:48>> main()
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 06:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 06:48>> cmds = commands.get_cmds(
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 06:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 06:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 06:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 06:48>> html = get_occweb_page(
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 06:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 06:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 06:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 06:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 06:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 06:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 06:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 06:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 06:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 06:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:10:56:00.000&tstop=2025:110:02:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 06:58>> Traceback (most recent call last):
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 06:58>> sock = connection.create_connection(
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 06:58>> raise err
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 06:58>> sock.connect(sa)
<<2025-Apr-17 06:58>> TimeoutError: timed out
<<2025-Apr-17 06:58>>
<<2025-Apr-17 06:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:58>>
<<2025-Apr-17 06:58>> Traceback (most recent call last):
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 06:58>> response = self._make_request(
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 06:58>> raise new_e
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 06:58>> self._validate_conn(conn)
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 06:58>> conn.connect()
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 06:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 06:58>> raise ConnectTimeoutError(
<<2025-Apr-17 06:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 06:58>>
<<2025-Apr-17 06:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 06:58>>
<<2025-Apr-17 06:58>> Traceback (most recent call last):
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 06:58>> resp = conn.urlopen(
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 06:58>> retries = retries.increment(
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 06:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 06:58>>
<<2025-Apr-17 06:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 06:58>>
<<2025-Apr-17 06:58>> Traceback (most recent call last):
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 06:58>> main()
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 06:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 06:58>> cmds = commands.get_cmds(
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 06:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 06:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 06:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 06:58>> html = get_occweb_page(
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 06:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 06:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 06:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 06:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 06:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 06:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 06:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 06:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 06:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 07:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:11:06:00.000&tstop=2025:110:02:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 07:08>> Traceback (most recent call last):
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 07:08>> sock = connection.create_connection(
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 07:08>> raise err
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 07:08>> sock.connect(sa)
<<2025-Apr-17 07:08>> TimeoutError: timed out
<<2025-Apr-17 07:08>>
<<2025-Apr-17 07:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:08>>
<<2025-Apr-17 07:08>> Traceback (most recent call last):
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 07:08>> response = self._make_request(
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 07:08>> raise new_e
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 07:08>> self._validate_conn(conn)
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 07:08>> conn.connect()
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 07:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 07:08>> raise ConnectTimeoutError(
<<2025-Apr-17 07:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 07:08>>
<<2025-Apr-17 07:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:08>>
<<2025-Apr-17 07:08>> Traceback (most recent call last):
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 07:08>> resp = conn.urlopen(
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 07:08>> retries = retries.increment(
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 07:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 07:08>>
<<2025-Apr-17 07:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 07:08>>
<<2025-Apr-17 07:08>> Traceback (most recent call last):
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 07:08>> main()
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 07:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 07:08>> cmds = commands.get_cmds(
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 07:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 07:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 07:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 07:08>> html = get_occweb_page(
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 07:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 07:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 07:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 07:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 07:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 07:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 07:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 07:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 07:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:11:16:00.000&tstop=2025:110:02:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 07:18>> Traceback (most recent call last):
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 07:18>> sock = connection.create_connection(
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 07:18>> raise err
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 07:18>> sock.connect(sa)
<<2025-Apr-17 07:18>> TimeoutError: timed out
<<2025-Apr-17 07:18>>
<<2025-Apr-17 07:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:18>>
<<2025-Apr-17 07:18>> Traceback (most recent call last):
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 07:18>> response = self._make_request(
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 07:18>> raise new_e
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 07:18>> self._validate_conn(conn)
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 07:18>> conn.connect()
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 07:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 07:18>> raise ConnectTimeoutError(
<<2025-Apr-17 07:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 07:18>>
<<2025-Apr-17 07:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:18>>
<<2025-Apr-17 07:18>> Traceback (most recent call last):
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 07:18>> resp = conn.urlopen(
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 07:18>> retries = retries.increment(
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 07:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 07:18>>
<<2025-Apr-17 07:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 07:18>>
<<2025-Apr-17 07:18>> Traceback (most recent call last):
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 07:18>> main()
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 07:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 07:18>> cmds = commands.get_cmds(
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 07:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 07:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 07:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 07:18>> html = get_occweb_page(
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 07:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 07:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 07:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 07:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 07:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 07:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 07:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 07:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 07:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:11:26:00.000&tstop=2025:110:02:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 07:28>> Traceback (most recent call last):
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 07:28>> sock = connection.create_connection(
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 07:28>> raise err
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 07:28>> sock.connect(sa)
<<2025-Apr-17 07:28>> TimeoutError: timed out
<<2025-Apr-17 07:28>>
<<2025-Apr-17 07:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:28>>
<<2025-Apr-17 07:28>> Traceback (most recent call last):
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 07:28>> response = self._make_request(
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 07:28>> raise new_e
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 07:28>> self._validate_conn(conn)
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 07:28>> conn.connect()
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 07:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 07:28>> raise ConnectTimeoutError(
<<2025-Apr-17 07:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 07:28>>
<<2025-Apr-17 07:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:28>>
<<2025-Apr-17 07:28>> Traceback (most recent call last):
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 07:28>> resp = conn.urlopen(
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 07:28>> retries = retries.increment(
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 07:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 07:28>>
<<2025-Apr-17 07:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 07:28>>
<<2025-Apr-17 07:28>> Traceback (most recent call last):
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 07:28>> main()
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 07:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 07:28>> cmds = commands.get_cmds(
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 07:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 07:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 07:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 07:28>> html = get_occweb_page(
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 07:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 07:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 07:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 07:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 07:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 07:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 07:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 07:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 07:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:11:36:00.000&tstop=2025:110:03:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 07:38>> Traceback (most recent call last):
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 07:38>> sock = connection.create_connection(
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 07:38>> raise err
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 07:38>> sock.connect(sa)
<<2025-Apr-17 07:38>> TimeoutError: timed out
<<2025-Apr-17 07:38>>
<<2025-Apr-17 07:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:38>>
<<2025-Apr-17 07:38>> Traceback (most recent call last):
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 07:38>> response = self._make_request(
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 07:38>> raise new_e
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 07:38>> self._validate_conn(conn)
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 07:38>> conn.connect()
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 07:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 07:38>> raise ConnectTimeoutError(
<<2025-Apr-17 07:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 07:38>>
<<2025-Apr-17 07:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:38>>
<<2025-Apr-17 07:38>> Traceback (most recent call last):
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 07:38>> resp = conn.urlopen(
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 07:38>> retries = retries.increment(
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 07:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 07:38>>
<<2025-Apr-17 07:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 07:38>>
<<2025-Apr-17 07:38>> Traceback (most recent call last):
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 07:38>> main()
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 07:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 07:38>> cmds = commands.get_cmds(
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 07:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 07:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 07:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 07:38>> html = get_occweb_page(
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 07:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 07:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 07:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 07:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 07:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 07:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 07:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 07:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 07:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:11:46:00.000&tstop=2025:110:03:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 07:48>> Traceback (most recent call last):
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 07:48>> sock = connection.create_connection(
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 07:48>> raise err
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 07:48>> sock.connect(sa)
<<2025-Apr-17 07:48>> TimeoutError: timed out
<<2025-Apr-17 07:48>>
<<2025-Apr-17 07:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:48>>
<<2025-Apr-17 07:48>> Traceback (most recent call last):
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 07:48>> response = self._make_request(
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 07:48>> raise new_e
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 07:48>> self._validate_conn(conn)
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 07:48>> conn.connect()
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 07:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 07:48>> raise ConnectTimeoutError(
<<2025-Apr-17 07:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 07:48>>
<<2025-Apr-17 07:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:48>>
<<2025-Apr-17 07:48>> Traceback (most recent call last):
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 07:48>> resp = conn.urlopen(
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 07:48>> retries = retries.increment(
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 07:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 07:48>>
<<2025-Apr-17 07:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 07:48>>
<<2025-Apr-17 07:48>> Traceback (most recent call last):
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 07:48>> main()
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 07:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 07:48>> cmds = commands.get_cmds(
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 07:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 07:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 07:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 07:48>> html = get_occweb_page(
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 07:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 07:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 07:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 07:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 07:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 07:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 07:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 07:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 07:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 07:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:11:56:00.000&tstop=2025:110:03:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 07:58>> Traceback (most recent call last):
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 07:58>> sock = connection.create_connection(
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 07:58>> raise err
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 07:58>> sock.connect(sa)
<<2025-Apr-17 07:58>> TimeoutError: timed out
<<2025-Apr-17 07:58>>
<<2025-Apr-17 07:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:58>>
<<2025-Apr-17 07:58>> Traceback (most recent call last):
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 07:58>> response = self._make_request(
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 07:58>> raise new_e
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 07:58>> self._validate_conn(conn)
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 07:58>> conn.connect()
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 07:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 07:58>> raise ConnectTimeoutError(
<<2025-Apr-17 07:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 07:58>>
<<2025-Apr-17 07:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 07:58>>
<<2025-Apr-17 07:58>> Traceback (most recent call last):
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 07:58>> resp = conn.urlopen(
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 07:58>> retries = retries.increment(
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 07:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 07:58>>
<<2025-Apr-17 07:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 07:58>>
<<2025-Apr-17 07:58>> Traceback (most recent call last):
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 07:58>> main()
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 07:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 07:58>> cmds = commands.get_cmds(
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 07:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 07:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 07:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 07:58>> html = get_occweb_page(
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 07:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 07:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 07:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 07:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 07:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 07:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 07:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 07:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 07:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 08:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:12:06:00.000&tstop=2025:110:03:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 08:08>> Traceback (most recent call last):
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 08:08>> sock = connection.create_connection(
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 08:08>> raise err
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 08:08>> sock.connect(sa)
<<2025-Apr-17 08:08>> TimeoutError: timed out
<<2025-Apr-17 08:08>>
<<2025-Apr-17 08:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:08>>
<<2025-Apr-17 08:08>> Traceback (most recent call last):
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 08:08>> response = self._make_request(
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 08:08>> raise new_e
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 08:08>> self._validate_conn(conn)
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 08:08>> conn.connect()
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 08:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 08:08>> raise ConnectTimeoutError(
<<2025-Apr-17 08:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 08:08>>
<<2025-Apr-17 08:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:08>>
<<2025-Apr-17 08:08>> Traceback (most recent call last):
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 08:08>> resp = conn.urlopen(
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 08:08>> retries = retries.increment(
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 08:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 08:08>>
<<2025-Apr-17 08:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 08:08>>
<<2025-Apr-17 08:08>> Traceback (most recent call last):
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 08:08>> main()
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 08:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 08:08>> cmds = commands.get_cmds(
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 08:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 08:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 08:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 08:08>> html = get_occweb_page(
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 08:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 08:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 08:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 08:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 08:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 08:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 08:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 08:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 08:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:12:16:01.000&tstop=2025:110:03:46:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 08:18>> Traceback (most recent call last):
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 08:18>> sock = connection.create_connection(
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 08:18>> raise err
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 08:18>> sock.connect(sa)
<<2025-Apr-17 08:18>> TimeoutError: timed out
<<2025-Apr-17 08:18>>
<<2025-Apr-17 08:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:18>>
<<2025-Apr-17 08:18>> Traceback (most recent call last):
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 08:18>> response = self._make_request(
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 08:18>> raise new_e
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 08:18>> self._validate_conn(conn)
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 08:18>> conn.connect()
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 08:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 08:18>> raise ConnectTimeoutError(
<<2025-Apr-17 08:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 08:18>>
<<2025-Apr-17 08:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:18>>
<<2025-Apr-17 08:18>> Traceback (most recent call last):
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 08:18>> resp = conn.urlopen(
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 08:18>> retries = retries.increment(
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 08:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 08:18>>
<<2025-Apr-17 08:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 08:18>>
<<2025-Apr-17 08:18>> Traceback (most recent call last):
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 08:18>> main()
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 08:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 08:18>> cmds = commands.get_cmds(
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 08:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 08:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 08:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 08:18>> html = get_occweb_page(
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 08:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 08:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 08:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 08:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 08:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 08:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 08:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 08:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 08:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:12:26:01.000&tstop=2025:110:03:56:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 08:28>> Traceback (most recent call last):
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 08:28>> sock = connection.create_connection(
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 08:28>> raise err
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 08:28>> sock.connect(sa)
<<2025-Apr-17 08:28>> TimeoutError: timed out
<<2025-Apr-17 08:28>>
<<2025-Apr-17 08:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:28>>
<<2025-Apr-17 08:28>> Traceback (most recent call last):
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 08:28>> response = self._make_request(
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 08:28>> raise new_e
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 08:28>> self._validate_conn(conn)
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 08:28>> conn.connect()
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 08:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 08:28>> raise ConnectTimeoutError(
<<2025-Apr-17 08:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 08:28>>
<<2025-Apr-17 08:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:28>>
<<2025-Apr-17 08:28>> Traceback (most recent call last):
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 08:28>> resp = conn.urlopen(
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 08:28>> retries = retries.increment(
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 08:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 08:28>>
<<2025-Apr-17 08:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 08:28>>
<<2025-Apr-17 08:28>> Traceback (most recent call last):
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 08:28>> main()
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 08:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 08:28>> cmds = commands.get_cmds(
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 08:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 08:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 08:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 08:28>> html = get_occweb_page(
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 08:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 08:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 08:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 08:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 08:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 08:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 08:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 08:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 08:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:12:36:01.000&tstop=2025:110:04:06:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 08:38>> Traceback (most recent call last):
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 08:38>> sock = connection.create_connection(
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 08:38>> raise err
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 08:38>> sock.connect(sa)
<<2025-Apr-17 08:38>> TimeoutError: timed out
<<2025-Apr-17 08:38>>
<<2025-Apr-17 08:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:38>>
<<2025-Apr-17 08:38>> Traceback (most recent call last):
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 08:38>> response = self._make_request(
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 08:38>> raise new_e
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 08:38>> self._validate_conn(conn)
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 08:38>> conn.connect()
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 08:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 08:38>> raise ConnectTimeoutError(
<<2025-Apr-17 08:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 08:38>>
<<2025-Apr-17 08:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:38>>
<<2025-Apr-17 08:38>> Traceback (most recent call last):
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 08:38>> resp = conn.urlopen(
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 08:38>> retries = retries.increment(
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 08:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 08:38>>
<<2025-Apr-17 08:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 08:38>>
<<2025-Apr-17 08:38>> Traceback (most recent call last):
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 08:38>> main()
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 08:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 08:38>> cmds = commands.get_cmds(
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 08:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 08:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 08:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 08:38>> html = get_occweb_page(
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 08:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 08:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 08:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 08:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 08:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 08:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 08:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 08:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 08:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:12:46:01.000&tstop=2025:110:04:16:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 08:48>> Traceback (most recent call last):
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 08:48>> sock = connection.create_connection(
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 08:48>> raise err
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 08:48>> sock.connect(sa)
<<2025-Apr-17 08:48>> TimeoutError: timed out
<<2025-Apr-17 08:48>>
<<2025-Apr-17 08:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:48>>
<<2025-Apr-17 08:48>> Traceback (most recent call last):
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 08:48>> response = self._make_request(
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 08:48>> raise new_e
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 08:48>> self._validate_conn(conn)
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 08:48>> conn.connect()
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 08:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 08:48>> raise ConnectTimeoutError(
<<2025-Apr-17 08:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 08:48>>
<<2025-Apr-17 08:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:48>>
<<2025-Apr-17 08:48>> Traceback (most recent call last):
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 08:48>> resp = conn.urlopen(
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 08:48>> retries = retries.increment(
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 08:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 08:48>>
<<2025-Apr-17 08:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 08:48>>
<<2025-Apr-17 08:48>> Traceback (most recent call last):
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 08:48>> main()
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 08:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 08:48>> cmds = commands.get_cmds(
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 08:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 08:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 08:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 08:48>> html = get_occweb_page(
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 08:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 08:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 08:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 08:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 08:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 08:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 08:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 08:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 08:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 08:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:12:56:00.000&tstop=2025:110:04:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 08:58>> Traceback (most recent call last):
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 08:58>> sock = connection.create_connection(
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 08:58>> raise err
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 08:58>> sock.connect(sa)
<<2025-Apr-17 08:58>> TimeoutError: timed out
<<2025-Apr-17 08:58>>
<<2025-Apr-17 08:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:58>>
<<2025-Apr-17 08:58>> Traceback (most recent call last):
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 08:58>> response = self._make_request(
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 08:58>> raise new_e
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 08:58>> self._validate_conn(conn)
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 08:58>> conn.connect()
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 08:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 08:58>> raise ConnectTimeoutError(
<<2025-Apr-17 08:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 08:58>>
<<2025-Apr-17 08:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 08:58>>
<<2025-Apr-17 08:58>> Traceback (most recent call last):
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 08:58>> resp = conn.urlopen(
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 08:58>> retries = retries.increment(
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 08:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 08:58>>
<<2025-Apr-17 08:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 08:58>>
<<2025-Apr-17 08:58>> Traceback (most recent call last):
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 08:58>> main()
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 08:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 08:58>> cmds = commands.get_cmds(
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 08:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 08:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 08:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 08:58>> html = get_occweb_page(
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 08:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 08:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 08:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 08:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 08:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 08:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 08:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 08:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 08:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 09:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:13:06:00.000&tstop=2025:110:04:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 09:08>> Traceback (most recent call last):
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 09:08>> sock = connection.create_connection(
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 09:08>> raise err
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 09:08>> sock.connect(sa)
<<2025-Apr-17 09:08>> TimeoutError: timed out
<<2025-Apr-17 09:08>>
<<2025-Apr-17 09:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:08>>
<<2025-Apr-17 09:08>> Traceback (most recent call last):
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 09:08>> response = self._make_request(
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 09:08>> raise new_e
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 09:08>> self._validate_conn(conn)
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 09:08>> conn.connect()
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 09:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 09:08>> raise ConnectTimeoutError(
<<2025-Apr-17 09:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 09:08>>
<<2025-Apr-17 09:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:08>>
<<2025-Apr-17 09:08>> Traceback (most recent call last):
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 09:08>> resp = conn.urlopen(
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 09:08>> retries = retries.increment(
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 09:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 09:08>>
<<2025-Apr-17 09:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 09:08>>
<<2025-Apr-17 09:08>> Traceback (most recent call last):
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 09:08>> main()
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 09:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 09:08>> cmds = commands.get_cmds(
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 09:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 09:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 09:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 09:08>> html = get_occweb_page(
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 09:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 09:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 09:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 09:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 09:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 09:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 09:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 09:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 09:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:13:16:00.000&tstop=2025:110:04:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 09:18>> Traceback (most recent call last):
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 09:18>> sock = connection.create_connection(
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 09:18>> raise err
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 09:18>> sock.connect(sa)
<<2025-Apr-17 09:18>> TimeoutError: timed out
<<2025-Apr-17 09:18>>
<<2025-Apr-17 09:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:18>>
<<2025-Apr-17 09:18>> Traceback (most recent call last):
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 09:18>> response = self._make_request(
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 09:18>> raise new_e
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 09:18>> self._validate_conn(conn)
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 09:18>> conn.connect()
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 09:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 09:18>> raise ConnectTimeoutError(
<<2025-Apr-17 09:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 09:18>>
<<2025-Apr-17 09:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:18>>
<<2025-Apr-17 09:18>> Traceback (most recent call last):
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 09:18>> resp = conn.urlopen(
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 09:18>> retries = retries.increment(
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 09:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 09:18>>
<<2025-Apr-17 09:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 09:18>>
<<2025-Apr-17 09:18>> Traceback (most recent call last):
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 09:18>> main()
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 09:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 09:18>> cmds = commands.get_cmds(
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 09:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 09:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 09:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 09:18>> html = get_occweb_page(
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 09:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 09:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 09:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 09:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 09:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 09:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 09:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 09:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 09:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:13:26:00.000&tstop=2025:110:04:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 09:28>> Traceback (most recent call last):
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 09:28>> sock = connection.create_connection(
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 09:28>> raise err
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 09:28>> sock.connect(sa)
<<2025-Apr-17 09:28>> TimeoutError: timed out
<<2025-Apr-17 09:28>>
<<2025-Apr-17 09:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:28>>
<<2025-Apr-17 09:28>> Traceback (most recent call last):
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 09:28>> response = self._make_request(
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 09:28>> raise new_e
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 09:28>> self._validate_conn(conn)
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 09:28>> conn.connect()
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 09:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 09:28>> raise ConnectTimeoutError(
<<2025-Apr-17 09:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 09:28>>
<<2025-Apr-17 09:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:28>>
<<2025-Apr-17 09:28>> Traceback (most recent call last):
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 09:28>> resp = conn.urlopen(
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 09:28>> retries = retries.increment(
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 09:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 09:28>>
<<2025-Apr-17 09:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 09:28>>
<<2025-Apr-17 09:28>> Traceback (most recent call last):
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 09:28>> main()
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 09:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 09:28>> cmds = commands.get_cmds(
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 09:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 09:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 09:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 09:28>> html = get_occweb_page(
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 09:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 09:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 09:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 09:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 09:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 09:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 09:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 09:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 09:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:13:36:00.000&tstop=2025:110:05:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 09:38>> Traceback (most recent call last):
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 09:38>> sock = connection.create_connection(
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 09:38>> raise err
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 09:38>> sock.connect(sa)
<<2025-Apr-17 09:38>> TimeoutError: timed out
<<2025-Apr-17 09:38>>
<<2025-Apr-17 09:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:38>>
<<2025-Apr-17 09:38>> Traceback (most recent call last):
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 09:38>> response = self._make_request(
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 09:38>> raise new_e
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 09:38>> self._validate_conn(conn)
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 09:38>> conn.connect()
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 09:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 09:38>> raise ConnectTimeoutError(
<<2025-Apr-17 09:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 09:38>>
<<2025-Apr-17 09:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:38>>
<<2025-Apr-17 09:38>> Traceback (most recent call last):
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 09:38>> resp = conn.urlopen(
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 09:38>> retries = retries.increment(
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 09:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 09:38>>
<<2025-Apr-17 09:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 09:38>>
<<2025-Apr-17 09:38>> Traceback (most recent call last):
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 09:38>> main()
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 09:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 09:38>> cmds = commands.get_cmds(
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 09:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 09:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 09:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 09:38>> html = get_occweb_page(
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 09:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 09:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 09:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 09:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 09:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 09:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 09:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 09:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 09:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 09:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:13:46:00.000&tstop=2025:110:05:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 09:48>> Traceback (most recent call last):
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 09:48>> sock = connection.create_connection(
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 09:48>> raise err
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 09:48>> sock.connect(sa)
<<2025-Apr-17 09:48>> TimeoutError: timed out
<<2025-Apr-17 09:48>>
<<2025-Apr-17 09:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:48>>
<<2025-Apr-17 09:48>> Traceback (most recent call last):
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 09:48>> response = self._make_request(
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 09:48>> raise new_e
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 09:48>> self._validate_conn(conn)
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 09:48>> conn.connect()
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 09:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 09:48>> raise ConnectTimeoutError(
<<2025-Apr-17 09:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 09:48>>
<<2025-Apr-17 09:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 09:48>>
<<2025-Apr-17 09:48>> Traceback (most recent call last):
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 09:48>> resp = conn.urlopen(
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 09:48>> retries = retries.increment(
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 09:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 09:48>>
<<2025-Apr-17 09:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 09:48>>
<<2025-Apr-17 09:48>> Traceback (most recent call last):
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 09:48>> main()
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 09:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 09:48>> cmds = commands.get_cmds(
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 09:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 09:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 09:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 09:48>> html = get_occweb_page(
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 09:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 09:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 09:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 09:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 09:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 09:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 09:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 09:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 09:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 10:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:14:05:00.000&tstop=2025:110:05:35:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 10:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:14:15:00.000&tstop=2025:110:05:45:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:25:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 10:26>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:14:25:00.000&tstop=2025:110:05:55:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:35:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 10:36>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:14:35:00.000&tstop=2025:110:06:05:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:45:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 10:46>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:14:45:00.000&tstop=2025:110:06:15:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 10:55:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 10:56>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:14:55:00.000&tstop=2025:110:06:25:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 11:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:15:05:01.000&tstop=2025:110:06:35:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 11:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:15:15:01.000&tstop=2025:110:06:45:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:25:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 11:26>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:15:25:00.000&tstop=2025:110:06:55:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:35:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 11:36>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:15:35:00.000&tstop=2025:110:07:05:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:45:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 11:46>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:15:45:00.000&tstop=2025:110:07:15:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 11:55:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 11:56>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:15:55:00.000&tstop=2025:110:07:25:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 12:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:16:05:00.000&tstop=2025:110:07:35:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 12:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:16:15:00.000&tstop=2025:110:07:45:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:25:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 12:26>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:16:25:00.000&tstop=2025:110:07:55:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:35:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 12:36>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:16:35:00.000&tstop=2025:110:08:05:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:45:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 12:46>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:16:45:00.000&tstop=2025:110:08:15:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 12:55:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 12:56>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:16:55:01.000&tstop=2025:110:08:25:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 13:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:17:05:01.000&tstop=2025:110:08:35:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 13:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:17:15:00.000&tstop=2025:110:08:45:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:25:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 13:26>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:17:25:00.000&tstop=2025:110:08:55:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:35:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 13:36>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:17:35:00.000&tstop=2025:110:09:05:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:45:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 13:46>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:17:45:00.000&tstop=2025:110:09:15:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 13:55:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 13:56>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:17:55:00.000&tstop=2025:110:09:25:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 14:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:18:05:00.000&tstop=2025:110:09:35:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 14:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:18:15:00.000&tstop=2025:110:09:45:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:25:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 14:26>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:18:25:00.000&tstop=2025:110:09:55:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:35:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 14:36>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:18:35:00.000&tstop=2025:110:10:05:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:45:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 14:46>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:18:45:00.000&tstop=2025:110:10:15:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 14:55:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 14:56>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:18:55:01.000&tstop=2025:110:10:25:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 15:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:19:05:01.000&tstop=2025:110:10:35:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 15:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:19:15:00.000&tstop=2025:110:10:45:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:25:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 15:26>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:19:25:00.000&tstop=2025:110:10:55:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:35:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 15:36>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:19:35:00.000&tstop=2025:110:11:05:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:45:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 15:46>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:19:45:00.000&tstop=2025:110:11:15:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 15:55:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 15:56>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:19:55:00.000&tstop=2025:110:11:25:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 16:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:20:05:00.000&tstop=2025:110:11:35:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 16:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:20:15:00.000&tstop=2025:110:11:45:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:25:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 16:26>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:20:25:00.000&tstop=2025:110:11:55:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:35:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 16:36>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:20:35:01.000&tstop=2025:110:12:05:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:45:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 16:46>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:20:45:01.000&tstop=2025:110:12:15:01.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 16:55:01 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 16:56>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:20:55:00.000&tstop=2025:110:12:25:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 17:05:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 17:06>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:21:05:00.000&tstop=2025:110:12:35:00.000)
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 17:15:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 17:16>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:21:15:00.000&tstop=2025:110:12:45:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 17:56>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 18:01>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 18:06>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/get_ace.py --h5=/proj/sot/ska3/flight/data/arc3/ACE.h5
############################################################
<<2025-Apr-18 05:25>> Warning: failed to open URL ftp://ftp.swpc.noaa.gov/pub/lists/ace/ace_epam_5m.txt: