Prev Index Next

arc: Thu Apr 17 05:58:48 2025

File: /proj/sot/ska/data/arc/Logs/daily.0/arc.log

Task	Status	Age	MaxAge	Last Date
arc	NOT OK	0.20	2.0	Thu Apr 17 05:58:48 2025

Errors:

Line 208: <<2025-Apr-16 18:12>> TimeoutError: The read operation timed out
Line 220: <<2025-Apr-16 18:12>> raise reraise(type(error), error, _stacktrace)
Line 230: <<2025-Apr-16 18:12>> raise ReadTimeoutError(
Line 231: <<2025-Apr-16 18:12>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Read timed out. (read timeout=30)
Line 332: <<2025-Apr-16 18:58>> TimeoutError: timed out
Line 350: <<2025-Apr-16 18:58>> raise ConnectTimeoutError(
Line 351: <<2025-Apr-16 18:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 363: <<2025-Apr-16 18:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 365: <<2025-Apr-16 18:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 407: <<2025-Apr-16 18:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 408: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:06:00 2025
Line 427: <<2025-Apr-16 19:08>> TimeoutError: timed out
Line 445: <<2025-Apr-16 19:08>> raise ConnectTimeoutError(
Line 446: <<2025-Apr-16 19:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 458: <<2025-Apr-16 19:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 460: <<2025-Apr-16 19:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 502: <<2025-Apr-16 19:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 503: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:16:00 2025
Line 522: <<2025-Apr-16 19:18>> TimeoutError: timed out
Line 540: <<2025-Apr-16 19:18>> raise ConnectTimeoutError(
Line 541: <<2025-Apr-16 19:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 553: <<2025-Apr-16 19:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 555: <<2025-Apr-16 19:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 597: <<2025-Apr-16 19:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 598: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:26:00 2025
Line 617: <<2025-Apr-16 19:28>> TimeoutError: timed out
Line 635: <<2025-Apr-16 19:28>> raise ConnectTimeoutError(
Line 636: <<2025-Apr-16 19:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 648: <<2025-Apr-16 19:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 650: <<2025-Apr-16 19:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 692: <<2025-Apr-16 19:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 693: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:36:00 2025
Line 712: <<2025-Apr-16 19:38>> TimeoutError: timed out
Line 730: <<2025-Apr-16 19:38>> raise ConnectTimeoutError(
Line 731: <<2025-Apr-16 19:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 743: <<2025-Apr-16 19:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 745: <<2025-Apr-16 19:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 787: <<2025-Apr-16 19:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 788: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:46:00 2025
Line 807: <<2025-Apr-16 19:48>> TimeoutError: timed out
Line 825: <<2025-Apr-16 19:48>> raise ConnectTimeoutError(
Line 826: <<2025-Apr-16 19:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 838: <<2025-Apr-16 19:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 840: <<2025-Apr-16 19:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 882: <<2025-Apr-16 19:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 883: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:56:00 2025
Line 902: <<2025-Apr-16 19:58>> TimeoutError: timed out
Line 920: <<2025-Apr-16 19:58>> raise ConnectTimeoutError(
Line 921: <<2025-Apr-16 19:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 933: <<2025-Apr-16 19:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 935: <<2025-Apr-16 19:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 977: <<2025-Apr-16 19:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 978: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:06:00 2025
Line 996: <<2025-Apr-16 20:08>> TimeoutError: timed out
Line 1014: <<2025-Apr-16 20:08>> raise ConnectTimeoutError(
Line 1015: <<2025-Apr-16 20:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1027: <<2025-Apr-16 20:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1029: <<2025-Apr-16 20:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1071: <<2025-Apr-16 20:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1072: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:16:00 2025
Line 1090: <<2025-Apr-16 20:18>> TimeoutError: timed out
Line 1108: <<2025-Apr-16 20:18>> raise ConnectTimeoutError(
Line 1109: <<2025-Apr-16 20:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1121: <<2025-Apr-16 20:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1123: <<2025-Apr-16 20:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1165: <<2025-Apr-16 20:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1166: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:26:00 2025
Line 1184: <<2025-Apr-16 20:28>> TimeoutError: timed out
Line 1202: <<2025-Apr-16 20:28>> raise ConnectTimeoutError(
Line 1203: <<2025-Apr-16 20:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1215: <<2025-Apr-16 20:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1217: <<2025-Apr-16 20:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1259: <<2025-Apr-16 20:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1260: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:36:00 2025
Line 1278: <<2025-Apr-16 20:38>> TimeoutError: timed out
Line 1296: <<2025-Apr-16 20:38>> raise ConnectTimeoutError(
Line 1297: <<2025-Apr-16 20:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1309: <<2025-Apr-16 20:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1311: <<2025-Apr-16 20:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1353: <<2025-Apr-16 20:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1354: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:46:00 2025
Line 1372: <<2025-Apr-16 20:48>> TimeoutError: timed out
Line 1390: <<2025-Apr-16 20:48>> raise ConnectTimeoutError(
Line 1391: <<2025-Apr-16 20:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1403: <<2025-Apr-16 20:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1405: <<2025-Apr-16 20:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1447: <<2025-Apr-16 20:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1448: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:56:00 2025
Line 1466: <<2025-Apr-16 20:58>> TimeoutError: timed out
Line 1484: <<2025-Apr-16 20:58>> raise ConnectTimeoutError(
Line 1485: <<2025-Apr-16 20:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1497: <<2025-Apr-16 20:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1499: <<2025-Apr-16 20:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1541: <<2025-Apr-16 20:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1542: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:06:00 2025
Line 1560: <<2025-Apr-16 21:08>> TimeoutError: timed out
Line 1578: <<2025-Apr-16 21:08>> raise ConnectTimeoutError(
Line 1579: <<2025-Apr-16 21:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1591: <<2025-Apr-16 21:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1593: <<2025-Apr-16 21:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1635: <<2025-Apr-16 21:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1636: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:16:00 2025
Line 1654: <<2025-Apr-16 21:18>> TimeoutError: timed out
Line 1672: <<2025-Apr-16 21:18>> raise ConnectTimeoutError(
Line 1673: <<2025-Apr-16 21:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1685: <<2025-Apr-16 21:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1687: <<2025-Apr-16 21:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1729: <<2025-Apr-16 21:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1730: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:26:00 2025
Line 1748: <<2025-Apr-16 21:28>> TimeoutError: timed out
Line 1766: <<2025-Apr-16 21:28>> raise ConnectTimeoutError(
Line 1767: <<2025-Apr-16 21:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1779: <<2025-Apr-16 21:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1781: <<2025-Apr-16 21:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1823: <<2025-Apr-16 21:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1824: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:36:00 2025
Line 1842: <<2025-Apr-16 21:38>> TimeoutError: timed out
Line 1860: <<2025-Apr-16 21:38>> raise ConnectTimeoutError(
Line 1861: <<2025-Apr-16 21:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1873: <<2025-Apr-16 21:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1875: <<2025-Apr-16 21:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1917: <<2025-Apr-16 21:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 1918: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:46:00 2025
Line 1936: <<2025-Apr-16 21:48>> TimeoutError: timed out
Line 1954: <<2025-Apr-16 21:48>> raise ConnectTimeoutError(
Line 1955: <<2025-Apr-16 21:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 1967: <<2025-Apr-16 21:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 1969: <<2025-Apr-16 21:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2011: <<2025-Apr-16 21:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2012: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:56:00 2025
Line 2030: <<2025-Apr-16 21:58>> TimeoutError: timed out
Line 2048: <<2025-Apr-16 21:58>> raise ConnectTimeoutError(
Line 2049: <<2025-Apr-16 21:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2061: <<2025-Apr-16 21:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2063: <<2025-Apr-16 21:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2105: <<2025-Apr-16 21:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2106: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:06:00 2025
Line 2124: <<2025-Apr-16 22:08>> TimeoutError: timed out
Line 2142: <<2025-Apr-16 22:08>> raise ConnectTimeoutError(
Line 2143: <<2025-Apr-16 22:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2155: <<2025-Apr-16 22:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2157: <<2025-Apr-16 22:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2199: <<2025-Apr-16 22:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2200: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:16:00 2025
Line 2218: <<2025-Apr-16 22:18>> TimeoutError: timed out
Line 2236: <<2025-Apr-16 22:18>> raise ConnectTimeoutError(
Line 2237: <<2025-Apr-16 22:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2249: <<2025-Apr-16 22:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2251: <<2025-Apr-16 22:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2293: <<2025-Apr-16 22:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2294: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:26:00 2025
Line 2312: <<2025-Apr-16 22:28>> TimeoutError: timed out
Line 2330: <<2025-Apr-16 22:28>> raise ConnectTimeoutError(
Line 2331: <<2025-Apr-16 22:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2343: <<2025-Apr-16 22:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2345: <<2025-Apr-16 22:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2387: <<2025-Apr-16 22:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2388: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:36:00 2025
Line 2406: <<2025-Apr-16 22:38>> TimeoutError: timed out
Line 2424: <<2025-Apr-16 22:38>> raise ConnectTimeoutError(
Line 2425: <<2025-Apr-16 22:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2437: <<2025-Apr-16 22:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2439: <<2025-Apr-16 22:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2481: <<2025-Apr-16 22:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2482: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:46:00 2025
Line 2500: <<2025-Apr-16 22:48>> TimeoutError: timed out
Line 2518: <<2025-Apr-16 22:48>> raise ConnectTimeoutError(
Line 2519: <<2025-Apr-16 22:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2531: <<2025-Apr-16 22:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2533: <<2025-Apr-16 22:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2575: <<2025-Apr-16 22:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2576: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:56:00 2025
Line 2594: <<2025-Apr-16 22:58>> TimeoutError: timed out
Line 2612: <<2025-Apr-16 22:58>> raise ConnectTimeoutError(
Line 2613: <<2025-Apr-16 22:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2625: <<2025-Apr-16 22:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2627: <<2025-Apr-16 22:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2669: <<2025-Apr-16 22:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2670: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:06:00 2025
Line 2688: <<2025-Apr-16 23:08>> TimeoutError: timed out
Line 2706: <<2025-Apr-16 23:08>> raise ConnectTimeoutError(
Line 2707: <<2025-Apr-16 23:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2719: <<2025-Apr-16 23:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2721: <<2025-Apr-16 23:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2763: <<2025-Apr-16 23:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2764: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:16:00 2025
Line 2782: <<2025-Apr-16 23:18>> TimeoutError: timed out
Line 2800: <<2025-Apr-16 23:18>> raise ConnectTimeoutError(
Line 2801: <<2025-Apr-16 23:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2813: <<2025-Apr-16 23:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2815: <<2025-Apr-16 23:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2857: <<2025-Apr-16 23:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2858: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:26:00 2025
Line 2876: <<2025-Apr-16 23:28>> TimeoutError: timed out
Line 2894: <<2025-Apr-16 23:28>> raise ConnectTimeoutError(
Line 2895: <<2025-Apr-16 23:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 2907: <<2025-Apr-16 23:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 2909: <<2025-Apr-16 23:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2951: <<2025-Apr-16 23:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 2952: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:36:00 2025
Line 2970: <<2025-Apr-16 23:38>> TimeoutError: timed out
Line 2988: <<2025-Apr-16 23:38>> raise ConnectTimeoutError(
Line 2989: <<2025-Apr-16 23:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3001: <<2025-Apr-16 23:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3003: <<2025-Apr-16 23:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3045: <<2025-Apr-16 23:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3046: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:46:00 2025
Line 3064: <<2025-Apr-16 23:48>> TimeoutError: timed out
Line 3082: <<2025-Apr-16 23:48>> raise ConnectTimeoutError(
Line 3083: <<2025-Apr-16 23:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3095: <<2025-Apr-16 23:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3097: <<2025-Apr-16 23:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3139: <<2025-Apr-16 23:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3140: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:56:00 2025
Line 3158: <<2025-Apr-16 23:58>> TimeoutError: timed out
Line 3176: <<2025-Apr-16 23:58>> raise ConnectTimeoutError(
Line 3177: <<2025-Apr-16 23:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3189: <<2025-Apr-16 23:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3191: <<2025-Apr-16 23:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3233: <<2025-Apr-16 23:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3234: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:06:00 2025
Line 3252: <<2025-Apr-17 00:08>> TimeoutError: timed out
Line 3270: <<2025-Apr-17 00:08>> raise ConnectTimeoutError(
Line 3271: <<2025-Apr-17 00:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3283: <<2025-Apr-17 00:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3285: <<2025-Apr-17 00:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3327: <<2025-Apr-17 00:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3328: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:16:00 2025
Line 3346: <<2025-Apr-17 00:18>> TimeoutError: timed out
Line 3364: <<2025-Apr-17 00:18>> raise ConnectTimeoutError(
Line 3365: <<2025-Apr-17 00:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3377: <<2025-Apr-17 00:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3379: <<2025-Apr-17 00:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3421: <<2025-Apr-17 00:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3422: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:26:00 2025
Line 3440: <<2025-Apr-17 00:28>> TimeoutError: timed out
Line 3458: <<2025-Apr-17 00:28>> raise ConnectTimeoutError(
Line 3459: <<2025-Apr-17 00:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3471: <<2025-Apr-17 00:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3473: <<2025-Apr-17 00:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3515: <<2025-Apr-17 00:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3516: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:36:00 2025
Line 3534: <<2025-Apr-17 00:38>> TimeoutError: timed out
Line 3552: <<2025-Apr-17 00:38>> raise ConnectTimeoutError(
Line 3553: <<2025-Apr-17 00:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3565: <<2025-Apr-17 00:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3567: <<2025-Apr-17 00:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3609: <<2025-Apr-17 00:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3610: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:46:00 2025
Line 3628: <<2025-Apr-17 00:48>> TimeoutError: timed out
Line 3646: <<2025-Apr-17 00:48>> raise ConnectTimeoutError(
Line 3647: <<2025-Apr-17 00:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3659: <<2025-Apr-17 00:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3661: <<2025-Apr-17 00:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3703: <<2025-Apr-17 00:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3704: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:56:00 2025
Line 3722: <<2025-Apr-17 00:58>> TimeoutError: timed out
Line 3740: <<2025-Apr-17 00:58>> raise ConnectTimeoutError(
Line 3741: <<2025-Apr-17 00:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3753: <<2025-Apr-17 00:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3755: <<2025-Apr-17 00:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3797: <<2025-Apr-17 00:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3798: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:06:00 2025
Line 3816: <<2025-Apr-17 01:08>> TimeoutError: timed out
Line 3834: <<2025-Apr-17 01:08>> raise ConnectTimeoutError(
Line 3835: <<2025-Apr-17 01:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3847: <<2025-Apr-17 01:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3849: <<2025-Apr-17 01:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3891: <<2025-Apr-17 01:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3892: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:16:00 2025
Line 3910: <<2025-Apr-17 01:18>> TimeoutError: timed out
Line 3928: <<2025-Apr-17 01:18>> raise ConnectTimeoutError(
Line 3929: <<2025-Apr-17 01:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 3941: <<2025-Apr-17 01:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 3943: <<2025-Apr-17 01:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3985: <<2025-Apr-17 01:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 3986: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:26:00 2025
Line 4004: <<2025-Apr-17 01:28>> TimeoutError: timed out
Line 4022: <<2025-Apr-17 01:28>> raise ConnectTimeoutError(
Line 4023: <<2025-Apr-17 01:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4035: <<2025-Apr-17 01:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4037: <<2025-Apr-17 01:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4079: <<2025-Apr-17 01:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4080: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:36:00 2025
Line 4099: <<2025-Apr-17 01:38>> TimeoutError: timed out
Line 4117: <<2025-Apr-17 01:38>> raise ConnectTimeoutError(
Line 4118: <<2025-Apr-17 01:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4130: <<2025-Apr-17 01:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4132: <<2025-Apr-17 01:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4174: <<2025-Apr-17 01:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4175: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:46:00 2025
Line 4193: <<2025-Apr-17 01:48>> TimeoutError: timed out
Line 4211: <<2025-Apr-17 01:48>> raise ConnectTimeoutError(
Line 4212: <<2025-Apr-17 01:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4224: <<2025-Apr-17 01:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4226: <<2025-Apr-17 01:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4268: <<2025-Apr-17 01:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4269: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:56:00 2025
Line 4287: <<2025-Apr-17 01:58>> TimeoutError: timed out
Line 4305: <<2025-Apr-17 01:58>> raise ConnectTimeoutError(
Line 4306: <<2025-Apr-17 01:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4318: <<2025-Apr-17 01:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4320: <<2025-Apr-17 01:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4362: <<2025-Apr-17 01:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4363: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:06:00 2025
Line 4381: <<2025-Apr-17 02:08>> TimeoutError: timed out
Line 4399: <<2025-Apr-17 02:08>> raise ConnectTimeoutError(
Line 4400: <<2025-Apr-17 02:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4412: <<2025-Apr-17 02:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4414: <<2025-Apr-17 02:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4456: <<2025-Apr-17 02:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4457: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:16:00 2025
Line 4475: <<2025-Apr-17 02:18>> TimeoutError: timed out
Line 4493: <<2025-Apr-17 02:18>> raise ConnectTimeoutError(
Line 4494: <<2025-Apr-17 02:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4506: <<2025-Apr-17 02:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4508: <<2025-Apr-17 02:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4550: <<2025-Apr-17 02:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4551: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:26:00 2025
Line 4569: <<2025-Apr-17 02:28>> TimeoutError: timed out
Line 4587: <<2025-Apr-17 02:28>> raise ConnectTimeoutError(
Line 4588: <<2025-Apr-17 02:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4600: <<2025-Apr-17 02:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4602: <<2025-Apr-17 02:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4644: <<2025-Apr-17 02:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4645: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:36:00 2025
Line 4663: <<2025-Apr-17 02:38>> TimeoutError: timed out
Line 4681: <<2025-Apr-17 02:38>> raise ConnectTimeoutError(
Line 4682: <<2025-Apr-17 02:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4694: <<2025-Apr-17 02:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4696: <<2025-Apr-17 02:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4738: <<2025-Apr-17 02:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4739: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:46:00 2025
Line 4757: <<2025-Apr-17 02:48>> TimeoutError: timed out
Line 4775: <<2025-Apr-17 02:48>> raise ConnectTimeoutError(
Line 4776: <<2025-Apr-17 02:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4788: <<2025-Apr-17 02:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4790: <<2025-Apr-17 02:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4832: <<2025-Apr-17 02:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4833: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:56:00 2025
Line 4851: <<2025-Apr-17 02:58>> TimeoutError: timed out
Line 4869: <<2025-Apr-17 02:58>> raise ConnectTimeoutError(
Line 4870: <<2025-Apr-17 02:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4882: <<2025-Apr-17 02:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4884: <<2025-Apr-17 02:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4926: <<2025-Apr-17 02:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 4927: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:06:00 2025
Line 4945: <<2025-Apr-17 03:08>> TimeoutError: timed out
Line 4963: <<2025-Apr-17 03:08>> raise ConnectTimeoutError(
Line 4964: <<2025-Apr-17 03:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 4976: <<2025-Apr-17 03:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 4978: <<2025-Apr-17 03:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5020: <<2025-Apr-17 03:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5021: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:16:00 2025
Line 5039: <<2025-Apr-17 03:18>> TimeoutError: timed out
Line 5057: <<2025-Apr-17 03:18>> raise ConnectTimeoutError(
Line 5058: <<2025-Apr-17 03:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5070: <<2025-Apr-17 03:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5072: <<2025-Apr-17 03:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5114: <<2025-Apr-17 03:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5115: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:26:00 2025
Line 5133: <<2025-Apr-17 03:28>> TimeoutError: timed out
Line 5151: <<2025-Apr-17 03:28>> raise ConnectTimeoutError(
Line 5152: <<2025-Apr-17 03:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5164: <<2025-Apr-17 03:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5166: <<2025-Apr-17 03:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5208: <<2025-Apr-17 03:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5209: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:36:00 2025
Line 5227: <<2025-Apr-17 03:38>> TimeoutError: timed out
Line 5245: <<2025-Apr-17 03:38>> raise ConnectTimeoutError(
Line 5246: <<2025-Apr-17 03:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5258: <<2025-Apr-17 03:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5260: <<2025-Apr-17 03:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5302: <<2025-Apr-17 03:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5303: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:46:00 2025
Line 5321: <<2025-Apr-17 03:48>> TimeoutError: timed out
Line 5339: <<2025-Apr-17 03:48>> raise ConnectTimeoutError(
Line 5340: <<2025-Apr-17 03:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5352: <<2025-Apr-17 03:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5354: <<2025-Apr-17 03:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5396: <<2025-Apr-17 03:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5397: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:56:00 2025
Line 5415: <<2025-Apr-17 03:58>> TimeoutError: timed out
Line 5433: <<2025-Apr-17 03:58>> raise ConnectTimeoutError(
Line 5434: <<2025-Apr-17 03:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5446: <<2025-Apr-17 03:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5448: <<2025-Apr-17 03:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5490: <<2025-Apr-17 03:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5491: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:06:00 2025
Line 5509: <<2025-Apr-17 04:08>> TimeoutError: timed out
Line 5527: <<2025-Apr-17 04:08>> raise ConnectTimeoutError(
Line 5528: <<2025-Apr-17 04:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5540: <<2025-Apr-17 04:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5542: <<2025-Apr-17 04:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5584: <<2025-Apr-17 04:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5585: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:16:00 2025
Line 5603: <<2025-Apr-17 04:18>> TimeoutError: timed out
Line 5621: <<2025-Apr-17 04:18>> raise ConnectTimeoutError(
Line 5622: <<2025-Apr-17 04:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5634: <<2025-Apr-17 04:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5636: <<2025-Apr-17 04:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5678: <<2025-Apr-17 04:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5679: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:26:00 2025
Line 5697: <<2025-Apr-17 04:28>> TimeoutError: timed out
Line 5715: <<2025-Apr-17 04:28>> raise ConnectTimeoutError(
Line 5716: <<2025-Apr-17 04:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5728: <<2025-Apr-17 04:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5730: <<2025-Apr-17 04:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5772: <<2025-Apr-17 04:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5773: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:36:00 2025
Line 5791: <<2025-Apr-17 04:38>> TimeoutError: timed out
Line 5809: <<2025-Apr-17 04:38>> raise ConnectTimeoutError(
Line 5810: <<2025-Apr-17 04:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5822: <<2025-Apr-17 04:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5824: <<2025-Apr-17 04:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5866: <<2025-Apr-17 04:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5867: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:46:00 2025
Line 5885: <<2025-Apr-17 04:48>> TimeoutError: timed out
Line 5903: <<2025-Apr-17 04:48>> raise ConnectTimeoutError(
Line 5904: <<2025-Apr-17 04:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 5916: <<2025-Apr-17 04:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 5918: <<2025-Apr-17 04:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5960: <<2025-Apr-17 04:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 5961: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:56:00 2025
Line 5979: <<2025-Apr-17 04:58>> TimeoutError: timed out
Line 5997: <<2025-Apr-17 04:58>> raise ConnectTimeoutError(
Line 5998: <<2025-Apr-17 04:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 6010: <<2025-Apr-17 04:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 6012: <<2025-Apr-17 04:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6054: <<2025-Apr-17 04:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6055: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:06:00 2025
Line 6073: <<2025-Apr-17 05:08>> TimeoutError: timed out
Line 6091: <<2025-Apr-17 05:08>> raise ConnectTimeoutError(
Line 6092: <<2025-Apr-17 05:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 6104: <<2025-Apr-17 05:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 6106: <<2025-Apr-17 05:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6148: <<2025-Apr-17 05:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6149: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:16:00 2025
Line 6167: <<2025-Apr-17 05:18>> TimeoutError: timed out
Line 6185: <<2025-Apr-17 05:18>> raise ConnectTimeoutError(
Line 6186: <<2025-Apr-17 05:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 6198: <<2025-Apr-17 05:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 6200: <<2025-Apr-17 05:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6242: <<2025-Apr-17 05:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6243: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:26:00 2025
Line 6261: <<2025-Apr-17 05:28>> TimeoutError: timed out
Line 6279: <<2025-Apr-17 05:28>> raise ConnectTimeoutError(
Line 6280: <<2025-Apr-17 05:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 6292: <<2025-Apr-17 05:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 6294: <<2025-Apr-17 05:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6336: <<2025-Apr-17 05:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6337: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:36:00 2025
Line 6355: <<2025-Apr-17 05:38>> TimeoutError: timed out
Line 6373: <<2025-Apr-17 05:38>> raise ConnectTimeoutError(
Line 6374: <<2025-Apr-17 05:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 6386: <<2025-Apr-17 05:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 6388: <<2025-Apr-17 05:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6430: <<2025-Apr-17 05:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6431: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:46:00 2025
Line 6449: <<2025-Apr-17 05:48>> TimeoutError: timed out
Line 6467: <<2025-Apr-17 05:48>> raise ConnectTimeoutError(
Line 6468: <<2025-Apr-17 05:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 6480: <<2025-Apr-17 05:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 6482: <<2025-Apr-17 05:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6524: <<2025-Apr-17 05:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6525: WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:56:00 2025
Line 6543: <<2025-Apr-17 05:58>> TimeoutError: timed out
Line 6561: <<2025-Apr-17 05:58>> raise ConnectTimeoutError(
Line 6562: <<2025-Apr-17 05:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
Line 6574: <<2025-Apr-17 05:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
Line 6576: <<2025-Apr-17 05:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
Line 6618: <<2025-Apr-17 05:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))

File contents:

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:16>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:21>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:26>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:31>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:36>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:41>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:46>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:51>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 15:56>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:01>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:06>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:11>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:16>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:21>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:26>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:31>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:36>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:41>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:46>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:51>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 16:56>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:01>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:06>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:11>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:16>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:21>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:26>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:31>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:36>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:41>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:46>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:51>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 17:56>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:01>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:06>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:11>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 18:12>> Traceback (most recent call last):
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 534, in _make_request
<<2025-Apr-16 18:12>> response = conn.getresponse()
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 516, in getresponse
<<2025-Apr-16 18:12>> httplib_response = super().getresponse()
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1428, in getresponse
<<2025-Apr-16 18:12>> response.begin()
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 331, in begin
<<2025-Apr-16 18:12>> version, status, reason = self._read_status()
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 292, in _read_status
<<2025-Apr-16 18:12>> line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/socket.py", line 720, in readinto
<<2025-Apr-16 18:12>> return self._sock.recv_into(b)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1251, in recv_into
<<2025-Apr-16 18:12>> return self.read(nbytes, buffer)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1103, in read
<<2025-Apr-16 18:12>> return self._sslobj.read(len, buffer)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> TimeoutError: The read operation timed out
<<2025-Apr-16 18:12>>
<<2025-Apr-16 18:12>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 18:12>>
<<2025-Apr-16 18:12>> Traceback (most recent call last):
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 18:12>> resp = conn.urlopen(
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 18:12>> retries = retries.increment(
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment
<<2025-Apr-16 18:12>> raise reraise(type(error), error, _stacktrace)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise
<<2025-Apr-16 18:12>> raise value
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 18:12>> response = self._make_request(
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request
<<2025-Apr-16 18:12>> self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
<<2025-Apr-16 18:12>> raise ReadTimeoutError(
<<2025-Apr-16 18:12>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Read timed out. (read timeout=30)
<<2025-Apr-16 18:12>>
<<2025-Apr-16 18:12>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 18:12>>
<<2025-Apr-16 18:12>> Traceback (most recent call last):
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 18:12>> main()
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 18:12>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 18:12>> cmds = commands.get_cmds(
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 18:12>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 18:12>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 18:12>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 18:12>> html = get_occweb_page(
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 18:12>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 18:12>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 18:12>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 18:12>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 18:12>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 18:12>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:12>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 713, in send
<<2025-Apr-16 18:12>> raise ReadTimeout(e, request=request)
<<2025-Apr-16 18:12>> requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Read timed out. (read timeout=30)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:16>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:21>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:26>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:31>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:36>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:41>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:46>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:51>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 18:57>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)
<<2025-Apr-16 18:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:106:22:56:00.000&tstop=2025:109:14:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 18:58>> Traceback (most recent call last):
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 18:58>> sock = connection.create_connection(
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 18:58>> raise err
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 18:58>> sock.connect(sa)
<<2025-Apr-16 18:58>> TimeoutError: timed out
<<2025-Apr-16 18:58>>
<<2025-Apr-16 18:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 18:58>>
<<2025-Apr-16 18:58>> Traceback (most recent call last):
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 18:58>> response = self._make_request(
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 18:58>> raise new_e
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 18:58>> self._validate_conn(conn)
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 18:58>> conn.connect()
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 18:58>> self.sock = sock = self._new_conn()
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 18:58>> raise ConnectTimeoutError(
<<2025-Apr-16 18:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 18:58>>
<<2025-Apr-16 18:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 18:58>>
<<2025-Apr-16 18:58>> Traceback (most recent call last):
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 18:58>> resp = conn.urlopen(
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 18:58>> retries = retries.increment(
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 18:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 18:58>>
<<2025-Apr-16 18:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 18:58>>
<<2025-Apr-16 18:58>> Traceback (most recent call last):
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 18:58>> main()
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 18:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 18:58>> cmds = commands.get_cmds(
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 18:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 18:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 18:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 18:58>> html = get_occweb_page(
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 18:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 18:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 18:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 18:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 18:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 18:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 18:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 18:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 18:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 19:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:106:23:06:00.000&tstop=2025:109:14:36:00.000)
<<2025-Apr-16 19:07>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 19:08>> Traceback (most recent call last):
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 19:08>> sock = connection.create_connection(
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 19:08>> raise err
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 19:08>> sock.connect(sa)
<<2025-Apr-16 19:08>> TimeoutError: timed out
<<2025-Apr-16 19:08>>
<<2025-Apr-16 19:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:08>>
<<2025-Apr-16 19:08>> Traceback (most recent call last):
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 19:08>> response = self._make_request(
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 19:08>> raise new_e
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 19:08>> self._validate_conn(conn)
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 19:08>> conn.connect()
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 19:08>> self.sock = sock = self._new_conn()
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 19:08>> raise ConnectTimeoutError(
<<2025-Apr-16 19:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 19:08>>
<<2025-Apr-16 19:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:08>>
<<2025-Apr-16 19:08>> Traceback (most recent call last):
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 19:08>> resp = conn.urlopen(
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 19:08>> retries = retries.increment(
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 19:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 19:08>>
<<2025-Apr-16 19:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 19:08>>
<<2025-Apr-16 19:08>> Traceback (most recent call last):
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 19:08>> main()
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 19:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 19:08>> cmds = commands.get_cmds(
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 19:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 19:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 19:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 19:08>> html = get_occweb_page(
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 19:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 19:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 19:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 19:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 19:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 19:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 19:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 19:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 19:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:106:23:16:00.000&tstop=2025:109:14:46:00.000)
<<2025-Apr-16 19:17>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 19:18>> Traceback (most recent call last):
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 19:18>> sock = connection.create_connection(
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 19:18>> raise err
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 19:18>> sock.connect(sa)
<<2025-Apr-16 19:18>> TimeoutError: timed out
<<2025-Apr-16 19:18>>
<<2025-Apr-16 19:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:18>>
<<2025-Apr-16 19:18>> Traceback (most recent call last):
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 19:18>> response = self._make_request(
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 19:18>> raise new_e
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 19:18>> self._validate_conn(conn)
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 19:18>> conn.connect()
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 19:18>> self.sock = sock = self._new_conn()
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 19:18>> raise ConnectTimeoutError(
<<2025-Apr-16 19:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 19:18>>
<<2025-Apr-16 19:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:18>>
<<2025-Apr-16 19:18>> Traceback (most recent call last):
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 19:18>> resp = conn.urlopen(
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 19:18>> retries = retries.increment(
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 19:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 19:18>>
<<2025-Apr-16 19:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 19:18>>
<<2025-Apr-16 19:18>> Traceback (most recent call last):
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 19:18>> main()
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 19:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 19:18>> cmds = commands.get_cmds(
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 19:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 19:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 19:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 19:18>> html = get_occweb_page(
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 19:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 19:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 19:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 19:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 19:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 19:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 19:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 19:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 19:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:106:23:26:00.000&tstop=2025:109:14:56:00.000)
<<2025-Apr-16 19:27>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 19:28>> Traceback (most recent call last):
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 19:28>> sock = connection.create_connection(
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 19:28>> raise err
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 19:28>> sock.connect(sa)
<<2025-Apr-16 19:28>> TimeoutError: timed out
<<2025-Apr-16 19:28>>
<<2025-Apr-16 19:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:28>>
<<2025-Apr-16 19:28>> Traceback (most recent call last):
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 19:28>> response = self._make_request(
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 19:28>> raise new_e
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 19:28>> self._validate_conn(conn)
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 19:28>> conn.connect()
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 19:28>> self.sock = sock = self._new_conn()
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 19:28>> raise ConnectTimeoutError(
<<2025-Apr-16 19:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 19:28>>
<<2025-Apr-16 19:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:28>>
<<2025-Apr-16 19:28>> Traceback (most recent call last):
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 19:28>> resp = conn.urlopen(
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 19:28>> retries = retries.increment(
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 19:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 19:28>>
<<2025-Apr-16 19:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 19:28>>
<<2025-Apr-16 19:28>> Traceback (most recent call last):
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 19:28>> main()
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 19:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 19:28>> cmds = commands.get_cmds(
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 19:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 19:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 19:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 19:28>> html = get_occweb_page(
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 19:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 19:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 19:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 19:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 19:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 19:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 19:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 19:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 19:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:106:23:36:00.000&tstop=2025:109:15:06:00.000)
<<2025-Apr-16 19:37>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 19:38>> Traceback (most recent call last):
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 19:38>> sock = connection.create_connection(
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 19:38>> raise err
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 19:38>> sock.connect(sa)
<<2025-Apr-16 19:38>> TimeoutError: timed out
<<2025-Apr-16 19:38>>
<<2025-Apr-16 19:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:38>>
<<2025-Apr-16 19:38>> Traceback (most recent call last):
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 19:38>> response = self._make_request(
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 19:38>> raise new_e
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 19:38>> self._validate_conn(conn)
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 19:38>> conn.connect()
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 19:38>> self.sock = sock = self._new_conn()
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 19:38>> raise ConnectTimeoutError(
<<2025-Apr-16 19:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 19:38>>
<<2025-Apr-16 19:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:38>>
<<2025-Apr-16 19:38>> Traceback (most recent call last):
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 19:38>> resp = conn.urlopen(
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 19:38>> retries = retries.increment(
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 19:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 19:38>>
<<2025-Apr-16 19:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 19:38>>
<<2025-Apr-16 19:38>> Traceback (most recent call last):
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 19:38>> main()
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 19:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 19:38>> cmds = commands.get_cmds(
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 19:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 19:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 19:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 19:38>> html = get_occweb_page(
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 19:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 19:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 19:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 19:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 19:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 19:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 19:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 19:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 19:47>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)
<<2025-Apr-16 19:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:106:23:46:00.000&tstop=2025:109:15:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 19:48>> Traceback (most recent call last):
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 19:48>> sock = connection.create_connection(
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 19:48>> raise err
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 19:48>> sock.connect(sa)
<<2025-Apr-16 19:48>> TimeoutError: timed out
<<2025-Apr-16 19:48>>
<<2025-Apr-16 19:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:48>>
<<2025-Apr-16 19:48>> Traceback (most recent call last):
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 19:48>> response = self._make_request(
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 19:48>> raise new_e
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 19:48>> self._validate_conn(conn)
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 19:48>> conn.connect()
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 19:48>> self.sock = sock = self._new_conn()
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 19:48>> raise ConnectTimeoutError(
<<2025-Apr-16 19:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 19:48>>
<<2025-Apr-16 19:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:48>>
<<2025-Apr-16 19:48>> Traceback (most recent call last):
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 19:48>> resp = conn.urlopen(
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 19:48>> retries = retries.increment(
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 19:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 19:48>>
<<2025-Apr-16 19:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 19:48>>
<<2025-Apr-16 19:48>> Traceback (most recent call last):
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 19:48>> main()
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 19:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 19:48>> cmds = commands.get_cmds(
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 19:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 19:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 19:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 19:48>> html = get_occweb_page(
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 19:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 19:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 19:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 19:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 19:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 19:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 19:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 19:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 19:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 19:57>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)
<<2025-Apr-16 19:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:106:23:56:00.000&tstop=2025:109:15:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 19:58>> Traceback (most recent call last):
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 19:58>> sock = connection.create_connection(
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 19:58>> raise err
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 19:58>> sock.connect(sa)
<<2025-Apr-16 19:58>> TimeoutError: timed out
<<2025-Apr-16 19:58>>
<<2025-Apr-16 19:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:58>>
<<2025-Apr-16 19:58>> Traceback (most recent call last):
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 19:58>> response = self._make_request(
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 19:58>> raise new_e
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 19:58>> self._validate_conn(conn)
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 19:58>> conn.connect()
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 19:58>> self.sock = sock = self._new_conn()
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 19:58>> raise ConnectTimeoutError(
<<2025-Apr-16 19:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 19:58>>
<<2025-Apr-16 19:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 19:58>>
<<2025-Apr-16 19:58>> Traceback (most recent call last):
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 19:58>> resp = conn.urlopen(
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 19:58>> retries = retries.increment(
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 19:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 19:58>>
<<2025-Apr-16 19:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 19:58>>
<<2025-Apr-16 19:58>> Traceback (most recent call last):
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 19:58>> main()
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 19:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 19:58>> cmds = commands.get_cmds(
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 19:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 19:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 19:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 19:58>> html = get_occweb_page(
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 19:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 19:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 19:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 19:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 19:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 19:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 19:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 19:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 19:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 20:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:00:06:00.000&tstop=2025:109:15:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 20:08>> Traceback (most recent call last):
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 20:08>> sock = connection.create_connection(
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 20:08>> raise err
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 20:08>> sock.connect(sa)
<<2025-Apr-16 20:08>> TimeoutError: timed out
<<2025-Apr-16 20:08>>
<<2025-Apr-16 20:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:08>>
<<2025-Apr-16 20:08>> Traceback (most recent call last):
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 20:08>> response = self._make_request(
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 20:08>> raise new_e
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 20:08>> self._validate_conn(conn)
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 20:08>> conn.connect()
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 20:08>> self.sock = sock = self._new_conn()
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 20:08>> raise ConnectTimeoutError(
<<2025-Apr-16 20:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 20:08>>
<<2025-Apr-16 20:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:08>>
<<2025-Apr-16 20:08>> Traceback (most recent call last):
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 20:08>> resp = conn.urlopen(
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 20:08>> retries = retries.increment(
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 20:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 20:08>>
<<2025-Apr-16 20:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 20:08>>
<<2025-Apr-16 20:08>> Traceback (most recent call last):
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 20:08>> main()
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 20:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 20:08>> cmds = commands.get_cmds(
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 20:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 20:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 20:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 20:08>> html = get_occweb_page(
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 20:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 20:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 20:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 20:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 20:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 20:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 20:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 20:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 20:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:00:16:00.000&tstop=2025:109:15:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 20:18>> Traceback (most recent call last):
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 20:18>> sock = connection.create_connection(
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 20:18>> raise err
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 20:18>> sock.connect(sa)
<<2025-Apr-16 20:18>> TimeoutError: timed out
<<2025-Apr-16 20:18>>
<<2025-Apr-16 20:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:18>>
<<2025-Apr-16 20:18>> Traceback (most recent call last):
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 20:18>> response = self._make_request(
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 20:18>> raise new_e
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 20:18>> self._validate_conn(conn)
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 20:18>> conn.connect()
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 20:18>> self.sock = sock = self._new_conn()
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 20:18>> raise ConnectTimeoutError(
<<2025-Apr-16 20:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 20:18>>
<<2025-Apr-16 20:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:18>>
<<2025-Apr-16 20:18>> Traceback (most recent call last):
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 20:18>> resp = conn.urlopen(
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 20:18>> retries = retries.increment(
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 20:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 20:18>>
<<2025-Apr-16 20:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 20:18>>
<<2025-Apr-16 20:18>> Traceback (most recent call last):
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 20:18>> main()
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 20:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 20:18>> cmds = commands.get_cmds(
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 20:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 20:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 20:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 20:18>> html = get_occweb_page(
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 20:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 20:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 20:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 20:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 20:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 20:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 20:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 20:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 20:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:00:26:00.000&tstop=2025:109:15:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 20:28>> Traceback (most recent call last):
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 20:28>> sock = connection.create_connection(
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 20:28>> raise err
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 20:28>> sock.connect(sa)
<<2025-Apr-16 20:28>> TimeoutError: timed out
<<2025-Apr-16 20:28>>
<<2025-Apr-16 20:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:28>>
<<2025-Apr-16 20:28>> Traceback (most recent call last):
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 20:28>> response = self._make_request(
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 20:28>> raise new_e
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 20:28>> self._validate_conn(conn)
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 20:28>> conn.connect()
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 20:28>> self.sock = sock = self._new_conn()
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 20:28>> raise ConnectTimeoutError(
<<2025-Apr-16 20:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 20:28>>
<<2025-Apr-16 20:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:28>>
<<2025-Apr-16 20:28>> Traceback (most recent call last):
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 20:28>> resp = conn.urlopen(
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 20:28>> retries = retries.increment(
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 20:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 20:28>>
<<2025-Apr-16 20:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 20:28>>
<<2025-Apr-16 20:28>> Traceback (most recent call last):
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 20:28>> main()
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 20:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 20:28>> cmds = commands.get_cmds(
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 20:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 20:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 20:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 20:28>> html = get_occweb_page(
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 20:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 20:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 20:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 20:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 20:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 20:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 20:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 20:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 20:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:00:36:01.000&tstop=2025:109:16:06:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 20:38>> Traceback (most recent call last):
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 20:38>> sock = connection.create_connection(
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 20:38>> raise err
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 20:38>> sock.connect(sa)
<<2025-Apr-16 20:38>> TimeoutError: timed out
<<2025-Apr-16 20:38>>
<<2025-Apr-16 20:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:38>>
<<2025-Apr-16 20:38>> Traceback (most recent call last):
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 20:38>> response = self._make_request(
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 20:38>> raise new_e
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 20:38>> self._validate_conn(conn)
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 20:38>> conn.connect()
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 20:38>> self.sock = sock = self._new_conn()
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 20:38>> raise ConnectTimeoutError(
<<2025-Apr-16 20:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 20:38>>
<<2025-Apr-16 20:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:38>>
<<2025-Apr-16 20:38>> Traceback (most recent call last):
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 20:38>> resp = conn.urlopen(
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 20:38>> retries = retries.increment(
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 20:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 20:38>>
<<2025-Apr-16 20:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 20:38>>
<<2025-Apr-16 20:38>> Traceback (most recent call last):
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 20:38>> main()
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 20:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 20:38>> cmds = commands.get_cmds(
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 20:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 20:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 20:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 20:38>> html = get_occweb_page(
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 20:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 20:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 20:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 20:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 20:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 20:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 20:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 20:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 20:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:00:46:01.000&tstop=2025:109:16:16:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 20:48>> Traceback (most recent call last):
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 20:48>> sock = connection.create_connection(
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 20:48>> raise err
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 20:48>> sock.connect(sa)
<<2025-Apr-16 20:48>> TimeoutError: timed out
<<2025-Apr-16 20:48>>
<<2025-Apr-16 20:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:48>>
<<2025-Apr-16 20:48>> Traceback (most recent call last):
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 20:48>> response = self._make_request(
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 20:48>> raise new_e
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 20:48>> self._validate_conn(conn)
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 20:48>> conn.connect()
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 20:48>> self.sock = sock = self._new_conn()
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 20:48>> raise ConnectTimeoutError(
<<2025-Apr-16 20:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 20:48>>
<<2025-Apr-16 20:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:48>>
<<2025-Apr-16 20:48>> Traceback (most recent call last):
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 20:48>> resp = conn.urlopen(
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 20:48>> retries = retries.increment(
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 20:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 20:48>>
<<2025-Apr-16 20:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 20:48>>
<<2025-Apr-16 20:48>> Traceback (most recent call last):
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 20:48>> main()
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 20:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 20:48>> cmds = commands.get_cmds(
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 20:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 20:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 20:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 20:48>> html = get_occweb_page(
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 20:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 20:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 20:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 20:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 20:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 20:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 20:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 20:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 20:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 20:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:00:56:01.000&tstop=2025:109:16:26:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 20:58>> Traceback (most recent call last):
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 20:58>> sock = connection.create_connection(
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 20:58>> raise err
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 20:58>> sock.connect(sa)
<<2025-Apr-16 20:58>> TimeoutError: timed out
<<2025-Apr-16 20:58>>
<<2025-Apr-16 20:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:58>>
<<2025-Apr-16 20:58>> Traceback (most recent call last):
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 20:58>> response = self._make_request(
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 20:58>> raise new_e
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 20:58>> self._validate_conn(conn)
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 20:58>> conn.connect()
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 20:58>> self.sock = sock = self._new_conn()
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 20:58>> raise ConnectTimeoutError(
<<2025-Apr-16 20:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 20:58>>
<<2025-Apr-16 20:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 20:58>>
<<2025-Apr-16 20:58>> Traceback (most recent call last):
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 20:58>> resp = conn.urlopen(
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 20:58>> retries = retries.increment(
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 20:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 20:58>>
<<2025-Apr-16 20:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 20:58>>
<<2025-Apr-16 20:58>> Traceback (most recent call last):
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 20:58>> main()
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 20:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 20:58>> cmds = commands.get_cmds(
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 20:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 20:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 20:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 20:58>> html = get_occweb_page(
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 20:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 20:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 20:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 20:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 20:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 20:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 20:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 20:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 20:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 21:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:01:06:00.000&tstop=2025:109:16:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 21:08>> Traceback (most recent call last):
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 21:08>> sock = connection.create_connection(
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 21:08>> raise err
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 21:08>> sock.connect(sa)
<<2025-Apr-16 21:08>> TimeoutError: timed out
<<2025-Apr-16 21:08>>
<<2025-Apr-16 21:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:08>>
<<2025-Apr-16 21:08>> Traceback (most recent call last):
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 21:08>> response = self._make_request(
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 21:08>> raise new_e
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 21:08>> self._validate_conn(conn)
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 21:08>> conn.connect()
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 21:08>> self.sock = sock = self._new_conn()
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 21:08>> raise ConnectTimeoutError(
<<2025-Apr-16 21:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 21:08>>
<<2025-Apr-16 21:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:08>>
<<2025-Apr-16 21:08>> Traceback (most recent call last):
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 21:08>> resp = conn.urlopen(
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 21:08>> retries = retries.increment(
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 21:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 21:08>>
<<2025-Apr-16 21:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 21:08>>
<<2025-Apr-16 21:08>> Traceback (most recent call last):
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 21:08>> main()
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 21:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 21:08>> cmds = commands.get_cmds(
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 21:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 21:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 21:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 21:08>> html = get_occweb_page(
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 21:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 21:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 21:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 21:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 21:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 21:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 21:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 21:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 21:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:01:16:00.000&tstop=2025:109:16:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 21:18>> Traceback (most recent call last):
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 21:18>> sock = connection.create_connection(
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 21:18>> raise err
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 21:18>> sock.connect(sa)
<<2025-Apr-16 21:18>> TimeoutError: timed out
<<2025-Apr-16 21:18>>
<<2025-Apr-16 21:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:18>>
<<2025-Apr-16 21:18>> Traceback (most recent call last):
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 21:18>> response = self._make_request(
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 21:18>> raise new_e
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 21:18>> self._validate_conn(conn)
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 21:18>> conn.connect()
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 21:18>> self.sock = sock = self._new_conn()
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 21:18>> raise ConnectTimeoutError(
<<2025-Apr-16 21:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 21:18>>
<<2025-Apr-16 21:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:18>>
<<2025-Apr-16 21:18>> Traceback (most recent call last):
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 21:18>> resp = conn.urlopen(
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 21:18>> retries = retries.increment(
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 21:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 21:18>>
<<2025-Apr-16 21:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 21:18>>
<<2025-Apr-16 21:18>> Traceback (most recent call last):
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 21:18>> main()
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 21:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 21:18>> cmds = commands.get_cmds(
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 21:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 21:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 21:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 21:18>> html = get_occweb_page(
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 21:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 21:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 21:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 21:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 21:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 21:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 21:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 21:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 21:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:01:26:00.000&tstop=2025:109:16:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 21:28>> Traceback (most recent call last):
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 21:28>> sock = connection.create_connection(
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 21:28>> raise err
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 21:28>> sock.connect(sa)
<<2025-Apr-16 21:28>> TimeoutError: timed out
<<2025-Apr-16 21:28>>
<<2025-Apr-16 21:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:28>>
<<2025-Apr-16 21:28>> Traceback (most recent call last):
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 21:28>> response = self._make_request(
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 21:28>> raise new_e
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 21:28>> self._validate_conn(conn)
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 21:28>> conn.connect()
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 21:28>> self.sock = sock = self._new_conn()
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 21:28>> raise ConnectTimeoutError(
<<2025-Apr-16 21:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 21:28>>
<<2025-Apr-16 21:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:28>>
<<2025-Apr-16 21:28>> Traceback (most recent call last):
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 21:28>> resp = conn.urlopen(
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 21:28>> retries = retries.increment(
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 21:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 21:28>>
<<2025-Apr-16 21:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 21:28>>
<<2025-Apr-16 21:28>> Traceback (most recent call last):
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 21:28>> main()
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 21:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 21:28>> cmds = commands.get_cmds(
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 21:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 21:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 21:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 21:28>> html = get_occweb_page(
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 21:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 21:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 21:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 21:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 21:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 21:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 21:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 21:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 21:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:01:36:00.000&tstop=2025:109:17:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 21:38>> Traceback (most recent call last):
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 21:38>> sock = connection.create_connection(
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 21:38>> raise err
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 21:38>> sock.connect(sa)
<<2025-Apr-16 21:38>> TimeoutError: timed out
<<2025-Apr-16 21:38>>
<<2025-Apr-16 21:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:38>>
<<2025-Apr-16 21:38>> Traceback (most recent call last):
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 21:38>> response = self._make_request(
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 21:38>> raise new_e
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 21:38>> self._validate_conn(conn)
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 21:38>> conn.connect()
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 21:38>> self.sock = sock = self._new_conn()
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 21:38>> raise ConnectTimeoutError(
<<2025-Apr-16 21:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 21:38>>
<<2025-Apr-16 21:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:38>>
<<2025-Apr-16 21:38>> Traceback (most recent call last):
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 21:38>> resp = conn.urlopen(
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 21:38>> retries = retries.increment(
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 21:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 21:38>>
<<2025-Apr-16 21:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 21:38>>
<<2025-Apr-16 21:38>> Traceback (most recent call last):
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 21:38>> main()
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 21:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 21:38>> cmds = commands.get_cmds(
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 21:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 21:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 21:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 21:38>> html = get_occweb_page(
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 21:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 21:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 21:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 21:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 21:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 21:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 21:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 21:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 21:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:01:46:00.000&tstop=2025:109:17:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 21:48>> Traceback (most recent call last):
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 21:48>> sock = connection.create_connection(
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 21:48>> raise err
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 21:48>> sock.connect(sa)
<<2025-Apr-16 21:48>> TimeoutError: timed out
<<2025-Apr-16 21:48>>
<<2025-Apr-16 21:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:48>>
<<2025-Apr-16 21:48>> Traceback (most recent call last):
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 21:48>> response = self._make_request(
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 21:48>> raise new_e
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 21:48>> self._validate_conn(conn)
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 21:48>> conn.connect()
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 21:48>> self.sock = sock = self._new_conn()
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 21:48>> raise ConnectTimeoutError(
<<2025-Apr-16 21:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 21:48>>
<<2025-Apr-16 21:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:48>>
<<2025-Apr-16 21:48>> Traceback (most recent call last):
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 21:48>> resp = conn.urlopen(
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 21:48>> retries = retries.increment(
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 21:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 21:48>>
<<2025-Apr-16 21:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 21:48>>
<<2025-Apr-16 21:48>> Traceback (most recent call last):
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 21:48>> main()
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 21:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 21:48>> cmds = commands.get_cmds(
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 21:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 21:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 21:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 21:48>> html = get_occweb_page(
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 21:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 21:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 21:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 21:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 21:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 21:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 21:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 21:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 21:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 21:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:01:56:00.000&tstop=2025:109:17:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 21:58>> Traceback (most recent call last):
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 21:58>> sock = connection.create_connection(
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 21:58>> raise err
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 21:58>> sock.connect(sa)
<<2025-Apr-16 21:58>> TimeoutError: timed out
<<2025-Apr-16 21:58>>
<<2025-Apr-16 21:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:58>>
<<2025-Apr-16 21:58>> Traceback (most recent call last):
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 21:58>> response = self._make_request(
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 21:58>> raise new_e
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 21:58>> self._validate_conn(conn)
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 21:58>> conn.connect()
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 21:58>> self.sock = sock = self._new_conn()
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 21:58>> raise ConnectTimeoutError(
<<2025-Apr-16 21:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 21:58>>
<<2025-Apr-16 21:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 21:58>>
<<2025-Apr-16 21:58>> Traceback (most recent call last):
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 21:58>> resp = conn.urlopen(
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 21:58>> retries = retries.increment(
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 21:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 21:58>>
<<2025-Apr-16 21:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 21:58>>
<<2025-Apr-16 21:58>> Traceback (most recent call last):
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 21:58>> main()
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 21:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 21:58>> cmds = commands.get_cmds(
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 21:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 21:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 21:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 21:58>> html = get_occweb_page(
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 21:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 21:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 21:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 21:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 21:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 21:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 21:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 21:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 21:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 22:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:02:06:00.000&tstop=2025:109:17:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 22:08>> Traceback (most recent call last):
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 22:08>> sock = connection.create_connection(
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 22:08>> raise err
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 22:08>> sock.connect(sa)
<<2025-Apr-16 22:08>> TimeoutError: timed out
<<2025-Apr-16 22:08>>
<<2025-Apr-16 22:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:08>>
<<2025-Apr-16 22:08>> Traceback (most recent call last):
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 22:08>> response = self._make_request(
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 22:08>> raise new_e
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 22:08>> self._validate_conn(conn)
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 22:08>> conn.connect()
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 22:08>> self.sock = sock = self._new_conn()
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 22:08>> raise ConnectTimeoutError(
<<2025-Apr-16 22:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 22:08>>
<<2025-Apr-16 22:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:08>>
<<2025-Apr-16 22:08>> Traceback (most recent call last):
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 22:08>> resp = conn.urlopen(
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 22:08>> retries = retries.increment(
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 22:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 22:08>>
<<2025-Apr-16 22:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 22:08>>
<<2025-Apr-16 22:08>> Traceback (most recent call last):
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 22:08>> main()
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 22:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 22:08>> cmds = commands.get_cmds(
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 22:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 22:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 22:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 22:08>> html = get_occweb_page(
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 22:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 22:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 22:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 22:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 22:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 22:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 22:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 22:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 22:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:02:16:00.000&tstop=2025:109:17:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 22:18>> Traceback (most recent call last):
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 22:18>> sock = connection.create_connection(
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 22:18>> raise err
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 22:18>> sock.connect(sa)
<<2025-Apr-16 22:18>> TimeoutError: timed out
<<2025-Apr-16 22:18>>
<<2025-Apr-16 22:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:18>>
<<2025-Apr-16 22:18>> Traceback (most recent call last):
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 22:18>> response = self._make_request(
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 22:18>> raise new_e
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 22:18>> self._validate_conn(conn)
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 22:18>> conn.connect()
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 22:18>> self.sock = sock = self._new_conn()
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 22:18>> raise ConnectTimeoutError(
<<2025-Apr-16 22:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 22:18>>
<<2025-Apr-16 22:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:18>>
<<2025-Apr-16 22:18>> Traceback (most recent call last):
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 22:18>> resp = conn.urlopen(
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 22:18>> retries = retries.increment(
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 22:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 22:18>>
<<2025-Apr-16 22:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 22:18>>
<<2025-Apr-16 22:18>> Traceback (most recent call last):
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 22:18>> main()
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 22:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 22:18>> cmds = commands.get_cmds(
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 22:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 22:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 22:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 22:18>> html = get_occweb_page(
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 22:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 22:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 22:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 22:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 22:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 22:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 22:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 22:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 22:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:02:26:00.000&tstop=2025:109:17:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 22:28>> Traceback (most recent call last):
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 22:28>> sock = connection.create_connection(
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 22:28>> raise err
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 22:28>> sock.connect(sa)
<<2025-Apr-16 22:28>> TimeoutError: timed out
<<2025-Apr-16 22:28>>
<<2025-Apr-16 22:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:28>>
<<2025-Apr-16 22:28>> Traceback (most recent call last):
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 22:28>> response = self._make_request(
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 22:28>> raise new_e
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 22:28>> self._validate_conn(conn)
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 22:28>> conn.connect()
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 22:28>> self.sock = sock = self._new_conn()
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 22:28>> raise ConnectTimeoutError(
<<2025-Apr-16 22:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 22:28>>
<<2025-Apr-16 22:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:28>>
<<2025-Apr-16 22:28>> Traceback (most recent call last):
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 22:28>> resp = conn.urlopen(
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 22:28>> retries = retries.increment(
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 22:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 22:28>>
<<2025-Apr-16 22:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 22:28>>
<<2025-Apr-16 22:28>> Traceback (most recent call last):
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 22:28>> main()
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 22:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 22:28>> cmds = commands.get_cmds(
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 22:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 22:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 22:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 22:28>> html = get_occweb_page(
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 22:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 22:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 22:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 22:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 22:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 22:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 22:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 22:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 22:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:02:36:00.000&tstop=2025:109:18:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 22:38>> Traceback (most recent call last):
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 22:38>> sock = connection.create_connection(
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 22:38>> raise err
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 22:38>> sock.connect(sa)
<<2025-Apr-16 22:38>> TimeoutError: timed out
<<2025-Apr-16 22:38>>
<<2025-Apr-16 22:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:38>>
<<2025-Apr-16 22:38>> Traceback (most recent call last):
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 22:38>> response = self._make_request(
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 22:38>> raise new_e
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 22:38>> self._validate_conn(conn)
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 22:38>> conn.connect()
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 22:38>> self.sock = sock = self._new_conn()
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 22:38>> raise ConnectTimeoutError(
<<2025-Apr-16 22:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 22:38>>
<<2025-Apr-16 22:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:38>>
<<2025-Apr-16 22:38>> Traceback (most recent call last):
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 22:38>> resp = conn.urlopen(
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 22:38>> retries = retries.increment(
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 22:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 22:38>>
<<2025-Apr-16 22:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 22:38>>
<<2025-Apr-16 22:38>> Traceback (most recent call last):
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 22:38>> main()
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 22:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 22:38>> cmds = commands.get_cmds(
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 22:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 22:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 22:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 22:38>> html = get_occweb_page(
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 22:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 22:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 22:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 22:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 22:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 22:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 22:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 22:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 22:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:02:46:00.000&tstop=2025:109:18:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 22:48>> Traceback (most recent call last):
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 22:48>> sock = connection.create_connection(
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 22:48>> raise err
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 22:48>> sock.connect(sa)
<<2025-Apr-16 22:48>> TimeoutError: timed out
<<2025-Apr-16 22:48>>
<<2025-Apr-16 22:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:48>>
<<2025-Apr-16 22:48>> Traceback (most recent call last):
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 22:48>> response = self._make_request(
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 22:48>> raise new_e
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 22:48>> self._validate_conn(conn)
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 22:48>> conn.connect()
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 22:48>> self.sock = sock = self._new_conn()
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 22:48>> raise ConnectTimeoutError(
<<2025-Apr-16 22:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 22:48>>
<<2025-Apr-16 22:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:48>>
<<2025-Apr-16 22:48>> Traceback (most recent call last):
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 22:48>> resp = conn.urlopen(
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 22:48>> retries = retries.increment(
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 22:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 22:48>>
<<2025-Apr-16 22:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 22:48>>
<<2025-Apr-16 22:48>> Traceback (most recent call last):
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 22:48>> main()
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 22:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 22:48>> cmds = commands.get_cmds(
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 22:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 22:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 22:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 22:48>> html = get_occweb_page(
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 22:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 22:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 22:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 22:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 22:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 22:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 22:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 22:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 22:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 22:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:02:56:00.000&tstop=2025:109:18:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 22:58>> Traceback (most recent call last):
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 22:58>> sock = connection.create_connection(
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 22:58>> raise err
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 22:58>> sock.connect(sa)
<<2025-Apr-16 22:58>> TimeoutError: timed out
<<2025-Apr-16 22:58>>
<<2025-Apr-16 22:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:58>>
<<2025-Apr-16 22:58>> Traceback (most recent call last):
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 22:58>> response = self._make_request(
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 22:58>> raise new_e
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 22:58>> self._validate_conn(conn)
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 22:58>> conn.connect()
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 22:58>> self.sock = sock = self._new_conn()
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 22:58>> raise ConnectTimeoutError(
<<2025-Apr-16 22:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 22:58>>
<<2025-Apr-16 22:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 22:58>>
<<2025-Apr-16 22:58>> Traceback (most recent call last):
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 22:58>> resp = conn.urlopen(
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 22:58>> retries = retries.increment(
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 22:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 22:58>>
<<2025-Apr-16 22:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 22:58>>
<<2025-Apr-16 22:58>> Traceback (most recent call last):
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 22:58>> main()
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 22:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 22:58>> cmds = commands.get_cmds(
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 22:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 22:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 22:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 22:58>> html = get_occweb_page(
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 22:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 22:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 22:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 22:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 22:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 22:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 22:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 22:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 22:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 23:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:03:06:00.000&tstop=2025:109:18:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 23:08>> Traceback (most recent call last):
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 23:08>> sock = connection.create_connection(
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 23:08>> raise err
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 23:08>> sock.connect(sa)
<<2025-Apr-16 23:08>> TimeoutError: timed out
<<2025-Apr-16 23:08>>
<<2025-Apr-16 23:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:08>>
<<2025-Apr-16 23:08>> Traceback (most recent call last):
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 23:08>> response = self._make_request(
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 23:08>> raise new_e
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 23:08>> self._validate_conn(conn)
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 23:08>> conn.connect()
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 23:08>> self.sock = sock = self._new_conn()
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 23:08>> raise ConnectTimeoutError(
<<2025-Apr-16 23:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 23:08>>
<<2025-Apr-16 23:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:08>>
<<2025-Apr-16 23:08>> Traceback (most recent call last):
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 23:08>> resp = conn.urlopen(
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 23:08>> retries = retries.increment(
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 23:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 23:08>>
<<2025-Apr-16 23:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 23:08>>
<<2025-Apr-16 23:08>> Traceback (most recent call last):
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 23:08>> main()
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 23:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 23:08>> cmds = commands.get_cmds(
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 23:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 23:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 23:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 23:08>> html = get_occweb_page(
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 23:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 23:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 23:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 23:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 23:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 23:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 23:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 23:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 23:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:03:16:00.000&tstop=2025:109:18:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 23:18>> Traceback (most recent call last):
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 23:18>> sock = connection.create_connection(
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 23:18>> raise err
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 23:18>> sock.connect(sa)
<<2025-Apr-16 23:18>> TimeoutError: timed out
<<2025-Apr-16 23:18>>
<<2025-Apr-16 23:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:18>>
<<2025-Apr-16 23:18>> Traceback (most recent call last):
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 23:18>> response = self._make_request(
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 23:18>> raise new_e
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 23:18>> self._validate_conn(conn)
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 23:18>> conn.connect()
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 23:18>> self.sock = sock = self._new_conn()
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 23:18>> raise ConnectTimeoutError(
<<2025-Apr-16 23:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 23:18>>
<<2025-Apr-16 23:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:18>>
<<2025-Apr-16 23:18>> Traceback (most recent call last):
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 23:18>> resp = conn.urlopen(
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 23:18>> retries = retries.increment(
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 23:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 23:18>>
<<2025-Apr-16 23:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 23:18>>
<<2025-Apr-16 23:18>> Traceback (most recent call last):
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 23:18>> main()
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 23:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 23:18>> cmds = commands.get_cmds(
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 23:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 23:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 23:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 23:18>> html = get_occweb_page(
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 23:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 23:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 23:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 23:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 23:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 23:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 23:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 23:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 23:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:03:26:00.000&tstop=2025:109:18:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 23:28>> Traceback (most recent call last):
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 23:28>> sock = connection.create_connection(
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 23:28>> raise err
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 23:28>> sock.connect(sa)
<<2025-Apr-16 23:28>> TimeoutError: timed out
<<2025-Apr-16 23:28>>
<<2025-Apr-16 23:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:28>>
<<2025-Apr-16 23:28>> Traceback (most recent call last):
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 23:28>> response = self._make_request(
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 23:28>> raise new_e
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 23:28>> self._validate_conn(conn)
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 23:28>> conn.connect()
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 23:28>> self.sock = sock = self._new_conn()
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 23:28>> raise ConnectTimeoutError(
<<2025-Apr-16 23:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 23:28>>
<<2025-Apr-16 23:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:28>>
<<2025-Apr-16 23:28>> Traceback (most recent call last):
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 23:28>> resp = conn.urlopen(
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 23:28>> retries = retries.increment(
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 23:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 23:28>>
<<2025-Apr-16 23:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 23:28>>
<<2025-Apr-16 23:28>> Traceback (most recent call last):
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 23:28>> main()
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 23:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 23:28>> cmds = commands.get_cmds(
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 23:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 23:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 23:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 23:28>> html = get_occweb_page(
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 23:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 23:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 23:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 23:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 23:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 23:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 23:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 23:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 23:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:03:36:00.000&tstop=2025:109:19:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 23:38>> Traceback (most recent call last):
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 23:38>> sock = connection.create_connection(
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 23:38>> raise err
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 23:38>> sock.connect(sa)
<<2025-Apr-16 23:38>> TimeoutError: timed out
<<2025-Apr-16 23:38>>
<<2025-Apr-16 23:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:38>>
<<2025-Apr-16 23:38>> Traceback (most recent call last):
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 23:38>> response = self._make_request(
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 23:38>> raise new_e
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 23:38>> self._validate_conn(conn)
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 23:38>> conn.connect()
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 23:38>> self.sock = sock = self._new_conn()
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 23:38>> raise ConnectTimeoutError(
<<2025-Apr-16 23:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 23:38>>
<<2025-Apr-16 23:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:38>>
<<2025-Apr-16 23:38>> Traceback (most recent call last):
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 23:38>> resp = conn.urlopen(
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 23:38>> retries = retries.increment(
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 23:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 23:38>>
<<2025-Apr-16 23:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 23:38>>
<<2025-Apr-16 23:38>> Traceback (most recent call last):
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 23:38>> main()
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 23:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 23:38>> cmds = commands.get_cmds(
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 23:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 23:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 23:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 23:38>> html = get_occweb_page(
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 23:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 23:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 23:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 23:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 23:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 23:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 23:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 23:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 23:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:03:46:00.000&tstop=2025:109:19:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 23:48>> Traceback (most recent call last):
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 23:48>> sock = connection.create_connection(
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 23:48>> raise err
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 23:48>> sock.connect(sa)
<<2025-Apr-16 23:48>> TimeoutError: timed out
<<2025-Apr-16 23:48>>
<<2025-Apr-16 23:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:48>>
<<2025-Apr-16 23:48>> Traceback (most recent call last):
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 23:48>> response = self._make_request(
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 23:48>> raise new_e
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 23:48>> self._validate_conn(conn)
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 23:48>> conn.connect()
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 23:48>> self.sock = sock = self._new_conn()
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 23:48>> raise ConnectTimeoutError(
<<2025-Apr-16 23:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 23:48>>
<<2025-Apr-16 23:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:48>>
<<2025-Apr-16 23:48>> Traceback (most recent call last):
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 23:48>> resp = conn.urlopen(
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 23:48>> retries = retries.increment(
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 23:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 23:48>>
<<2025-Apr-16 23:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 23:48>>
<<2025-Apr-16 23:48>> Traceback (most recent call last):
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 23:48>> main()
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 23:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 23:48>> cmds = commands.get_cmds(
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 23:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 23:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 23:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 23:48>> html = get_occweb_page(
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 23:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 23:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 23:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 23:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 23:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 23:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 23:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 23:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Wed Apr 16 23:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-16 23:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:03:56:00.000&tstop=2025:109:19:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-16 23:58>> Traceback (most recent call last):
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-16 23:58>> sock = connection.create_connection(
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-16 23:58>> raise err
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-16 23:58>> sock.connect(sa)
<<2025-Apr-16 23:58>> TimeoutError: timed out
<<2025-Apr-16 23:58>>
<<2025-Apr-16 23:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:58>>
<<2025-Apr-16 23:58>> Traceback (most recent call last):
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-16 23:58>> response = self._make_request(
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-16 23:58>> raise new_e
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-16 23:58>> self._validate_conn(conn)
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-16 23:58>> conn.connect()
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-16 23:58>> self.sock = sock = self._new_conn()
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-16 23:58>> raise ConnectTimeoutError(
<<2025-Apr-16 23:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-16 23:58>>
<<2025-Apr-16 23:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-16 23:58>>
<<2025-Apr-16 23:58>> Traceback (most recent call last):
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-16 23:58>> resp = conn.urlopen(
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-16 23:58>> retries = retries.increment(
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-16 23:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-16 23:58>>
<<2025-Apr-16 23:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-16 23:58>>
<<2025-Apr-16 23:58>> Traceback (most recent call last):
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-16 23:58>> main()
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-16 23:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-16 23:58>> cmds = commands.get_cmds(
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-16 23:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-16 23:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-16 23:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-16 23:58>> html = get_occweb_page(
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-16 23:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-16 23:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-16 23:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-16 23:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-16 23:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-16 23:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-16 23:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-16 23:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-16 23:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 00:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:04:06:00.000&tstop=2025:109:19:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 00:08>> Traceback (most recent call last):
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 00:08>> sock = connection.create_connection(
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 00:08>> raise err
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 00:08>> sock.connect(sa)
<<2025-Apr-17 00:08>> TimeoutError: timed out
<<2025-Apr-17 00:08>>
<<2025-Apr-17 00:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:08>>
<<2025-Apr-17 00:08>> Traceback (most recent call last):
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 00:08>> response = self._make_request(
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 00:08>> raise new_e
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 00:08>> self._validate_conn(conn)
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 00:08>> conn.connect()
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 00:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 00:08>> raise ConnectTimeoutError(
<<2025-Apr-17 00:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 00:08>>
<<2025-Apr-17 00:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:08>>
<<2025-Apr-17 00:08>> Traceback (most recent call last):
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 00:08>> resp = conn.urlopen(
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 00:08>> retries = retries.increment(
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 00:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 00:08>>
<<2025-Apr-17 00:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 00:08>>
<<2025-Apr-17 00:08>> Traceback (most recent call last):
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 00:08>> main()
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 00:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 00:08>> cmds = commands.get_cmds(
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 00:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 00:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 00:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 00:08>> html = get_occweb_page(
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 00:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 00:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 00:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 00:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 00:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 00:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 00:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 00:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 00:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:04:16:00.000&tstop=2025:109:19:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 00:18>> Traceback (most recent call last):
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 00:18>> sock = connection.create_connection(
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 00:18>> raise err
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 00:18>> sock.connect(sa)
<<2025-Apr-17 00:18>> TimeoutError: timed out
<<2025-Apr-17 00:18>>
<<2025-Apr-17 00:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:18>>
<<2025-Apr-17 00:18>> Traceback (most recent call last):
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 00:18>> response = self._make_request(
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 00:18>> raise new_e
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 00:18>> self._validate_conn(conn)
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 00:18>> conn.connect()
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 00:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 00:18>> raise ConnectTimeoutError(
<<2025-Apr-17 00:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 00:18>>
<<2025-Apr-17 00:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:18>>
<<2025-Apr-17 00:18>> Traceback (most recent call last):
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 00:18>> resp = conn.urlopen(
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 00:18>> retries = retries.increment(
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 00:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 00:18>>
<<2025-Apr-17 00:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 00:18>>
<<2025-Apr-17 00:18>> Traceback (most recent call last):
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 00:18>> main()
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 00:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 00:18>> cmds = commands.get_cmds(
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 00:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 00:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 00:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 00:18>> html = get_occweb_page(
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 00:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 00:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 00:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 00:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 00:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 00:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 00:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 00:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 00:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:04:26:00.000&tstop=2025:109:19:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 00:28>> Traceback (most recent call last):
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 00:28>> sock = connection.create_connection(
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 00:28>> raise err
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 00:28>> sock.connect(sa)
<<2025-Apr-17 00:28>> TimeoutError: timed out
<<2025-Apr-17 00:28>>
<<2025-Apr-17 00:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:28>>
<<2025-Apr-17 00:28>> Traceback (most recent call last):
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 00:28>> response = self._make_request(
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 00:28>> raise new_e
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 00:28>> self._validate_conn(conn)
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 00:28>> conn.connect()
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 00:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 00:28>> raise ConnectTimeoutError(
<<2025-Apr-17 00:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 00:28>>
<<2025-Apr-17 00:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:28>>
<<2025-Apr-17 00:28>> Traceback (most recent call last):
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 00:28>> resp = conn.urlopen(
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 00:28>> retries = retries.increment(
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 00:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 00:28>>
<<2025-Apr-17 00:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 00:28>>
<<2025-Apr-17 00:28>> Traceback (most recent call last):
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 00:28>> main()
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 00:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 00:28>> cmds = commands.get_cmds(
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 00:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 00:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 00:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 00:28>> html = get_occweb_page(
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 00:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 00:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 00:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 00:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 00:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 00:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 00:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 00:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 00:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:04:36:00.000&tstop=2025:109:20:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 00:38>> Traceback (most recent call last):
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 00:38>> sock = connection.create_connection(
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 00:38>> raise err
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 00:38>> sock.connect(sa)
<<2025-Apr-17 00:38>> TimeoutError: timed out
<<2025-Apr-17 00:38>>
<<2025-Apr-17 00:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:38>>
<<2025-Apr-17 00:38>> Traceback (most recent call last):
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 00:38>> response = self._make_request(
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 00:38>> raise new_e
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 00:38>> self._validate_conn(conn)
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 00:38>> conn.connect()
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 00:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 00:38>> raise ConnectTimeoutError(
<<2025-Apr-17 00:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 00:38>>
<<2025-Apr-17 00:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:38>>
<<2025-Apr-17 00:38>> Traceback (most recent call last):
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 00:38>> resp = conn.urlopen(
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 00:38>> retries = retries.increment(
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 00:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 00:38>>
<<2025-Apr-17 00:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 00:38>>
<<2025-Apr-17 00:38>> Traceback (most recent call last):
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 00:38>> main()
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 00:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 00:38>> cmds = commands.get_cmds(
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 00:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 00:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 00:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 00:38>> html = get_occweb_page(
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 00:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 00:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 00:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 00:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 00:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 00:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 00:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 00:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 00:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:04:46:00.000&tstop=2025:109:20:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 00:48>> Traceback (most recent call last):
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 00:48>> sock = connection.create_connection(
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 00:48>> raise err
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 00:48>> sock.connect(sa)
<<2025-Apr-17 00:48>> TimeoutError: timed out
<<2025-Apr-17 00:48>>
<<2025-Apr-17 00:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:48>>
<<2025-Apr-17 00:48>> Traceback (most recent call last):
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 00:48>> response = self._make_request(
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 00:48>> raise new_e
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 00:48>> self._validate_conn(conn)
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 00:48>> conn.connect()
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 00:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 00:48>> raise ConnectTimeoutError(
<<2025-Apr-17 00:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 00:48>>
<<2025-Apr-17 00:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:48>>
<<2025-Apr-17 00:48>> Traceback (most recent call last):
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 00:48>> resp = conn.urlopen(
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 00:48>> retries = retries.increment(
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 00:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 00:48>>
<<2025-Apr-17 00:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 00:48>>
<<2025-Apr-17 00:48>> Traceback (most recent call last):
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 00:48>> main()
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 00:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 00:48>> cmds = commands.get_cmds(
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 00:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 00:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 00:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 00:48>> html = get_occweb_page(
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 00:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 00:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 00:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 00:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 00:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 00:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 00:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 00:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 00:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 00:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:04:56:01.000&tstop=2025:109:20:26:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 00:58>> Traceback (most recent call last):
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 00:58>> sock = connection.create_connection(
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 00:58>> raise err
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 00:58>> sock.connect(sa)
<<2025-Apr-17 00:58>> TimeoutError: timed out
<<2025-Apr-17 00:58>>
<<2025-Apr-17 00:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:58>>
<<2025-Apr-17 00:58>> Traceback (most recent call last):
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 00:58>> response = self._make_request(
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 00:58>> raise new_e
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 00:58>> self._validate_conn(conn)
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 00:58>> conn.connect()
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 00:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 00:58>> raise ConnectTimeoutError(
<<2025-Apr-17 00:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 00:58>>
<<2025-Apr-17 00:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 00:58>>
<<2025-Apr-17 00:58>> Traceback (most recent call last):
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 00:58>> resp = conn.urlopen(
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 00:58>> retries = retries.increment(
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 00:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 00:58>>
<<2025-Apr-17 00:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 00:58>>
<<2025-Apr-17 00:58>> Traceback (most recent call last):
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 00:58>> main()
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 00:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 00:58>> cmds = commands.get_cmds(
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 00:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 00:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 00:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 00:58>> html = get_occweb_page(
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 00:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 00:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 00:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 00:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 00:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 00:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 00:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 00:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 00:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 01:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:05:06:00.000&tstop=2025:109:20:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 01:08>> Traceback (most recent call last):
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 01:08>> sock = connection.create_connection(
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 01:08>> raise err
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 01:08>> sock.connect(sa)
<<2025-Apr-17 01:08>> TimeoutError: timed out
<<2025-Apr-17 01:08>>
<<2025-Apr-17 01:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:08>>
<<2025-Apr-17 01:08>> Traceback (most recent call last):
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 01:08>> response = self._make_request(
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 01:08>> raise new_e
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 01:08>> self._validate_conn(conn)
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 01:08>> conn.connect()
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 01:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 01:08>> raise ConnectTimeoutError(
<<2025-Apr-17 01:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 01:08>>
<<2025-Apr-17 01:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:08>>
<<2025-Apr-17 01:08>> Traceback (most recent call last):
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 01:08>> resp = conn.urlopen(
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 01:08>> retries = retries.increment(
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 01:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 01:08>>
<<2025-Apr-17 01:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 01:08>>
<<2025-Apr-17 01:08>> Traceback (most recent call last):
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 01:08>> main()
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 01:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 01:08>> cmds = commands.get_cmds(
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 01:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 01:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 01:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 01:08>> html = get_occweb_page(
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 01:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 01:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 01:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 01:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 01:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 01:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 01:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 01:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 01:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:05:16:00.000&tstop=2025:109:20:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 01:18>> Traceback (most recent call last):
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 01:18>> sock = connection.create_connection(
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 01:18>> raise err
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 01:18>> sock.connect(sa)
<<2025-Apr-17 01:18>> TimeoutError: timed out
<<2025-Apr-17 01:18>>
<<2025-Apr-17 01:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:18>>
<<2025-Apr-17 01:18>> Traceback (most recent call last):
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 01:18>> response = self._make_request(
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 01:18>> raise new_e
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 01:18>> self._validate_conn(conn)
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 01:18>> conn.connect()
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 01:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 01:18>> raise ConnectTimeoutError(
<<2025-Apr-17 01:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 01:18>>
<<2025-Apr-17 01:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:18>>
<<2025-Apr-17 01:18>> Traceback (most recent call last):
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 01:18>> resp = conn.urlopen(
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 01:18>> retries = retries.increment(
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 01:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 01:18>>
<<2025-Apr-17 01:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 01:18>>
<<2025-Apr-17 01:18>> Traceback (most recent call last):
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 01:18>> main()
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 01:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 01:18>> cmds = commands.get_cmds(
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 01:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 01:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 01:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 01:18>> html = get_occweb_page(
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 01:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 01:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 01:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 01:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 01:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 01:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 01:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 01:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 01:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:05:26:00.000&tstop=2025:109:20:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 01:28>> Traceback (most recent call last):
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 01:28>> sock = connection.create_connection(
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 01:28>> raise err
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 01:28>> sock.connect(sa)
<<2025-Apr-17 01:28>> TimeoutError: timed out
<<2025-Apr-17 01:28>>
<<2025-Apr-17 01:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:28>>
<<2025-Apr-17 01:28>> Traceback (most recent call last):
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 01:28>> response = self._make_request(
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 01:28>> raise new_e
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 01:28>> self._validate_conn(conn)
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 01:28>> conn.connect()
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 01:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 01:28>> raise ConnectTimeoutError(
<<2025-Apr-17 01:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 01:28>>
<<2025-Apr-17 01:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:28>>
<<2025-Apr-17 01:28>> Traceback (most recent call last):
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 01:28>> resp = conn.urlopen(
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 01:28>> retries = retries.increment(
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 01:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 01:28>>
<<2025-Apr-17 01:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 01:28>>
<<2025-Apr-17 01:28>> Traceback (most recent call last):
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 01:28>> main()
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 01:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 01:28>> cmds = commands.get_cmds(
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 01:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 01:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 01:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 01:28>> html = get_occweb_page(
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 01:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 01:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 01:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 01:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 01:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 01:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 01:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 01:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 01:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:05:36:00.000&tstop=2025:109:21:06:00.000)
<<2025-Apr-17 01:37>> Warning: 500 Can't connect to space.umd.edu:443 (Connection refused) for web data solar_wind (https://space.umd.edu/pm/)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 01:38>> Traceback (most recent call last):
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 01:38>> sock = connection.create_connection(
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 01:38>> raise err
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 01:38>> sock.connect(sa)
<<2025-Apr-17 01:38>> TimeoutError: timed out
<<2025-Apr-17 01:38>>
<<2025-Apr-17 01:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:38>>
<<2025-Apr-17 01:38>> Traceback (most recent call last):
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 01:38>> response = self._make_request(
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 01:38>> raise new_e
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 01:38>> self._validate_conn(conn)
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 01:38>> conn.connect()
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 01:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 01:38>> raise ConnectTimeoutError(
<<2025-Apr-17 01:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 01:38>>
<<2025-Apr-17 01:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:38>>
<<2025-Apr-17 01:38>> Traceback (most recent call last):
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 01:38>> resp = conn.urlopen(
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 01:38>> retries = retries.increment(
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 01:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 01:38>>
<<2025-Apr-17 01:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 01:38>>
<<2025-Apr-17 01:38>> Traceback (most recent call last):
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 01:38>> main()
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 01:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 01:38>> cmds = commands.get_cmds(
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 01:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 01:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 01:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 01:38>> html = get_occweb_page(
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 01:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 01:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 01:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 01:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 01:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 01:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 01:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 01:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 01:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:05:46:00.000&tstop=2025:109:21:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 01:48>> Traceback (most recent call last):
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 01:48>> sock = connection.create_connection(
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 01:48>> raise err
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 01:48>> sock.connect(sa)
<<2025-Apr-17 01:48>> TimeoutError: timed out
<<2025-Apr-17 01:48>>
<<2025-Apr-17 01:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:48>>
<<2025-Apr-17 01:48>> Traceback (most recent call last):
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 01:48>> response = self._make_request(
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 01:48>> raise new_e
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 01:48>> self._validate_conn(conn)
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 01:48>> conn.connect()
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 01:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 01:48>> raise ConnectTimeoutError(
<<2025-Apr-17 01:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 01:48>>
<<2025-Apr-17 01:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:48>>
<<2025-Apr-17 01:48>> Traceback (most recent call last):
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 01:48>> resp = conn.urlopen(
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 01:48>> retries = retries.increment(
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 01:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 01:48>>
<<2025-Apr-17 01:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 01:48>>
<<2025-Apr-17 01:48>> Traceback (most recent call last):
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 01:48>> main()
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 01:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 01:48>> cmds = commands.get_cmds(
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 01:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 01:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 01:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 01:48>> html = get_occweb_page(
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 01:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 01:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 01:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 01:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 01:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 01:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 01:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 01:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 01:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 01:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:05:56:00.000&tstop=2025:109:21:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 01:58>> Traceback (most recent call last):
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 01:58>> sock = connection.create_connection(
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 01:58>> raise err
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 01:58>> sock.connect(sa)
<<2025-Apr-17 01:58>> TimeoutError: timed out
<<2025-Apr-17 01:58>>
<<2025-Apr-17 01:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:58>>
<<2025-Apr-17 01:58>> Traceback (most recent call last):
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 01:58>> response = self._make_request(
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 01:58>> raise new_e
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 01:58>> self._validate_conn(conn)
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 01:58>> conn.connect()
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 01:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 01:58>> raise ConnectTimeoutError(
<<2025-Apr-17 01:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 01:58>>
<<2025-Apr-17 01:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 01:58>>
<<2025-Apr-17 01:58>> Traceback (most recent call last):
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 01:58>> resp = conn.urlopen(
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 01:58>> retries = retries.increment(
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 01:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 01:58>>
<<2025-Apr-17 01:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 01:58>>
<<2025-Apr-17 01:58>> Traceback (most recent call last):
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 01:58>> main()
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 01:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 01:58>> cmds = commands.get_cmds(
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 01:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 01:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 01:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 01:58>> html = get_occweb_page(
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 01:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 01:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 01:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 01:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 01:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 01:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 01:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 01:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 01:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 02:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:06:06:00.000&tstop=2025:109:21:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 02:08>> Traceback (most recent call last):
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 02:08>> sock = connection.create_connection(
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 02:08>> raise err
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 02:08>> sock.connect(sa)
<<2025-Apr-17 02:08>> TimeoutError: timed out
<<2025-Apr-17 02:08>>
<<2025-Apr-17 02:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:08>>
<<2025-Apr-17 02:08>> Traceback (most recent call last):
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 02:08>> response = self._make_request(
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 02:08>> raise new_e
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 02:08>> self._validate_conn(conn)
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 02:08>> conn.connect()
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 02:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 02:08>> raise ConnectTimeoutError(
<<2025-Apr-17 02:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 02:08>>
<<2025-Apr-17 02:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:08>>
<<2025-Apr-17 02:08>> Traceback (most recent call last):
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 02:08>> resp = conn.urlopen(
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 02:08>> retries = retries.increment(
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 02:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 02:08>>
<<2025-Apr-17 02:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 02:08>>
<<2025-Apr-17 02:08>> Traceback (most recent call last):
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 02:08>> main()
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 02:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 02:08>> cmds = commands.get_cmds(
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 02:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 02:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 02:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 02:08>> html = get_occweb_page(
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 02:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 02:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 02:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 02:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 02:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 02:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 02:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 02:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 02:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:06:16:00.000&tstop=2025:109:21:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 02:18>> Traceback (most recent call last):
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 02:18>> sock = connection.create_connection(
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 02:18>> raise err
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 02:18>> sock.connect(sa)
<<2025-Apr-17 02:18>> TimeoutError: timed out
<<2025-Apr-17 02:18>>
<<2025-Apr-17 02:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:18>>
<<2025-Apr-17 02:18>> Traceback (most recent call last):
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 02:18>> response = self._make_request(
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 02:18>> raise new_e
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 02:18>> self._validate_conn(conn)
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 02:18>> conn.connect()
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 02:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 02:18>> raise ConnectTimeoutError(
<<2025-Apr-17 02:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 02:18>>
<<2025-Apr-17 02:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:18>>
<<2025-Apr-17 02:18>> Traceback (most recent call last):
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 02:18>> resp = conn.urlopen(
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 02:18>> retries = retries.increment(
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 02:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 02:18>>
<<2025-Apr-17 02:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 02:18>>
<<2025-Apr-17 02:18>> Traceback (most recent call last):
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 02:18>> main()
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 02:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 02:18>> cmds = commands.get_cmds(
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 02:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 02:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 02:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 02:18>> html = get_occweb_page(
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 02:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 02:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 02:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 02:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 02:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 02:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 02:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 02:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 02:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:06:26:00.000&tstop=2025:109:21:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 02:28>> Traceback (most recent call last):
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 02:28>> sock = connection.create_connection(
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 02:28>> raise err
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 02:28>> sock.connect(sa)
<<2025-Apr-17 02:28>> TimeoutError: timed out
<<2025-Apr-17 02:28>>
<<2025-Apr-17 02:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:28>>
<<2025-Apr-17 02:28>> Traceback (most recent call last):
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 02:28>> response = self._make_request(
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 02:28>> raise new_e
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 02:28>> self._validate_conn(conn)
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 02:28>> conn.connect()
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 02:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 02:28>> raise ConnectTimeoutError(
<<2025-Apr-17 02:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 02:28>>
<<2025-Apr-17 02:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:28>>
<<2025-Apr-17 02:28>> Traceback (most recent call last):
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 02:28>> resp = conn.urlopen(
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 02:28>> retries = retries.increment(
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 02:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 02:28>>
<<2025-Apr-17 02:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 02:28>>
<<2025-Apr-17 02:28>> Traceback (most recent call last):
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 02:28>> main()
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 02:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 02:28>> cmds = commands.get_cmds(
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 02:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 02:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 02:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 02:28>> html = get_occweb_page(
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 02:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 02:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 02:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 02:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 02:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 02:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 02:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 02:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 02:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:06:36:00.000&tstop=2025:109:22:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 02:38>> Traceback (most recent call last):
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 02:38>> sock = connection.create_connection(
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 02:38>> raise err
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 02:38>> sock.connect(sa)
<<2025-Apr-17 02:38>> TimeoutError: timed out
<<2025-Apr-17 02:38>>
<<2025-Apr-17 02:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:38>>
<<2025-Apr-17 02:38>> Traceback (most recent call last):
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 02:38>> response = self._make_request(
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 02:38>> raise new_e
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 02:38>> self._validate_conn(conn)
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 02:38>> conn.connect()
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 02:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 02:38>> raise ConnectTimeoutError(
<<2025-Apr-17 02:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 02:38>>
<<2025-Apr-17 02:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:38>>
<<2025-Apr-17 02:38>> Traceback (most recent call last):
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 02:38>> resp = conn.urlopen(
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 02:38>> retries = retries.increment(
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 02:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 02:38>>
<<2025-Apr-17 02:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 02:38>>
<<2025-Apr-17 02:38>> Traceback (most recent call last):
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 02:38>> main()
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 02:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 02:38>> cmds = commands.get_cmds(
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 02:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 02:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 02:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 02:38>> html = get_occweb_page(
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 02:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 02:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 02:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 02:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 02:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 02:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 02:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 02:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 02:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:06:46:00.000&tstop=2025:109:22:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 02:48>> Traceback (most recent call last):
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 02:48>> sock = connection.create_connection(
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 02:48>> raise err
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 02:48>> sock.connect(sa)
<<2025-Apr-17 02:48>> TimeoutError: timed out
<<2025-Apr-17 02:48>>
<<2025-Apr-17 02:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:48>>
<<2025-Apr-17 02:48>> Traceback (most recent call last):
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 02:48>> response = self._make_request(
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 02:48>> raise new_e
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 02:48>> self._validate_conn(conn)
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 02:48>> conn.connect()
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 02:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 02:48>> raise ConnectTimeoutError(
<<2025-Apr-17 02:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 02:48>>
<<2025-Apr-17 02:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:48>>
<<2025-Apr-17 02:48>> Traceback (most recent call last):
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 02:48>> resp = conn.urlopen(
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 02:48>> retries = retries.increment(
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 02:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 02:48>>
<<2025-Apr-17 02:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 02:48>>
<<2025-Apr-17 02:48>> Traceback (most recent call last):
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 02:48>> main()
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 02:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 02:48>> cmds = commands.get_cmds(
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 02:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 02:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 02:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 02:48>> html = get_occweb_page(
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 02:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 02:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 02:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 02:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 02:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 02:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 02:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 02:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 02:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 02:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:06:56:00.000&tstop=2025:109:22:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 02:58>> Traceback (most recent call last):
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 02:58>> sock = connection.create_connection(
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 02:58>> raise err
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 02:58>> sock.connect(sa)
<<2025-Apr-17 02:58>> TimeoutError: timed out
<<2025-Apr-17 02:58>>
<<2025-Apr-17 02:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:58>>
<<2025-Apr-17 02:58>> Traceback (most recent call last):
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 02:58>> response = self._make_request(
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 02:58>> raise new_e
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 02:58>> self._validate_conn(conn)
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 02:58>> conn.connect()
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 02:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 02:58>> raise ConnectTimeoutError(
<<2025-Apr-17 02:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 02:58>>
<<2025-Apr-17 02:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 02:58>>
<<2025-Apr-17 02:58>> Traceback (most recent call last):
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 02:58>> resp = conn.urlopen(
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 02:58>> retries = retries.increment(
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 02:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 02:58>>
<<2025-Apr-17 02:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 02:58>>
<<2025-Apr-17 02:58>> Traceback (most recent call last):
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 02:58>> main()
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 02:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 02:58>> cmds = commands.get_cmds(
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 02:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 02:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 02:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 02:58>> html = get_occweb_page(
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 02:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 02:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 02:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 02:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 02:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 02:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 02:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 02:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 02:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 03:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:07:06:00.000&tstop=2025:109:22:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 03:08>> Traceback (most recent call last):
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 03:08>> sock = connection.create_connection(
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 03:08>> raise err
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 03:08>> sock.connect(sa)
<<2025-Apr-17 03:08>> TimeoutError: timed out
<<2025-Apr-17 03:08>>
<<2025-Apr-17 03:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:08>>
<<2025-Apr-17 03:08>> Traceback (most recent call last):
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 03:08>> response = self._make_request(
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 03:08>> raise new_e
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 03:08>> self._validate_conn(conn)
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 03:08>> conn.connect()
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 03:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 03:08>> raise ConnectTimeoutError(
<<2025-Apr-17 03:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 03:08>>
<<2025-Apr-17 03:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:08>>
<<2025-Apr-17 03:08>> Traceback (most recent call last):
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 03:08>> resp = conn.urlopen(
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 03:08>> retries = retries.increment(
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 03:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 03:08>>
<<2025-Apr-17 03:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 03:08>>
<<2025-Apr-17 03:08>> Traceback (most recent call last):
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 03:08>> main()
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 03:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 03:08>> cmds = commands.get_cmds(
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 03:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 03:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 03:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 03:08>> html = get_occweb_page(
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 03:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 03:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 03:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 03:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 03:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 03:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 03:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 03:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 03:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:07:16:00.000&tstop=2025:109:22:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 03:18>> Traceback (most recent call last):
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 03:18>> sock = connection.create_connection(
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 03:18>> raise err
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 03:18>> sock.connect(sa)
<<2025-Apr-17 03:18>> TimeoutError: timed out
<<2025-Apr-17 03:18>>
<<2025-Apr-17 03:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:18>>
<<2025-Apr-17 03:18>> Traceback (most recent call last):
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 03:18>> response = self._make_request(
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 03:18>> raise new_e
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 03:18>> self._validate_conn(conn)
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 03:18>> conn.connect()
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 03:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 03:18>> raise ConnectTimeoutError(
<<2025-Apr-17 03:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 03:18>>
<<2025-Apr-17 03:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:18>>
<<2025-Apr-17 03:18>> Traceback (most recent call last):
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 03:18>> resp = conn.urlopen(
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 03:18>> retries = retries.increment(
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 03:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 03:18>>
<<2025-Apr-17 03:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 03:18>>
<<2025-Apr-17 03:18>> Traceback (most recent call last):
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 03:18>> main()
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 03:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 03:18>> cmds = commands.get_cmds(
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 03:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 03:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 03:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 03:18>> html = get_occweb_page(
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 03:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 03:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 03:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 03:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 03:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 03:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 03:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 03:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 03:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:07:26:00.000&tstop=2025:109:22:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 03:28>> Traceback (most recent call last):
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 03:28>> sock = connection.create_connection(
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 03:28>> raise err
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 03:28>> sock.connect(sa)
<<2025-Apr-17 03:28>> TimeoutError: timed out
<<2025-Apr-17 03:28>>
<<2025-Apr-17 03:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:28>>
<<2025-Apr-17 03:28>> Traceback (most recent call last):
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 03:28>> response = self._make_request(
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 03:28>> raise new_e
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 03:28>> self._validate_conn(conn)
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 03:28>> conn.connect()
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 03:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 03:28>> raise ConnectTimeoutError(
<<2025-Apr-17 03:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 03:28>>
<<2025-Apr-17 03:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:28>>
<<2025-Apr-17 03:28>> Traceback (most recent call last):
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 03:28>> resp = conn.urlopen(
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 03:28>> retries = retries.increment(
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 03:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 03:28>>
<<2025-Apr-17 03:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 03:28>>
<<2025-Apr-17 03:28>> Traceback (most recent call last):
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 03:28>> main()
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 03:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 03:28>> cmds = commands.get_cmds(
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 03:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 03:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 03:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 03:28>> html = get_occweb_page(
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 03:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 03:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 03:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 03:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 03:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 03:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 03:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 03:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 03:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:07:36:00.000&tstop=2025:109:23:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 03:38>> Traceback (most recent call last):
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 03:38>> sock = connection.create_connection(
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 03:38>> raise err
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 03:38>> sock.connect(sa)
<<2025-Apr-17 03:38>> TimeoutError: timed out
<<2025-Apr-17 03:38>>
<<2025-Apr-17 03:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:38>>
<<2025-Apr-17 03:38>> Traceback (most recent call last):
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 03:38>> response = self._make_request(
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 03:38>> raise new_e
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 03:38>> self._validate_conn(conn)
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 03:38>> conn.connect()
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 03:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 03:38>> raise ConnectTimeoutError(
<<2025-Apr-17 03:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 03:38>>
<<2025-Apr-17 03:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:38>>
<<2025-Apr-17 03:38>> Traceback (most recent call last):
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 03:38>> resp = conn.urlopen(
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 03:38>> retries = retries.increment(
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 03:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 03:38>>
<<2025-Apr-17 03:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 03:38>>
<<2025-Apr-17 03:38>> Traceback (most recent call last):
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 03:38>> main()
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 03:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 03:38>> cmds = commands.get_cmds(
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 03:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 03:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 03:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 03:38>> html = get_occweb_page(
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 03:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 03:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 03:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 03:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 03:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 03:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 03:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 03:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 03:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:07:46:00.000&tstop=2025:109:23:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 03:48>> Traceback (most recent call last):
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 03:48>> sock = connection.create_connection(
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 03:48>> raise err
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 03:48>> sock.connect(sa)
<<2025-Apr-17 03:48>> TimeoutError: timed out
<<2025-Apr-17 03:48>>
<<2025-Apr-17 03:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:48>>
<<2025-Apr-17 03:48>> Traceback (most recent call last):
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 03:48>> response = self._make_request(
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 03:48>> raise new_e
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 03:48>> self._validate_conn(conn)
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 03:48>> conn.connect()
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 03:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 03:48>> raise ConnectTimeoutError(
<<2025-Apr-17 03:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 03:48>>
<<2025-Apr-17 03:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:48>>
<<2025-Apr-17 03:48>> Traceback (most recent call last):
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 03:48>> resp = conn.urlopen(
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 03:48>> retries = retries.increment(
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 03:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 03:48>>
<<2025-Apr-17 03:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 03:48>>
<<2025-Apr-17 03:48>> Traceback (most recent call last):
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 03:48>> main()
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 03:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 03:48>> cmds = commands.get_cmds(
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 03:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 03:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 03:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 03:48>> html = get_occweb_page(
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 03:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 03:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 03:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 03:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 03:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 03:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 03:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 03:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 03:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 03:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:07:56:01.000&tstop=2025:109:23:26:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 03:58>> Traceback (most recent call last):
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 03:58>> sock = connection.create_connection(
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 03:58>> raise err
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 03:58>> sock.connect(sa)
<<2025-Apr-17 03:58>> TimeoutError: timed out
<<2025-Apr-17 03:58>>
<<2025-Apr-17 03:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:58>>
<<2025-Apr-17 03:58>> Traceback (most recent call last):
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 03:58>> response = self._make_request(
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 03:58>> raise new_e
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 03:58>> self._validate_conn(conn)
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 03:58>> conn.connect()
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 03:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 03:58>> raise ConnectTimeoutError(
<<2025-Apr-17 03:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 03:58>>
<<2025-Apr-17 03:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 03:58>>
<<2025-Apr-17 03:58>> Traceback (most recent call last):
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 03:58>> resp = conn.urlopen(
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 03:58>> retries = retries.increment(
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 03:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 03:58>>
<<2025-Apr-17 03:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 03:58>>
<<2025-Apr-17 03:58>> Traceback (most recent call last):
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 03:58>> main()
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 03:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 03:58>> cmds = commands.get_cmds(
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 03:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 03:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 03:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 03:58>> html = get_occweb_page(
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 03:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 03:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 03:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 03:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 03:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 03:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 03:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 03:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 03:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 04:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:08:06:01.000&tstop=2025:109:23:36:01.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 04:08>> Traceback (most recent call last):
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 04:08>> sock = connection.create_connection(
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 04:08>> raise err
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 04:08>> sock.connect(sa)
<<2025-Apr-17 04:08>> TimeoutError: timed out
<<2025-Apr-17 04:08>>
<<2025-Apr-17 04:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:08>>
<<2025-Apr-17 04:08>> Traceback (most recent call last):
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 04:08>> response = self._make_request(
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 04:08>> raise new_e
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 04:08>> self._validate_conn(conn)
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 04:08>> conn.connect()
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 04:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 04:08>> raise ConnectTimeoutError(
<<2025-Apr-17 04:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 04:08>>
<<2025-Apr-17 04:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:08>>
<<2025-Apr-17 04:08>> Traceback (most recent call last):
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 04:08>> resp = conn.urlopen(
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 04:08>> retries = retries.increment(
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 04:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 04:08>>
<<2025-Apr-17 04:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 04:08>>
<<2025-Apr-17 04:08>> Traceback (most recent call last):
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 04:08>> main()
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 04:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 04:08>> cmds = commands.get_cmds(
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 04:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 04:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 04:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 04:08>> html = get_occweb_page(
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 04:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 04:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 04:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 04:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 04:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 04:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 04:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 04:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 04:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:08:16:00.000&tstop=2025:109:23:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 04:18>> Traceback (most recent call last):
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 04:18>> sock = connection.create_connection(
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 04:18>> raise err
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 04:18>> sock.connect(sa)
<<2025-Apr-17 04:18>> TimeoutError: timed out
<<2025-Apr-17 04:18>>
<<2025-Apr-17 04:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:18>>
<<2025-Apr-17 04:18>> Traceback (most recent call last):
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 04:18>> response = self._make_request(
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 04:18>> raise new_e
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 04:18>> self._validate_conn(conn)
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 04:18>> conn.connect()
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 04:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 04:18>> raise ConnectTimeoutError(
<<2025-Apr-17 04:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 04:18>>
<<2025-Apr-17 04:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:18>>
<<2025-Apr-17 04:18>> Traceback (most recent call last):
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 04:18>> resp = conn.urlopen(
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 04:18>> retries = retries.increment(
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 04:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 04:18>>
<<2025-Apr-17 04:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 04:18>>
<<2025-Apr-17 04:18>> Traceback (most recent call last):
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 04:18>> main()
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 04:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 04:18>> cmds = commands.get_cmds(
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 04:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 04:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 04:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 04:18>> html = get_occweb_page(
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 04:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 04:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 04:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 04:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 04:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 04:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 04:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 04:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 04:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:08:26:00.000&tstop=2025:109:23:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 04:28>> Traceback (most recent call last):
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 04:28>> sock = connection.create_connection(
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 04:28>> raise err
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 04:28>> sock.connect(sa)
<<2025-Apr-17 04:28>> TimeoutError: timed out
<<2025-Apr-17 04:28>>
<<2025-Apr-17 04:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:28>>
<<2025-Apr-17 04:28>> Traceback (most recent call last):
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 04:28>> response = self._make_request(
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 04:28>> raise new_e
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 04:28>> self._validate_conn(conn)
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 04:28>> conn.connect()
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 04:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 04:28>> raise ConnectTimeoutError(
<<2025-Apr-17 04:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 04:28>>
<<2025-Apr-17 04:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:28>>
<<2025-Apr-17 04:28>> Traceback (most recent call last):
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 04:28>> resp = conn.urlopen(
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 04:28>> retries = retries.increment(
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 04:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 04:28>>
<<2025-Apr-17 04:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 04:28>>
<<2025-Apr-17 04:28>> Traceback (most recent call last):
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 04:28>> main()
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 04:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 04:28>> cmds = commands.get_cmds(
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 04:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 04:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 04:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 04:28>> html = get_occweb_page(
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 04:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 04:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 04:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 04:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 04:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 04:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 04:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 04:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 04:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:08:36:00.000&tstop=2025:110:00:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 04:38>> Traceback (most recent call last):
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 04:38>> sock = connection.create_connection(
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 04:38>> raise err
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 04:38>> sock.connect(sa)
<<2025-Apr-17 04:38>> TimeoutError: timed out
<<2025-Apr-17 04:38>>
<<2025-Apr-17 04:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:38>>
<<2025-Apr-17 04:38>> Traceback (most recent call last):
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 04:38>> response = self._make_request(
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 04:38>> raise new_e
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 04:38>> self._validate_conn(conn)
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 04:38>> conn.connect()
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 04:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 04:38>> raise ConnectTimeoutError(
<<2025-Apr-17 04:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 04:38>>
<<2025-Apr-17 04:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:38>>
<<2025-Apr-17 04:38>> Traceback (most recent call last):
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 04:38>> resp = conn.urlopen(
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 04:38>> retries = retries.increment(
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 04:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 04:38>>
<<2025-Apr-17 04:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 04:38>>
<<2025-Apr-17 04:38>> Traceback (most recent call last):
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 04:38>> main()
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 04:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 04:38>> cmds = commands.get_cmds(
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 04:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 04:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 04:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 04:38>> html = get_occweb_page(
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 04:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 04:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 04:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 04:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 04:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 04:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 04:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 04:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 04:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:08:46:00.000&tstop=2025:110:00:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 04:48>> Traceback (most recent call last):
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 04:48>> sock = connection.create_connection(
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 04:48>> raise err
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 04:48>> sock.connect(sa)
<<2025-Apr-17 04:48>> TimeoutError: timed out
<<2025-Apr-17 04:48>>
<<2025-Apr-17 04:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:48>>
<<2025-Apr-17 04:48>> Traceback (most recent call last):
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 04:48>> response = self._make_request(
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 04:48>> raise new_e
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 04:48>> self._validate_conn(conn)
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 04:48>> conn.connect()
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 04:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 04:48>> raise ConnectTimeoutError(
<<2025-Apr-17 04:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 04:48>>
<<2025-Apr-17 04:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:48>>
<<2025-Apr-17 04:48>> Traceback (most recent call last):
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 04:48>> resp = conn.urlopen(
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 04:48>> retries = retries.increment(
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 04:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 04:48>>
<<2025-Apr-17 04:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 04:48>>
<<2025-Apr-17 04:48>> Traceback (most recent call last):
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 04:48>> main()
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 04:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 04:48>> cmds = commands.get_cmds(
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 04:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 04:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 04:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 04:48>> html = get_occweb_page(
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 04:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 04:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 04:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 04:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 04:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 04:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 04:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 04:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 04:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 04:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:08:56:00.000&tstop=2025:110:00:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 04:58>> Traceback (most recent call last):
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 04:58>> sock = connection.create_connection(
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 04:58>> raise err
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 04:58>> sock.connect(sa)
<<2025-Apr-17 04:58>> TimeoutError: timed out
<<2025-Apr-17 04:58>>
<<2025-Apr-17 04:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:58>>
<<2025-Apr-17 04:58>> Traceback (most recent call last):
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 04:58>> response = self._make_request(
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 04:58>> raise new_e
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 04:58>> self._validate_conn(conn)
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 04:58>> conn.connect()
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 04:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 04:58>> raise ConnectTimeoutError(
<<2025-Apr-17 04:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 04:58>>
<<2025-Apr-17 04:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 04:58>>
<<2025-Apr-17 04:58>> Traceback (most recent call last):
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 04:58>> resp = conn.urlopen(
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 04:58>> retries = retries.increment(
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 04:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 04:58>>
<<2025-Apr-17 04:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 04:58>>
<<2025-Apr-17 04:58>> Traceback (most recent call last):
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 04:58>> main()
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 04:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 04:58>> cmds = commands.get_cmds(
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 04:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 04:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 04:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 04:58>> html = get_occweb_page(
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 04:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 04:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 04:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 04:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 04:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 04:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 04:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 04:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 04:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:06:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 05:07>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:09:06:00.000&tstop=2025:110:00:36:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 05:08>> Traceback (most recent call last):
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 05:08>> sock = connection.create_connection(
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 05:08>> raise err
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 05:08>> sock.connect(sa)
<<2025-Apr-17 05:08>> TimeoutError: timed out
<<2025-Apr-17 05:08>>
<<2025-Apr-17 05:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:08>>
<<2025-Apr-17 05:08>> Traceback (most recent call last):
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 05:08>> response = self._make_request(
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 05:08>> raise new_e
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 05:08>> self._validate_conn(conn)
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 05:08>> conn.connect()
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 05:08>> self.sock = sock = self._new_conn()
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 05:08>> raise ConnectTimeoutError(
<<2025-Apr-17 05:08>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 05:08>>
<<2025-Apr-17 05:08>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:08>>
<<2025-Apr-17 05:08>> Traceback (most recent call last):
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 05:08>> resp = conn.urlopen(
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 05:08>> retries = retries.increment(
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 05:08>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 05:08>>
<<2025-Apr-17 05:08>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 05:08>>
<<2025-Apr-17 05:08>> Traceback (most recent call last):
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 05:08>> main()
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 05:08>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 05:08>> cmds = commands.get_cmds(
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 05:08>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 05:08>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 05:08>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 05:08>> html = get_occweb_page(
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 05:08>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 05:08>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 05:08>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 05:08>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 05:08>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 05:08>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:08>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 05:08>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 05:08>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:16:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 05:17>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:09:16:00.000&tstop=2025:110:00:46:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 05:18>> Traceback (most recent call last):
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 05:18>> sock = connection.create_connection(
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 05:18>> raise err
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 05:18>> sock.connect(sa)
<<2025-Apr-17 05:18>> TimeoutError: timed out
<<2025-Apr-17 05:18>>
<<2025-Apr-17 05:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:18>>
<<2025-Apr-17 05:18>> Traceback (most recent call last):
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 05:18>> response = self._make_request(
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 05:18>> raise new_e
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 05:18>> self._validate_conn(conn)
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 05:18>> conn.connect()
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 05:18>> self.sock = sock = self._new_conn()
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 05:18>> raise ConnectTimeoutError(
<<2025-Apr-17 05:18>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 05:18>>
<<2025-Apr-17 05:18>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:18>>
<<2025-Apr-17 05:18>> Traceback (most recent call last):
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 05:18>> resp = conn.urlopen(
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 05:18>> retries = retries.increment(
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 05:18>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 05:18>>
<<2025-Apr-17 05:18>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 05:18>>
<<2025-Apr-17 05:18>> Traceback (most recent call last):
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 05:18>> main()
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 05:18>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 05:18>> cmds = commands.get_cmds(
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 05:18>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 05:18>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 05:18>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 05:18>> html = get_occweb_page(
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 05:18>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 05:18>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 05:18>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 05:18>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 05:18>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 05:18>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:18>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 05:18>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 05:18>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:26:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 05:27>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:09:26:00.000&tstop=2025:110:00:56:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 05:28>> Traceback (most recent call last):
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 05:28>> sock = connection.create_connection(
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 05:28>> raise err
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 05:28>> sock.connect(sa)
<<2025-Apr-17 05:28>> TimeoutError: timed out
<<2025-Apr-17 05:28>>
<<2025-Apr-17 05:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:28>>
<<2025-Apr-17 05:28>> Traceback (most recent call last):
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 05:28>> response = self._make_request(
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 05:28>> raise new_e
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 05:28>> self._validate_conn(conn)
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 05:28>> conn.connect()
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 05:28>> self.sock = sock = self._new_conn()
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 05:28>> raise ConnectTimeoutError(
<<2025-Apr-17 05:28>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 05:28>>
<<2025-Apr-17 05:28>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:28>>
<<2025-Apr-17 05:28>> Traceback (most recent call last):
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 05:28>> resp = conn.urlopen(
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 05:28>> retries = retries.increment(
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 05:28>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 05:28>>
<<2025-Apr-17 05:28>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 05:28>>
<<2025-Apr-17 05:28>> Traceback (most recent call last):
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 05:28>> main()
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 05:28>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 05:28>> cmds = commands.get_cmds(
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 05:28>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 05:28>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 05:28>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 05:28>> html = get_occweb_page(
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 05:28>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 05:28>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 05:28>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 05:28>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 05:28>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 05:28>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:28>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 05:28>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 05:28>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:36:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 05:37>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:09:36:00.000&tstop=2025:110:01:06:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 05:38>> Traceback (most recent call last):
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 05:38>> sock = connection.create_connection(
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 05:38>> raise err
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 05:38>> sock.connect(sa)
<<2025-Apr-17 05:38>> TimeoutError: timed out
<<2025-Apr-17 05:38>>
<<2025-Apr-17 05:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:38>>
<<2025-Apr-17 05:38>> Traceback (most recent call last):
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 05:38>> response = self._make_request(
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 05:38>> raise new_e
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 05:38>> self._validate_conn(conn)
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 05:38>> conn.connect()
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 05:38>> self.sock = sock = self._new_conn()
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 05:38>> raise ConnectTimeoutError(
<<2025-Apr-17 05:38>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 05:38>>
<<2025-Apr-17 05:38>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:38>>
<<2025-Apr-17 05:38>> Traceback (most recent call last):
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 05:38>> resp = conn.urlopen(
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 05:38>> retries = retries.increment(
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 05:38>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 05:38>>
<<2025-Apr-17 05:38>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 05:38>>
<<2025-Apr-17 05:38>> Traceback (most recent call last):
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 05:38>> main()
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 05:38>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 05:38>> cmds = commands.get_cmds(
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 05:38>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 05:38>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 05:38>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 05:38>> html = get_occweb_page(
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 05:38>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 05:38>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 05:38>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 05:38>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 05:38>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 05:38>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:38>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 05:38>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 05:38>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:46:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 05:47>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:09:46:00.000&tstop=2025:110:01:16:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 05:48>> Traceback (most recent call last):
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 05:48>> sock = connection.create_connection(
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 05:48>> raise err
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 05:48>> sock.connect(sa)
<<2025-Apr-17 05:48>> TimeoutError: timed out
<<2025-Apr-17 05:48>>
<<2025-Apr-17 05:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:48>>
<<2025-Apr-17 05:48>> Traceback (most recent call last):
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 05:48>> response = self._make_request(
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 05:48>> raise new_e
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 05:48>> self._validate_conn(conn)
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 05:48>> conn.connect()
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 05:48>> self.sock = sock = self._new_conn()
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 05:48>> raise ConnectTimeoutError(
<<2025-Apr-17 05:48>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 05:48>>
<<2025-Apr-17 05:48>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:48>>
<<2025-Apr-17 05:48>> Traceback (most recent call last):
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 05:48>> resp = conn.urlopen(
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 05:48>> retries = retries.increment(
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 05:48>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 05:48>>
<<2025-Apr-17 05:48>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 05:48>>
<<2025-Apr-17 05:48>> Traceback (most recent call last):
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 05:48>> main()
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 05:48>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 05:48>> cmds = commands.get_cmds(
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 05:48>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 05:48>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 05:48>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 05:48>> html = get_occweb_page(
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 05:48>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 05:48>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 05:48>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 05:48>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 05:48>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 05:48>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:48>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 05:48>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 05:48>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
WARNING - /proj/sot/ska3/flight/share/arc3/get_iFOT_events.pl command timed out Thu Apr 17 05:56:00 2025

############################################################
/proj/sot/ska3/flight/share/arc3/get_web_content.pl
############################################################
<<2025-Apr-17 05:57>> Warning: 500 Can't connect to occweb.cfa.harvard.edu:80 (Connection timed out) for web data orbit_image (http://occweb.cfa.harvard.edu/occweb/web/webapps/ifot/ifot.php?r=home&t=qserver&format=orbit&detail=properties&fg=000000&bg=F0F1FF&size=300x230&scale=1400&showtimes=false&border=false&ul=6&tstart=2025:107:09:56:00.000&tstop=2025:110:01:26:00.000)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Apr-17 05:58>> Traceback (most recent call last):
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
<<2025-Apr-17 05:58>> sock = connection.create_connection(
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
<<2025-Apr-17 05:58>> raise err
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
<<2025-Apr-17 05:58>> sock.connect(sa)
<<2025-Apr-17 05:58>> TimeoutError: timed out
<<2025-Apr-17 05:58>>
<<2025-Apr-17 05:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:58>>
<<2025-Apr-17 05:58>> Traceback (most recent call last):
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Apr-17 05:58>> response = self._make_request(
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
<<2025-Apr-17 05:58>> raise new_e
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
<<2025-Apr-17 05:58>> self._validate_conn(conn)
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
<<2025-Apr-17 05:58>> conn.connect()
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 704, in connect
<<2025-Apr-17 05:58>> self.sock = sock = self._new_conn()
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
<<2025-Apr-17 05:58>> raise ConnectTimeoutError(
<<2025-Apr-17 05:58>> urllib3.exceptions.ConnectTimeoutError: (, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)')
<<2025-Apr-17 05:58>>
<<2025-Apr-17 05:58>> The above exception was the direct cause of the following exception:
<<2025-Apr-17 05:58>>
<<2025-Apr-17 05:58>> Traceback (most recent call last):
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Apr-17 05:58>> resp = conn.urlopen(
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Apr-17 05:58>> retries = retries.increment(
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
<<2025-Apr-17 05:58>> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))
<<2025-Apr-17 05:58>>
<<2025-Apr-17 05:58>> During handling of the above exception, another exception occurred:
<<2025-Apr-17 05:58>>
<<2025-Apr-17 05:58>> Traceback (most recent call last):
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Apr-17 05:58>> main()
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Apr-17 05:58>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2191, in get_states
<<2025-Apr-17 05:58>> cmds = commands.get_cmds(
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Apr-17 05:58>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Apr-17 05:58>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Apr-17 05:58>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Apr-17 05:58>> html = get_occweb_page(
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Apr-17 05:58>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Apr-17 05:58>> return request("get", url, params=params, **kwargs)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Apr-17 05:58>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-17 05:58>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-17 05:58>> r = adapter.send(request, **kwargs)
<<2025-Apr-17 05:58>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-17 05:58>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
<<2025-Apr-17 05:58>> raise ConnectTimeout(e, request=request)
<<2025-Apr-17 05:58>> requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Max retries exceeded with url: /occweb/FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR (Caused by ConnectTimeoutError(, 'Connection to occweb.cfa.harvard.edu timed out. (connect timeout=30)'))