Prev   Index   Next

arc: Tue Jul 8 06:00:56 2025

File: /proj/sot/ska/data/arc/Logs/daily.0/arc.log

Task Status AgeMaxAge Last Date
arc NOT OK 0.202.0 Tue Jul 8 06:00:56 2025

Errors:

File contents:


############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-07 07:17>> Traceback (most recent call last):
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 534, in _make_request
<<2025-Jul-07 07:17>> response = conn.getresponse()
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 516, in getresponse
<<2025-Jul-07 07:17>> httplib_response = super().getresponse()
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1428, in getresponse
<<2025-Jul-07 07:17>> response.begin()
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 331, in begin
<<2025-Jul-07 07:17>> version, status, reason = self._read_status()
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 292, in _read_status
<<2025-Jul-07 07:17>> line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/socket.py", line 720, in readinto
<<2025-Jul-07 07:17>> return self._sock.recv_into(b)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1251, in recv_into
<<2025-Jul-07 07:17>> return self.read(nbytes, buffer)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1103, in read
<<2025-Jul-07 07:17>> return self._sslobj.read(len, buffer)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> TimeoutError: The read operation timed out
<<2025-Jul-07 07:17>>
<<2025-Jul-07 07:17>> The above exception was the direct cause of the following exception:
<<2025-Jul-07 07:17>>
<<2025-Jul-07 07:17>> Traceback (most recent call last):
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Jul-07 07:17>> resp = conn.urlopen(
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Jul-07 07:17>> retries = retries.increment(
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment
<<2025-Jul-07 07:17>> raise reraise(type(error), error, _stacktrace)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise
<<2025-Jul-07 07:17>> raise value
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Jul-07 07:17>> response = self._make_request(
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request
<<2025-Jul-07 07:17>> self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
<<2025-Jul-07 07:17>> raise ReadTimeoutError(
<<2025-Jul-07 07:17>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)
<<2025-Jul-07 07:17>>
<<2025-Jul-07 07:17>> During handling of the above exception, another exception occurred:
<<2025-Jul-07 07:17>>
<<2025-Jul-07 07:17>> Traceback (most recent call last):
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Jul-07 07:17>> main()
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Jul-07 07:17>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2334, in get_states
<<2025-Jul-07 07:17>> cmds = commands.get_cmds(
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Jul-07 07:17>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 412, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Jul-07 07:17>> cmd_events = update_cmd_events(scenario, event_filter)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1054, in update_cmd_events
<<2025-Jul-07 07:17>> cmd_events = get_cmd_events_from_sheet(scenario)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1098, in get_cmd_events_from_sheet
<<2025-Jul-07 07:17>> req = requests.get(url, timeout=30)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Jul-07 07:17>> return request("get", url, params=params, **kwargs)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Jul-07 07:17>> return session.request(method=method, url=url, **kwargs)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Jul-07 07:17>> resp = self.send(prep, **send_kwargs)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Jul-07 07:17>> r = adapter.send(request, **kwargs)
<<2025-Jul-07 07:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 07:17>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 713, in send
<<2025-Jul-07 07:17>> raise ReadTimeout(e, request=request)
<<2025-Jul-07 07:17>> requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-07 08:37>> Traceback (most recent call last):
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 534, in _make_request
<<2025-Jul-07 08:37>> response = conn.getresponse()
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 516, in getresponse
<<2025-Jul-07 08:37>> httplib_response = super().getresponse()
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1428, in getresponse
<<2025-Jul-07 08:37>> response.begin()
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 331, in begin
<<2025-Jul-07 08:37>> version, status, reason = self._read_status()
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 292, in _read_status
<<2025-Jul-07 08:37>> line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/socket.py", line 720, in readinto
<<2025-Jul-07 08:37>> return self._sock.recv_into(b)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1251, in recv_into
<<2025-Jul-07 08:37>> return self.read(nbytes, buffer)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1103, in read
<<2025-Jul-07 08:37>> return self._sslobj.read(len, buffer)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> TimeoutError: The read operation timed out
<<2025-Jul-07 08:37>>
<<2025-Jul-07 08:37>> The above exception was the direct cause of the following exception:
<<2025-Jul-07 08:37>>
<<2025-Jul-07 08:37>> Traceback (most recent call last):
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Jul-07 08:37>> resp = conn.urlopen(
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Jul-07 08:37>> retries = retries.increment(
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment
<<2025-Jul-07 08:37>> raise reraise(type(error), error, _stacktrace)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise
<<2025-Jul-07 08:37>> raise value
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Jul-07 08:37>> response = self._make_request(
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request
<<2025-Jul-07 08:37>> self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
<<2025-Jul-07 08:37>> raise ReadTimeoutError(
<<2025-Jul-07 08:37>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Read timed out. (read timeout=30)
<<2025-Jul-07 08:37>>
<<2025-Jul-07 08:37>> During handling of the above exception, another exception occurred:
<<2025-Jul-07 08:37>>
<<2025-Jul-07 08:37>> Traceback (most recent call last):
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Jul-07 08:37>> main()
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Jul-07 08:37>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2334, in get_states
<<2025-Jul-07 08:37>> cmds = commands.get_cmds(
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Jul-07 08:37>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Jul-07 08:37>> loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
<<2025-Jul-07 08:37>> contents = occweb.get_occweb_dir(dir_year_month)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
<<2025-Jul-07 08:37>> html = get_occweb_page(
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
<<2025-Jul-07 08:37>> req = requests.get(url, auth=auth, timeout=timeout)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Jul-07 08:37>> return request("get", url, params=params, **kwargs)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Jul-07 08:37>> return session.request(method=method, url=url, **kwargs)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Jul-07 08:37>> resp = self.send(prep, **send_kwargs)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Jul-07 08:37>> r = adapter.send(request, **kwargs)
<<2025-Jul-07 08:37>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:37>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 713, in send
<<2025-Jul-07 08:37>> raise ReadTimeout(e, request=request)
<<2025-Jul-07 08:37>> requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Read timed out. (read timeout=30)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-07 08:42>> Traceback (most recent call last):
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 534, in _make_request
<<2025-Jul-07 08:42>> response = conn.getresponse()
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 516, in getresponse
<<2025-Jul-07 08:42>> httplib_response = super().getresponse()
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1428, in getresponse
<<2025-Jul-07 08:42>> response.begin()
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 331, in begin
<<2025-Jul-07 08:42>> version, status, reason = self._read_status()
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 292, in _read_status
<<2025-Jul-07 08:42>> line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/socket.py", line 720, in readinto
<<2025-Jul-07 08:42>> return self._sock.recv_into(b)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1251, in recv_into
<<2025-Jul-07 08:42>> return self.read(nbytes, buffer)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1103, in read
<<2025-Jul-07 08:42>> return self._sslobj.read(len, buffer)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> TimeoutError: The read operation timed out
<<2025-Jul-07 08:42>>
<<2025-Jul-07 08:42>> The above exception was the direct cause of the following exception:
<<2025-Jul-07 08:42>>
<<2025-Jul-07 08:42>> Traceback (most recent call last):
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
<<2025-Jul-07 08:42>> resp = conn.urlopen(
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
<<2025-Jul-07 08:42>> retries = retries.increment(
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment
<<2025-Jul-07 08:42>> raise reraise(type(error), error, _stacktrace)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise
<<2025-Jul-07 08:42>> raise value
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
<<2025-Jul-07 08:42>> response = self._make_request(
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request
<<2025-Jul-07 08:42>> self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
<<2025-Jul-07 08:42>> raise ReadTimeoutError(
<<2025-Jul-07 08:42>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='doc-0s-60-sheets.googleusercontent.com', port=443): Read timed out. (read timeout=30)
<<2025-Jul-07 08:42>>
<<2025-Jul-07 08:42>> During handling of the above exception, another exception occurred:
<<2025-Jul-07 08:42>>
<<2025-Jul-07 08:42>> Traceback (most recent call last):
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 1255, in
<<2025-Jul-07 08:42>> main()
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/share/arc3/make_timeline.py", line 634, in main
<<2025-Jul-07 08:42>> states = kadi_states.get_states(start=start, stop=stop)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/states.py", line 2334, in get_states
<<2025-Jul-07 08:42>> cmds = commands.get_cmds(
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
<<2025-Jul-07 08:42>> cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 412, in update_cmd_events_and_loads_and_get_cmds_recent
<<2025-Jul-07 08:42>> cmd_events = update_cmd_events(scenario, event_filter)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1054, in update_cmd_events
<<2025-Jul-07 08:42>> cmd_events = get_cmd_events_from_sheet(scenario)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1098, in get_cmd_events_from_sheet
<<2025-Jul-07 08:42>> req = requests.get(url, timeout=30)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
<<2025-Jul-07 08:42>> return request("get", url, params=params, **kwargs)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
<<2025-Jul-07 08:42>> return session.request(method=method, url=url, **kwargs)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
<<2025-Jul-07 08:42>> resp = self.send(prep, **send_kwargs)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 724, in send
<<2025-Jul-07 08:42>> history = [resp for resp in gen]
<<2025-Jul-07 08:42>> ^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 265, in resolve_redirects
<<2025-Jul-07 08:42>> resp = self.send(
<<2025-Jul-07 08:42>> ^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
<<2025-Jul-07 08:42>> r = adapter.send(request, **kwargs)
<<2025-Jul-07 08:42>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Jul-07 08:42>> File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 713, in send
<<2025-Jul-07 08:42>> raise ReadTimeout(e, request=request)
<<2025-Jul-07 08:42>> requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='doc-0s-60-sheets.googleusercontent.com', port=443): Read timed out. (read timeout=30)

############################################################
/proj/sot/ska3/flight/share/arc3/get_goes_x.py --h5=/proj/sot/ska3/flight/data/arc3/GOES_X.h5
############################################################
<<2025-Jul-07 13:01>> Malformed GOES_X data from SWPC; Table(json.loads(urldat)) did not succeed: Unterminated string starting at: line 1 column 163501 (char 163500)

############################################################
/proj/sot/ska3/flight/share/arc3/get_goes_x.py --h5=/proj/sot/ska3/flight/data/arc3/GOES_X.h5
############################################################
<<2025-Jul-07 13:46>> Malformed GOES_X data from SWPC; Table(json.loads(urldat)) did not succeed: Expecting value: line 1 column 163061 (char 163060)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 05:25>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 05:30>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 05:35>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 05:40>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 05:45>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 05:51>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 05:56>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)

############################################################
/proj/sot/ska3/flight/share/arc3/make_timeline.py --data-dir=/proj/sot/ska3/flight/data/arc3
############################################################
<<2025-Jul-08 06:00>> WARNING: /data/mta4/www/ace.html file contains 0 lines that start with AVERAGE (expect one)