Prev   Index   Next

kalman_watch3: Mon Apr 21 08:31:47 2025

File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log

Task Status AgeMaxAge Last Date
kalman_watch3 NOT OK 0.091.0 Mon Apr 21 08:31:47 2025

Errors:

File contents:

2025-04-21 08:31:10,664 log_run_info: ******************************************
2025-04-21 08:31:10,665 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kalman_watch/kalman_perigee_mon.py
2025-04-21 08:31:10,665 log_run_info: Version: 0.6.0
2025-04-21 08:31:10,665 log_run_info: Time: Mon Apr 21 08:31:10 2025
2025-04-21 08:31:10,665 log_run_info: User: aca
2025-04-21 08:31:10,665 log_run_info: Machine: kady.cfa.harvard.edu
2025-04-21 08:31:10,665 log_run_info: Processing args:
2025-04-21 08:31:10,665 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/flight/www/ASPECT/kalman_watch3'),
2025-04-21 08:31:10,665 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2025-04-21 08:31:10,665 log_run_info: 'lookback': 14,
2025-04-21 08:31:10,665 log_run_info: 'make_html': True,
2025-04-21 08:31:10,665 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/flight/data/stk/radiation_data.fits'),
2025-04-21 08:31:10,665 log_run_info: 'stop': None}
2025-04-21 08:31:10,665 log_run_info: ******************************************
2025-04-21 08:31:10,667 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2025-04-21 08:31:10,686 get_evts_perigee: Getting perigee events between 2025:097:12:31:10.665 and 2025:111:12:31:10.665
2025-04-21 08:31:12,152 _get_tlm: Getting telemetry for 2025:111:06:06:32.696
2025-04-21 08:31:12,707 get_evts_perigee: No TLM found for perigee event at 2025:111:06:06:32.696, skipping
2025-04-21 08:31:12,707 get_evts_perigee: Found 0 new perigee event(s)
2025-04-21 08:31:12,707 main: No new perigee events, exiting
2025-04-21 08:31:16,831 get_manvrs_perigee: Getting maneuvers from 2025:066:12:31:16.830 to 2025:110:12:31:16.831
Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 534, in _make_request
response = conn.getresponse()
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connection.py", line 516, in getresponse
httplib_response = super().getresponse()
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 1428, in getresponse
response.begin()
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 331, in begin
version, status, reason = self._read_status()
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/http/client.py", line 292, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/socket.py", line 720, in readinto
return self._sock.recv_into(b)
^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1251, in recv_into
return self.read(nbytes, buffer)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/ssl.py", line 1103, in read
return self._sslobj.read(len, buffer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TimeoutError: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment
raise reraise(type(error), error, _stacktrace)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise
raise value
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Read timed out. (read timeout=30)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kalman_watch_monitor_win_perigee", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kalman_watch/monitor_win_perigee.py", line 398, in main
kalman_drops_nman_list = [] if opt.skip_mon else get_kalman_drops_nman(start, stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kalman_watch/kalman_watch_data.py", line 1061, in get_kalman_drops_nman
manvrs_perigee = get_manvrs_perigee(start, stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kalman_watch/kalman_watch_data.py", line 592, in get_manvrs_perigee
cmds = get_cmds(start, stop)
^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 283, in get_cmds
cmds_recent = update_cmd_events_and_loads_and_get_cmds_recent(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 426, in update_cmd_events_and_loads_and_get_cmds_recent
loads = update_loads(scenario, lookback=lookback, stop_loads=stop_loads)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/commands/commands_v2.py", line 1190, in update_loads
contents = occweb.get_occweb_dir(dir_year_month)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 367, in get_occweb_dir
html = get_occweb_page(
^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/kadi/occweb.py", line 328, in get_occweb_page
req = requests.get(url, auth=auth, timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.12/site-packages/requests/adapters.py", line 713, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='occweb.cfa.harvard.edu', port=443): Read timed out. (read timeout=30)