Prev
Index
Next
kadi: Thu Sep 24 08:36:59 2026
File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log
| Task | Status | Age | MaxAge | Last Date |
| kadi |
OK
|
0.09 | 1.5 |
Thu Sep 24 08:36:59 2026 |
No errors
File contents:
2026-09-24 08:36:05,853 run_validators: Validating pitch
2026-09-24 08:36:05,853 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2026:253:12:20:35.853 to 2026:267:12:51:35.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4166:1096192]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2026-09-24 08:36:08,585 tlm: Fetching telemetry for ['pitch_comp'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for pitch_comp between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2026:253:12:05:35.853 to 2026:267:13:06:35.853
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 905429205.0369998 to 906642465.0369996
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3288:1096192]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2026:253:12:21:05.853 to 2026:266:11:16:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4195:1096192]
_get_data: Getting data for orbitephem0_x between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [5186:8921]
_get_data: Getting data for orbitephem0_y between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for orbitephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [5186:8921]
_get_data: Getting data for orbitephem0_z between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for orbitephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [5186:8921]
_get_data: Getting data for solarephem0_x between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [5186:8921]
_get_data: Getting data for solarephem0_y between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for solarephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [5186:8921]
_get_data: Getting data for solarephem0_z between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for solarephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [5186:8921]
_get_data: Getting data for aoattqt1 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [3493:1096192]
_get_data: Getting data for aoattqt2 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for pcad3eng 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [3493:1096192]
_get_data: Getting data for aoattqt3 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for pcad3eng 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [3493:1096192]
_get_data: Getting data for aoattqt4 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for pcad3eng 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [3493:1096192]
fetch: Setting bads because of gaps in aoattqt1 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
fetch: Setting bads because of gaps in aoattqt2 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
fetch: Setting bads because of gaps in aoattqt3 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
fetch: Setting bads because of gaps in aoattqt4 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2026:267:05:42:31.205 to 2026:267:05:43:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [2208:2208]
_get_data: Getting data for orbitephem0_x between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9138:9143]
_get_data: Getting data for orbitephem0_y between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9138:9143]
_get_data: Getting data for orbitephem0_z between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9138:9143]
_get_data: Getting data for solarephem0_x between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9138:9143]
_get_data: Getting data for solarephem0_y between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9138:9143]
_get_data: Getting data for solarephem0_z between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9138:9143]
_get_data: Getting data for aoattqt1 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2208:2208]
_get_data: Getting data for aoattqt2 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2208:2208]
_get_data: Getting data for aoattqt3 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2208:2208]
_get_data: Getting data for aoattqt4 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2208:2208]
fetch: Setting bads because of gaps in aoattqt1 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
fetch: Setting bads because of gaps in aoattqt2 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
fetch: Setting bads because of gaps in aoattqt3 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
fetch: Setting bads because of gaps in aoattqt4 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2026:267:05:44:11.655 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615920.839 to 906641535.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [2208:2208]
_get_data: Getting data for orbitephem0_x between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9138:9228]
_get_data: Getting data for orbitephem0_y between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9138:9228]
_get_data: Getting data for orbitephem0_z between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9138:9228]
_get_data: Getting data for solarephem0_x between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9138:9228]
_get_data: Getting data for solarephem0_y between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9138:9228]
_get_data: Getting data for solarephem0_z between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9138:9228]
_get_data: Getting data for aoattqt1 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2208:2208]
_get_data: Getting data for aoattqt2 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2208:2208]
_get_data: Getting data for aoattqt3 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2208:2208]
_get_data: Getting data for aoattqt4 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2208:2208]
fetch: Setting bads because of gaps in aoattqt1 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
fetch: Setting bads because of gaps in aoattqt2 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
fetch: Setting bads because of gaps in aoattqt3 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
fetch: Setting bads because of gaps in aoattqt4 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2026-09-24 08:36:13,648 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:13,648 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2026:253:12:36:06.616 - 2026:267:06:22:04.691
2026-09-24 08:36:13,648 get_cmds: Getting commands from 2026:253:12:36:06.616 to 2026:267:06:22:04.691 for scenario=None
2026-09-24 08:36:13,648 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:13,649 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2026-09-24 08:36:13,649 read_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2026-09-24 08:36:14,687 get_cmd_events_from_sheet: Writing 174 cmd_events to /home/aca/.kadi/cmd_events.csv
2026-09-24 08:36:14,696 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2026/AUG with cache=False
2026-09-24 08:36:14,871 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/AUG3126A.pkl.gz
2026-09-24 08:36:14,878 add_scheduled_obsid_cmds: Adding 54 OBSID load event commands
2026-09-24 08:36:14,879 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2026/SEP with cache=False
2026-09-24 08:36:14,949 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/SEP0726A.pkl.gz
2026-09-24 08:36:14,954 add_scheduled_obsid_cmds: Adding 47 OBSID load event commands
2026-09-24 08:36:14,956 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/SEP1426A.pkl.gz
2026-09-24 08:36:14,962 add_scheduled_obsid_cmds: Adding 55 OBSID load event commands
2026-09-24 08:36:14,963 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/SEP2126A.pkl.gz
2026-09-24 08:36:14,968 add_scheduled_obsid_cmds: Adding 45 OBSID load event commands
2026-09-24 08:36:14,970 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2026/OCT with cache=False
2026-09-24 08:36:15,019 update_cmd_events_and_loads_and_get_cmds_recent: Including loads AUG3126A, SEP0726A, SEP1426A, SEP2126A
2026-09-24 08:36:15,025 add_scheduled_obsid_cmds: Adding 54 OBSID load event commands
2026-09-24 08:36:15,026 update_cmd_events_and_loads_and_get_cmds_recent: Load AUG3126A has 2657 commands with RLTT=2026:242:22:06:33.837
2026-09-24 08:36:15,031 add_scheduled_obsid_cmds: Adding 47 OBSID load event commands
2026-09-24 08:36:15,032 update_cmd_events_and_loads_and_get_cmds_recent: Load SEP0726A has 2266 commands with RLTT=2026:250:02:17:56.780
2026-09-24 08:36:15,037 add_scheduled_obsid_cmds: Adding 55 OBSID load event commands
2026-09-24 08:36:15,038 update_cmd_events_and_loads_and_get_cmds_recent: Load SEP1426A has 2183 commands with RLTT=2026:257:02:09:19.867
2026-09-24 08:36:15,043 add_scheduled_obsid_cmds: Adding 45 OBSID load event commands
2026-09-24 08:36:15,044 update_cmd_events_and_loads_and_get_cmds_recent: Load SEP2126A has 2179 commands with RLTT=2026:264:01:05:49.560
2026-09-24 08:36:15,076 update_cmd_events_and_loads_and_get_cmds_recent: Including cmd_events:
Dither at 2026:238:20:48:35.257
Dither at 2026:237:15:35:25.650
Command at 2026:236:16:09:00.213
Dither at 2026:236:15:51:54.445
2026-09-24 08:36:15,082 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT Dither at 2026:236:15:51:54.445 with 1 commands
2026-09-24 08:36:15,082 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1 commands from CMD_EVT Dither at 2026:236:15:51:54.445
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT Command at 2026:236:16:09:00.213 with 1 commands
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1 commands from CMD_EVT Command at 2026:236:16:09:00.213
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT Dither at 2026:237:15:35:25.650 with 1 commands
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1 commands from CMD_EVT Dither at 2026:237:15:35:25.650
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT Dither at 2026:238:20:48:35.257 with 1 commands
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1 commands from CMD_EVT Dither at 2026:238:20:48:35.257
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Processing AUG3126A with 2657 commands
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2657 commands from AUG3126A
2026-09-24 08:36:15,083 update_cmd_events_and_loads_and_get_cmds_recent: Processing SEP0726A with 2266 commands
2026-09-24 08:36:15,084 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2266 commands from SEP0726A
2026-09-24 08:36:15,084 update_cmd_events_and_loads_and_get_cmds_recent: Processing SEP1426A with 2183 commands
2026-09-24 08:36:15,084 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2183 commands from SEP1426A
2026-09-24 08:36:15,084 update_cmd_events_and_loads_and_get_cmds_recent: Processing SEP2126A with 2179 commands
2026-09-24 08:36:15,084 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2179 commands from SEP2126A
2026-09-24 08:36:15,526 load_pars_dict: Loaded /proj/sot/ska3/aca/data/kadi/cmds3.pkl with 207732 pars
2026-09-24 08:36:15,541 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:15,543 get_cmds: Getting commands from 2026:246:12:36:06.616 to 2026:253:12:36:06.616 for scenario=None
2026-09-24 08:36:15,543 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:15,544 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:15,545 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:20,555 get_plot_figure: Compressing Telem data for state pitch
2026-09-24 08:36:22,607 get_plot_figure: Creating Telem scatter plot for state pitch
2026-09-24 08:36:22,748 get_plot_figure: Compressing State data for state pitch
2026-09-24 08:36:24,458 get_plot_figure: Creating State scatter plot for state pitch
2026-09-24 08:36:24,524 get_plot_html: Creating HTML for state pitch
2026-09-24 08:36:24,618 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2026:253:12:20:35.853 to 2026:267:12:51:35.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4166:1096192]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2026-09-24 08:36:24,897 tlm: Fetching telemetry for ['roll_comp'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for roll_comp between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2026:253:12:05:35.853 to 2026:267:13:06:35.853
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 905429205.0369998 to 906642465.0369996
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3288:1096192]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2026:253:12:21:05.853 to 2026:266:11:16:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4195:1096192]
_get_data: Getting data for orbitephem0_x between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [5186:8921]
_get_data: Getting data for orbitephem0_y between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for orbitephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [5186:8921]
_get_data: Getting data for orbitephem0_z between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for orbitephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [5186:8921]
_get_data: Getting data for solarephem0_x between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [5186:8921]
_get_data: Getting data for solarephem0_y between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for solarephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [5186:8921]
_get_data: Getting data for solarephem0_z between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for solarephem0 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [5186:8921]
_get_data: Getting data for aoattqt1 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [3493:1096192]
_get_data: Getting data for aoattqt2 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for pcad3eng 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [3493:1096192]
_get_data: Getting data for aoattqt3 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for pcad3eng 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [3493:1096192]
_get_data: Getting data for aoattqt4 between 2026:253:12:09:05.853 to 2026:266:11:28:14.986
_get_msid_data_from_cxc: Using times_cache for pcad3eng 905429415.0369998 to 906550164.17
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [3493:1096192]
fetch: Setting bads because of gaps in aoattqt1 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
fetch: Setting bads because of gaps in aoattqt2 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
fetch: Setting bads because of gaps in aoattqt3 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
fetch: Setting bads because of gaps in aoattqt4 between 2026:266:11:16:18.966 to 2026:266:11:28:14.416
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2026:267:05:42:31.205 to 2026:267:05:43:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [2208:2208]
_get_data: Getting data for orbitephem0_x between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9138:9143]
_get_data: Getting data for orbitephem0_y between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9138:9143]
_get_data: Getting data for orbitephem0_z between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9138:9143]
_get_data: Getting data for solarephem0_x between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9138:9143]
_get_data: Getting data for solarephem0_y between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9138:9143]
_get_data: Getting data for solarephem0_z between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9138:9143]
_get_data: Getting data for aoattqt1 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2208:2208]
_get_data: Getting data for aoattqt2 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2208:2208]
_get_data: Getting data for aoattqt3 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2208:2208]
_get_data: Getting data for aoattqt4 between 2026:267:05:30:31.205 to 2026:267:05:55:36.830
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615100.3889998 to 906616606.0139998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2208:2208]
fetch: Setting bads because of gaps in aoattqt1 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
fetch: Setting bads because of gaps in aoattqt2 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
fetch: Setting bads because of gaps in aoattqt3 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
fetch: Setting bads because of gaps in aoattqt4 between 2026:267:05:30:30.216 to 2026:267:05:44:08.166
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2026:267:05:44:11.655 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615920.839 to 906641535.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [2208:2208]
_get_data: Getting data for orbitephem0_x between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9138:9228]
_get_data: Getting data for orbitephem0_y between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9138:9228]
_get_data: Getting data for orbitephem0_z between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for orbitephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9138:9228]
_get_data: Getting data for solarephem0_x between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9138:9228]
_get_data: Getting data for solarephem0_y between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9138:9228]
_get_data: Getting data for solarephem0_z between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for solarephem0 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9138:9228]
_get_data: Getting data for aoattqt1 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2208:2208]
_get_data: Getting data for aoattqt2 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2208:2208]
_get_data: Getting data for aoattqt3 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2208:2208]
_get_data: Getting data for aoattqt4 between 2026:267:05:32:11.655 to 2026:267:13:03:05.853
_get_msid_data_from_cxc: Using times_cache for pcad3eng 906615200.839 to 906642255.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2208:2208]
fetch: Setting bads because of gaps in aoattqt1 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
fetch: Setting bads because of gaps in aoattqt2 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
fetch: Setting bads because of gaps in aoattqt3 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
fetch: Setting bads because of gaps in aoattqt4 between 2026:267:05:32:10.666 to 2026:267:13:03:05.541
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2026-09-24 08:36:26,998 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:26,998 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2026:253:12:36:06.616 - 2026:267:06:22:04.691
2026-09-24 08:36:26,998 get_cmds: Getting commands from 2026:253:12:36:06.616 to 2026:267:06:22:04.691 for scenario=None
2026-09-24 08:36:26,998 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:26,999 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:27,000 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:27,002 get_cmds: Getting commands from 2026:246:12:36:06.616 to 2026:253:12:36:06.616 for scenario=None
2026-09-24 08:36:27,002 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:27,003 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:27,003 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:31,194 get_plot_figure: Compressing Telem data for state off_nom_roll
2026-09-24 08:36:33,022 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2026-09-24 08:36:33,045 get_plot_figure: Compressing State data for state off_nom_roll
2026-09-24 08:36:34,751 get_plot_figure: Creating State scatter plot for state off_nom_roll
2026-09-24 08:36:34,806 get_plot_html: Creating HTML for state off_nom_roll
2026-09-24 08:36:34,831 run_validators: Validating dither
_get_data: Getting data for conlofp between 2026:253:12:20:35.853 to 2026:267:12:51:35.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4166:1096192]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2026-09-24 08:36:35,174 get_cmds: Getting commands from 2026:253:12:16:05.853 to 2026:267:12:36:05.853 for scenario=None
2026-09-24 08:36:35,175 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:35,175 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:35,176 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:35,221 add_exclude_interval: dither: excluding interval 2026:254:00:24:59.000 - 2026:254:00:37:59.000: SRDC
2026-09-24 08:36:35,222 add_exclude_interval: dither: excluding interval 2026:256:10:39:59.000 - 2026:256:10:52:59.000: SRDC
2026-09-24 08:36:35,224 add_exclude_interval: dither: excluding interval 2026:261:19:09:00.000 - 2026:261:19:22:00.000: SRDC
2026-09-24 08:36:35,225 add_exclude_interval: dither: excluding interval 2026:261:23:49:00.000 - 2026:262:00:02:00.000: SRDC
2026-09-24 08:36:35,226 add_exclude_interval: dither: excluding interval 2026:264:11:14:59.000 - 2026:264:11:27:59.000: SRDC
2026-09-24 08:36:35,227 tlm: Fetching telemetry for ['aodithen'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for aodithen between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [525:137024]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2026-09-24 08:36:35,400 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:35,401 get_states: Getting commanded states ['dither'] between 2026:253:12:36:13.311 - 2026:267:06:21:59.743
2026-09-24 08:36:35,401 get_cmds: Getting commands from 2026:253:12:36:13.311 to 2026:267:06:21:59.743 for scenario=None
2026-09-24 08:36:35,401 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:35,402 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:35,402 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:35,404 get_cmds: Getting commands from 2026:246:12:36:13.311 to 2026:253:12:36:13.311 for scenario=None
2026-09-24 08:36:35,405 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:35,405 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:35,406 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:36,249 get_plot_figure: Compressing Telem data for state dither
2026-09-24 08:36:36,461 get_plot_figure: Creating Telem scatter plot for state dither
2026-09-24 08:36:36,463 get_plot_figure: Compressing State data for state dither
2026-09-24 08:36:36,674 get_plot_figure: Creating State scatter plot for state dither
2026-09-24 08:36:36,712 get_plot_html: Creating HTML for state dither
2026-09-24 08:36:36,734 run_validators: Validating pcad_mode
2026-09-24 08:36:36,745 get_cmds: Getting commands from 2026:253:12:16:05.853 to 2026:267:12:36:05.853 for scenario=None
2026-09-24 08:36:36,745 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:36,746 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:36,746 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:36,792 add_exclude_interval: pcad_mode: excluding interval 2026:254:00:24:59.000 - 2026:254:00:37:59.000: SRDC
2026-09-24 08:36:36,794 add_exclude_interval: pcad_mode: excluding interval 2026:256:10:39:59.000 - 2026:256:10:52:59.000: SRDC
2026-09-24 08:36:36,795 add_exclude_interval: pcad_mode: excluding interval 2026:261:19:09:00.000 - 2026:261:19:22:00.000: SRDC
2026-09-24 08:36:36,797 add_exclude_interval: pcad_mode: excluding interval 2026:261:23:49:00.000 - 2026:262:00:02:00.000: SRDC
2026-09-24 08:36:36,798 add_exclude_interval: pcad_mode: excluding interval 2026:264:11:14:59.000 - 2026:264:11:27:59.000: SRDC
2026-09-24 08:36:36,799 tlm: Fetching telemetry for ['aopcadmd'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for aopcadmd between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4195:1096192]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2026-09-24 08:36:37,226 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:37,226 get_states: Getting commanded states ['pcad_mode'] between 2026:253:12:36:06.136 - 2026:267:06:22:05.893
2026-09-24 08:36:37,226 get_cmds: Getting commands from 2026:253:12:36:06.136 to 2026:267:06:22:05.893 for scenario=None
2026-09-24 08:36:37,227 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:37,227 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:37,228 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:37,230 get_cmds: Getting commands from 2026:246:12:36:06.136 to 2026:253:12:36:06.136 for scenario=None
2026-09-24 08:36:37,230 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:37,231 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:37,231 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:41,558 get_plot_figure: Compressing Telem data for state pcad_mode
2026-09-24 08:36:43,239 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2026-09-24 08:36:43,243 get_plot_figure: Compressing State data for state pcad_mode
2026-09-24 08:36:44,928 get_plot_figure: Creating State scatter plot for state pcad_mode
2026-09-24 08:36:44,987 get_plot_html: Creating HTML for state pcad_mode
2026-09-24 08:36:45,010 run_validators: Validating simpos
2026-09-24 08:36:45,016 tlm: Fetching telemetry for ['3tscpos'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for 3tscpos between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [131:34184]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2026-09-24 08:36:45,231 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:45,231 get_states: Getting commanded states ['simpos'] between 2026:253:12:36:21.511 - 2026:267:06:22:00.256
2026-09-24 08:36:45,231 get_cmds: Getting commands from 2026:253:12:36:21.511 to 2026:267:06:22:00.256 for scenario=None
2026-09-24 08:36:45,232 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:45,232 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:45,233 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:45,235 get_cmds: Getting commands from 2026:246:12:36:21.511 to 2026:253:12:36:21.511 for scenario=None
2026-09-24 08:36:45,235 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:45,236 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:45,236 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:45,353 get_plot_figure: Compressing Telem data for state simpos
2026-09-24 08:36:45,408 get_plot_figure: Creating Telem scatter plot for state simpos
2026-09-24 08:36:45,411 get_plot_figure: Compressing State data for state simpos
2026-09-24 08:36:45,464 get_plot_figure: Creating State scatter plot for state simpos
2026-09-24 08:36:45,473 get_plot_html: Creating HTML for state simpos
2026-09-24 08:36:45,495 run_validators: Validating obsid
2026-09-24 08:36:45,501 tlm: Fetching telemetry for ['cobsrqid'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for cobsrqid between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [2098:548096]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2026-09-24 08:36:45,718 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:45,718 get_states: Getting commanded states ['obsid'] between 2026:253:12:36:07.161 - 2026:267:06:22:05.637
2026-09-24 08:36:45,719 get_cmds: Getting commands from 2026:253:12:36:07.161 to 2026:267:06:22:05.637 for scenario=None
2026-09-24 08:36:45,719 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:45,719 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:45,720 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:45,722 get_cmds: Getting commands from 2026:246:12:36:07.161 to 2026:253:12:36:07.161 for scenario=None
2026-09-24 08:36:45,722 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:45,723 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:45,724 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:47,676 get_plot_figure: Compressing Telem data for state obsid
2026-09-24 08:36:48,521 get_plot_figure: Creating Telem scatter plot for state obsid
2026-09-24 08:36:48,523 get_plot_figure: Compressing State data for state obsid
2026-09-24 08:36:49,364 get_plot_figure: Creating State scatter plot for state obsid
2026-09-24 08:36:49,381 get_plot_html: Creating HTML for state obsid
2026-09-24 08:36:49,404 run_validators: Validating letg
2026-09-24 08:36:49,410 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for 4ootgsel between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [132:34256]
_get_data: Getting data for 4ootgmtn between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Using times_cache for tel2eng 905430135.0369998 to 906641535.0369998
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [132:34256]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2026-09-24 08:36:49,798 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:49,798 get_states: Getting commanded states ['letg'] between 2026:253:12:36:21.511 - 2026:267:06:21:49.237
2026-09-24 08:36:49,798 get_cmds: Getting commands from 2026:253:12:36:21.511 to 2026:267:06:21:49.237 for scenario=None
2026-09-24 08:36:49,799 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:49,799 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:49,800 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:49,802 get_cmds: Getting commands from 2026:246:12:36:21.511 to 2026:253:12:36:21.511 for scenario=None
2026-09-24 08:36:49,802 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:49,803 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:49,803 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:49,810 get_cmds: Getting commands from 2026:223:12:36:21.511 to 2026:253:12:36:21.511 for scenario=None
2026-09-24 08:36:49,811 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:49,811 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:49,812 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2026:223:12:36:21.511
2026-09-24 08:36:51,531 load_idx_cmds: Loaded /proj/sot/ska3/aca/data/kadi/cmds3.h5 with 1860565 commands
2026-09-24 08:36:51,539 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2026-09-24 08:36:51,897 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2026-09-24 08:36:51,897 get_matching_block_idx: Match(a=0, b=0, size=1)
2026-09-24 08:36:51,897 get_matching_block_idx: Match(a=6, b=1, size=1)
2026-09-24 08:36:51,897 get_matching_block_idx: Match(a=353, b=2, size=1)
2026-09-24 08:36:51,897 get_matching_block_idx: Match(a=822, b=3, size=1)
2026-09-24 08:36:51,897 get_matching_block_idx: Match(a=2099, b=4, size=3)
2026-09-24 08:36:51,897 get_matching_block_idx: Match(a=2105, b=7, size=30)
2026-09-24 08:36:51,898 get_matching_block_idx: Match(a=2136, b=37, size=9452)
2026-09-24 08:36:51,898 get_matching_block_idx: Found matching block of size 9452 > 500
2026-09-24 08:36:51,902 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2026-09-24 08:36:51,922 get_cmds: Getting commands from 2026:073:12:36:21.511 to 2026:253:12:36:21.511 for scenario=None
2026-09-24 08:36:51,923 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:51,923 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:51,924 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2026:073:12:36:21.511
2026-09-24 08:36:51,927 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2026-09-24 08:36:52,160 get_plot_figure: Compressing Telem data for state letg
2026-09-24 08:36:52,213 get_plot_figure: Creating Telem scatter plot for state letg
2026-09-24 08:36:52,214 get_plot_figure: Compressing State data for state letg
2026-09-24 08:36:52,266 get_plot_figure: Creating State scatter plot for state letg
2026-09-24 08:36:52,274 get_plot_html: Creating HTML for state letg
2026-09-24 08:36:52,300 run_validators: Validating hetg
2026-09-24 08:36:52,306 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for 4ootgsel between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_data: Getting data for 4ootgmtn between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2026-09-24 08:36:52,319 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:52,319 get_states: Getting commanded states ['hetg'] between 2026:253:12:36:21.511 - 2026:267:06:21:49.237
2026-09-24 08:36:52,319 get_cmds: Getting commands from 2026:253:12:36:21.511 to 2026:267:06:21:49.237 for scenario=None
2026-09-24 08:36:52,319 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:52,320 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:52,321 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:52,322 get_cmds: Getting commands from 2026:246:12:36:21.511 to 2026:253:12:36:21.511 for scenario=None
2026-09-24 08:36:52,323 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:52,323 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:52,324 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:52,331 get_cmds: Getting commands from 2026:223:12:36:21.511 to 2026:253:12:36:21.511 for scenario=None
2026-09-24 08:36:52,331 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:52,332 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:52,333 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2026:223:12:36:21.511
2026-09-24 08:36:52,334 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2026-09-24 08:36:52,355 get_cmds: Getting commands from 2026:073:12:36:21.511 to 2026:253:12:36:21.511 for scenario=None
2026-09-24 08:36:52,355 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:52,356 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:52,356 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2026:073:12:36:21.511
2026-09-24 08:36:52,360 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2026-09-24 08:36:52,605 get_plot_figure: Compressing Telem data for state hetg
2026-09-24 08:36:52,659 get_plot_figure: Creating Telem scatter plot for state hetg
2026-09-24 08:36:52,660 get_plot_figure: Compressing State data for state hetg
2026-09-24 08:36:52,714 get_plot_figure: Creating State scatter plot for state hetg
2026-09-24 08:36:52,721 get_plot_html: Creating HTML for state hetg
2026-09-24 08:36:52,746 run_validators: Validating sun_pos_mon
2026-09-24 08:36:52,754 tlm: Fetching telemetry for ['aopssupm'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for aopssupm between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [525:137024]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2026-09-24 08:36:53,111 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:53,111 get_states: Getting commanded states ['sun_pos_mon'] between 2026:253:12:36:13.311 - 2026:267:06:22:05.125
2026-09-24 08:36:53,112 get_cmds: Getting commands from 2026:253:12:36:13.311 to 2026:267:06:22:05.125 for scenario=None
2026-09-24 08:36:53,112 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:53,112 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:53,113 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:53,115 get_cmds: Getting commands from 2026:246:12:36:13.311 to 2026:253:12:36:13.311 for scenario=None
2026-09-24 08:36:53,115 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:53,116 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:53,117 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:53,130 get_cmds: Getting commands from 2026:223:12:36:13.311 to 2026:253:12:36:13.311 for scenario=None
2026-09-24 08:36:53,131 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:53,131 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:53,133 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2026:223:12:36:13.311
2026-09-24 08:36:53,134 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2026-09-24 08:36:53,156 get_cmds: Getting commands from 2026:073:12:36:13.311 to 2026:253:12:36:13.311 for scenario=None
2026-09-24 08:36:53,156 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:53,157 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:53,157 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2026:073:12:36:13.311
2026-09-24 08:36:53,161 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2026-09-24 08:36:53,678 get_plot_figure: Compressing Telem data for state sun_pos_mon
2026-09-24 08:36:53,886 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2026-09-24 08:36:53,888 get_plot_figure: Compressing State data for state sun_pos_mon
2026-09-24 08:36:54,097 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2026-09-24 08:36:54,111 get_plot_html: Creating HTML for state sun_pos_mon
2026-09-24 08:36:54,133 run_validators: Validating dpa_power
2026-09-24 08:36:54,141 tlm: Fetching telemetry for ['dpa_power'] between 2026:253:12:36:05.853 and 2026:267:12:36:05.853
_get_data: Getting data for dpa_power between 2026:253:12:21:05.853 to 2026:267:12:51:05.853
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/dp_acispow128/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/aca/data/eng_archive/data/dp_acispow128/DP_DPA_POWER.h5
_get_msid_data_from_cxc: Slicing DP_DPA_POWER arrays [241:34160]
interpolate: Interpolating index for dpa_power
interpolate: Slicing on indexes
2026-09-24 08:36:54,474 get_states: Using kadi.commands.states to get cmd_states
2026-09-24 08:36:54,475 get_states: Getting commanded states ['dpa_power'] between 2026:253:12:36:14.816 - 2026:267:06:21:52.312
2026-09-24 08:36:54,475 get_cmds: Getting commands from 2026:253:12:36:14.816 to 2026:267:06:21:52.312 for scenario=None
2026-09-24 08:36:54,475 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:54,475 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:54,476 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:54,478 get_cmds: Getting commands from 2026:246:12:36:14.816 to 2026:253:12:36:14.816 for scenario=None
2026-09-24 08:36:54,478 get_cmds: Cache key: (None, None, 30.0, None)
2026-09-24 08:36:54,479 get_cmds: Getting recent commands from cache cache_key=(None, None, 30.0, None)
2026-09-24 08:36:54,480 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2026-09-24 08:36:57,470 get_plot_figure: Compressing Telem data for state dpa_power
2026-09-24 08:36:57,917 get_plot_figure: Creating Telem scatter plot for state dpa_power
2026-09-24 08:36:58,142 get_plot_figure: Compressing State data for state dpa_power
2026-09-24 08:36:58,198 get_plot_figure: Creating State scatter plot for state dpa_power
2026-09-24 08:36:58,234 get_plot_html: Creating HTML for state dpa_power