Prev
Index
Next
kadi: Wed Mar 5 08:32:07 2025
File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kadi |
OK
|
1.09 | 1.5 |
Wed Mar 5 08:32:07 2025 |
No errors
File contents:
2025-03-05 08:31:07,958 run_validators: Validating pitch
2025-03-05 08:31:07,958 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:050:13:15:37.958 to 2025:064:13:46:37.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4219:1067872]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-03-05 08:31:09,409 tlm: Fetching telemetry for ['pitch_comp'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for pitch_comp between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:050:13:00:37.958 to 2025:064:14:01:37.958
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 856357307.142 to 857570567.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3341:1067872]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4248:1067872]
_get_data: Getting data for orbitephem0_x between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [6925:10967]
_get_data: Getting data for orbitephem0_y between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Using times_cache for orbitephem0 856357517.1420001 to 857570357.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [6925:10967]
_get_data: Getting data for orbitephem0_z between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Using times_cache for orbitephem0 856357517.1420001 to 857570357.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [6925:10967]
_get_data: Getting data for solarephem0_x between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [6925:10967]
_get_data: Getting data for solarephem0_y between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Using times_cache for solarephem0 856357517.1420001 to 857570357.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [6925:10967]
_get_data: Getting data for solarephem0_z between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Using times_cache for solarephem0 856357517.1420001 to 857570357.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [6925:10967]
_get_data: Getting data for aoattqt1 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [3546:1067872]
_get_data: Getting data for aoattqt2 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Using times_cache for pcad3eng 856357517.1420001 to 857570357.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [3546:1067872]
_get_data: Getting data for aoattqt3 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Using times_cache for pcad3eng 856357517.1420001 to 857570357.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [3546:1067872]
_get_data: Getting data for aoattqt4 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_msid_data_from_cxc: Using times_cache for pcad3eng 856357517.1420001 to 857570357.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [3546:1067872]
fetch: Setting bads because of gaps in aoattqt1 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
fetch: Setting bads because of gaps in aoattqt2 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
fetch: Setting bads because of gaps in aoattqt3 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
fetch: Setting bads because of gaps in aoattqt4 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-03-05 08:31:15,531 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:31:15,531 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:050:13:31:08.041 - 2025:064:13:11:57.416
2025-03-05 08:31:15,532 get_cmds: Getting commands from 2025:050:13:31:08.041 to 2025:064:13:11:57.416 for scenario=None
2025-03-05 08:31:15,534 update_cmd_events: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-03-05 08:31:15,866 update_cmd_events: Writing 150 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-03-05 08:31:15,876 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/FEB with cache=False
2025-03-05 08:31:16,027 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/FEB1025A.pkl.gz
2025-03-05 08:31:16,034 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/FEB1225A.pkl.gz
2025-03-05 08:31:16,039 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/FEB1725A.pkl.gz
2025-03-05 08:31:16,043 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/FEB2425A.pkl.gz
2025-03-05 08:31:16,049 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR with cache=False
2025-03-05 08:31:16,108 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR0325A.pkl.gz
2025-03-05 08:31:16,116 update_archive_and_get_cmds_recent: Including loads FEB1025A, FEB1225A, FEB1725A, FEB2425A, MAR0325A
2025-03-05 08:31:16,120 update_archive_and_get_cmds_recent: Load FEB1025A has 2197 commands with RLTT=2025:041:02:29:04.906
2025-03-05 08:31:16,123 update_archive_and_get_cmds_recent: Load FEB1225A has 1492 commands with RLTT=2025:043:13:00:00.000
2025-03-05 08:31:16,127 update_archive_and_get_cmds_recent: Load FEB1725A has 2005 commands with RLTT=2025:047:14:11:00.000
2025-03-05 08:31:16,131 update_archive_and_get_cmds_recent: Load FEB2425A has 2742 commands with RLTT=2025:054:22:31:22.991
2025-03-05 08:31:16,136 update_archive_and_get_cmds_recent: Load MAR0325A has 2735 commands with RLTT=2025:061:23:35:37.150
2025-03-05 08:31:16,169 update_archive_and_get_cmds_recent: No cmd_events to include
2025-03-05 08:31:16,169 update_archive_and_get_cmds_recent: Processing FEB1025A with 2197 commands
2025-03-05 08:31:16,170 update_archive_and_get_cmds_recent: Adding 2197 commands from FEB1025A
2025-03-05 08:31:16,170 update_archive_and_get_cmds_recent: Processing FEB1225A with 1492 commands
2025-03-05 08:31:16,170 update_archive_and_get_cmds_recent: Removing 1418 cmds in SCS slots [128, 129, 130, 131, 132, 133] from FEB1025A due to RLTT in FEB1225A
2025-03-05 08:31:16,171 update_archive_and_get_cmds_recent: Adding 1492 commands from FEB1225A
2025-03-05 08:31:16,171 update_archive_and_get_cmds_recent: Processing FEB1725A with 2005 commands
2025-03-05 08:31:16,172 update_archive_and_get_cmds_recent: Adding 2005 commands from FEB1725A
2025-03-05 08:31:16,172 update_archive_and_get_cmds_recent: Processing FEB2425A with 2742 commands
2025-03-05 08:31:16,172 update_archive_and_get_cmds_recent: Adding 2742 commands from FEB2425A
2025-03-05 08:31:16,172 update_archive_and_get_cmds_recent: Processing MAR0325A with 2735 commands
2025-03-05 08:31:16,172 update_archive_and_get_cmds_recent: Adding 2735 commands from MAR0325A
2025-03-05 08:31:16,538 load_pars_dict: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.pkl with 177682 pars
2025-03-05 08:31:16,560 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:16,562 get_cmds: Getting commands from 2025:043:13:31:08.041 to 2025:050:13:31:08.041 for scenario=None
2025-03-05 08:31:16,564 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:08.041
2025-03-05 08:31:18,263 load_idx_cmds: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.h5 with 1683658 commands
2025-03-05 08:31:18,269 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-03-05 08:31:18,924 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-03-05 08:31:18,924 get_matching_block_idx: Match(a=0, b=0, size=3)
2025-03-05 08:31:18,924 get_matching_block_idx: Match(a=6, b=3, size=30)
2025-03-05 08:31:18,924 get_matching_block_idx: Match(a=37, b=33, size=9922)
2025-03-05 08:31:18,924 get_matching_block_idx: Match(a=9959, b=9955, size=0)
2025-03-05 08:31:18,924 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-03-05 08:31:18,924 get_matching_block_idx: ('equal', 0, 3, 0, 3)
2025-03-05 08:31:18,924 get_matching_block_idx: ('delete', 3, 6, 3, 3)
2025-03-05 08:31:18,924 get_matching_block_idx: ('equal', 6, 36, 3, 33)
2025-03-05 08:31:18,924 get_matching_block_idx: ('delete', 36, 37, 33, 33)
2025-03-05 08:31:18,924 get_matching_block_idx: ('equal', 37, 9959, 33, 9955)
2025-03-05 08:31:18,930 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:31:26,064 get_plot_figure: Compressing Telem data for state pitch
2025-03-05 08:31:28,288 get_plot_figure: Creating Telem scatter plot for state pitch
2025-03-05 08:31:28,474 get_plot_figure: Compressing State data for state pitch
2025-03-05 08:31:30,488 get_plot_figure: Creating State scatter plot for state pitch
2025-03-05 08:31:30,703 get_plot_html: Creating HTML for state pitch
2025-03-05 08:31:30,761 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:050:13:15:37.958 to 2025:064:13:46:37.958
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-03-05 08:31:31,038 tlm: Fetching telemetry for ['roll_comp'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for roll_comp between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:050:13:00:37.958 to 2025:064:14:01:37.958
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_data: Getting data for orbitephem0_x between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for orbitephem0_y between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for orbitephem0_z between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for solarephem0_x between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for solarephem0_y between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for solarephem0_z between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for aoattqt1 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for aoattqt2 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for aoattqt3 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
_get_data: Getting data for aoattqt4 between 2025:050:13:04:07.958 to 2025:064:13:58:07.958
fetch: Setting bads because of gaps in aoattqt1 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
fetch: Setting bads because of gaps in aoattqt2 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
fetch: Setting bads because of gaps in aoattqt3 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
fetch: Setting bads because of gaps in aoattqt4 between 2025:064:13:12:02.541 to 2025:064:13:58:06.966
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-03-05 08:31:33,310 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:31:33,311 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:050:13:31:08.041 - 2025:064:13:11:57.416
2025-03-05 08:31:33,311 get_cmds: Getting commands from 2025:050:13:31:08.041 to 2025:064:13:11:57.416 for scenario=None
2025-03-05 08:31:33,312 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:33,315 get_cmds: Getting commands from 2025:043:13:31:08.041 to 2025:050:13:31:08.041 for scenario=None
2025-03-05 08:31:33,316 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:08.041
2025-03-05 08:31:33,318 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:31:38,112 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-03-05 08:31:40,247 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-03-05 08:31:40,276 get_plot_figure: Compressing State data for state off_nom_roll
2025-03-05 08:31:42,272 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-03-05 08:31:42,329 get_plot_html: Creating HTML for state off_nom_roll
2025-03-05 08:31:42,341 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:050:13:15:37.958 to 2025:064:13:46:37.958
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-03-05 08:31:42,672 get_cmds: Getting commands from 2025:050:13:11:07.958 to 2025:064:13:31:07.958 for scenario=None
2025-03-05 08:31:42,673 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:42,743 add_exclude_interval: dither: excluding interval 2025:055:13:54:59.000 - 2025:055:14:07:59.000: SRDC
2025-03-05 08:31:42,745 add_exclude_interval: dither: excluding interval 2025:061:03:44:28.000 - 2025:061:03:57:28.000: SRDC
2025-03-05 08:31:42,745 tlm: Fetching telemetry for ['aodithen'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for aodithen between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [531:133484]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-03-05 08:31:43,054 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:31:43,054 get_states: Getting commanded states ['dither'] between 2025:050:13:31:10.462 - 2025:064:13:11:52.673
2025-03-05 08:31:43,054 get_cmds: Getting commands from 2025:050:13:31:10.462 to 2025:064:13:11:52.673 for scenario=None
2025-03-05 08:31:43,055 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:43,057 get_cmds: Getting commands from 2025:043:13:31:10.462 to 2025:050:13:31:10.462 for scenario=None
2025-03-05 08:31:43,059 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:10.462
2025-03-05 08:31:43,061 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:31:44,040 get_plot_figure: Compressing Telem data for state dither
2025-03-05 08:31:44,287 get_plot_figure: Creating Telem scatter plot for state dither
2025-03-05 08:31:44,289 get_plot_figure: Compressing State data for state dither
2025-03-05 08:31:44,544 get_plot_figure: Creating State scatter plot for state dither
2025-03-05 08:31:44,907 get_plot_html: Creating HTML for state dither
2025-03-05 08:31:44,912 run_validators: Validating pcad_mode
2025-03-05 08:31:44,924 get_cmds: Getting commands from 2025:050:13:11:07.958 to 2025:064:13:31:07.958 for scenario=None
2025-03-05 08:31:44,925 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:44,979 add_exclude_interval: pcad_mode: excluding interval 2025:055:13:54:59.000 - 2025:055:14:07:59.000: SRDC
2025-03-05 08:31:44,980 add_exclude_interval: pcad_mode: excluding interval 2025:061:03:44:28.000 - 2025:061:03:57:28.000: SRDC
2025-03-05 08:31:44,981 tlm: Fetching telemetry for ['aopcadmd'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for aopcadmd between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4248:1067872]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-03-05 08:31:45,272 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:31:45,273 get_states: Getting commanded states ['pcad_mode'] between 2025:050:13:31:08.412 - 2025:064:13:11:57.798
2025-03-05 08:31:45,273 get_cmds: Getting commands from 2025:050:13:31:08.412 to 2025:064:13:11:57.798 for scenario=None
2025-03-05 08:31:45,274 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:45,276 get_cmds: Getting commands from 2025:043:13:31:08.412 to 2025:050:13:31:08.412 for scenario=None
2025-03-05 08:31:45,278 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:08.412
2025-03-05 08:31:45,280 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:31:53,775 get_plot_figure: Compressing Telem data for state pcad_mode
2025-03-05 08:31:55,759 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-03-05 08:31:55,763 get_plot_figure: Compressing State data for state pcad_mode
2025-03-05 08:31:57,751 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-03-05 08:31:57,790 get_plot_html: Creating HTML for state pcad_mode
2025-03-05 08:31:57,795 run_validators: Validating simpos
2025-03-05 08:31:57,801 tlm: Fetching telemetry for ['3tscpos'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for 3tscpos between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [133:33292]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-03-05 08:31:57,968 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:31:57,969 get_states: Getting commanded states ['simpos'] between 2025:050:13:31:35.062 - 2025:064:13:11:28.586
2025-03-05 08:31:57,969 get_cmds: Getting commands from 2025:050:13:31:35.062 to 2025:064:13:11:28.586 for scenario=None
2025-03-05 08:31:57,970 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:57,972 get_cmds: Getting commands from 2025:043:13:31:35.062 to 2025:050:13:31:35.062 for scenario=None
2025-03-05 08:31:57,974 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:35.062
2025-03-05 08:31:57,975 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:31:58,117 get_plot_figure: Compressing Telem data for state simpos
2025-03-05 08:31:58,181 get_plot_figure: Creating Telem scatter plot for state simpos
2025-03-05 08:31:58,184 get_plot_figure: Compressing State data for state simpos
2025-03-05 08:31:58,246 get_plot_figure: Creating State scatter plot for state simpos
2025-03-05 08:31:58,255 get_plot_html: Creating HTML for state simpos
2025-03-05 08:31:58,259 run_validators: Validating obsid
2025-03-05 08:31:58,265 tlm: Fetching telemetry for ['cobsrqid'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for cobsrqid between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [2124:533936]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-03-05 08:31:58,569 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:31:58,569 get_states: Getting commanded states ['obsid'] between 2025:050:13:31:08.412 - 2025:064:13:11:56.517
2025-03-05 08:31:58,569 get_cmds: Getting commands from 2025:050:13:31:08.412 to 2025:064:13:11:56.517 for scenario=None
2025-03-05 08:31:58,571 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:31:58,573 get_cmds: Getting commands from 2025:043:13:31:08.412 to 2025:050:13:31:08.412 for scenario=None
2025-03-05 08:31:58,575 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:08.412
2025-03-05 08:31:58,576 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:00,762 get_plot_figure: Compressing Telem data for state obsid
2025-03-05 08:32:01,759 get_plot_figure: Creating Telem scatter plot for state obsid
2025-03-05 08:32:01,762 get_plot_figure: Compressing State data for state obsid
2025-03-05 08:32:02,758 get_plot_figure: Creating State scatter plot for state obsid
2025-03-05 08:32:02,776 get_plot_html: Creating HTML for state obsid
2025-03-05 08:32:02,785 run_validators: Validating letg
2025-03-05 08:32:02,792 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for 4ootgsel between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [133:33371]
_get_data: Getting data for 4ootgmtn between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Using times_cache for tel2eng 856358237.1420001 to 857569637.142
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [133:33371]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-03-05 08:32:03,249 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:32:03,250 get_states: Getting commanded states ['letg'] between 2025:050:13:31:35.062 - 2025:064:13:11:50.367
2025-03-05 08:32:03,250 get_cmds: Getting commands from 2025:050:13:31:35.062 to 2025:064:13:11:50.367 for scenario=None
2025-03-05 08:32:03,253 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:32:03,257 get_cmds: Getting commands from 2025:043:13:31:35.062 to 2025:050:13:31:35.062 for scenario=None
2025-03-05 08:32:03,259 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:35.062
2025-03-05 08:32:03,262 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:03,280 get_cmds: Getting commands from 2025:020:13:31:35.062 to 2025:050:13:31:35.062 for scenario=None
2025-03-05 08:32:03,283 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:020:13:31:35.062
2025-03-05 08:32:03,286 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:03,322 get_cmds: Getting commands from 2024:236:13:31:35.062 to 2025:050:13:31:35.062 for scenario=None
2025-03-05 08:32:03,325 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2024:236:13:31:35.062
2025-03-05 08:32:03,331 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:03,745 get_plot_figure: Compressing Telem data for state letg
2025-03-05 08:32:03,809 get_plot_figure: Creating Telem scatter plot for state letg
2025-03-05 08:32:03,811 get_plot_figure: Compressing State data for state letg
2025-03-05 08:32:03,873 get_plot_figure: Creating State scatter plot for state letg
2025-03-05 08:32:03,881 get_plot_html: Creating HTML for state letg
2025-03-05 08:32:03,887 run_validators: Validating hetg
2025-03-05 08:32:03,893 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for 4ootgsel between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_data: Getting data for 4ootgmtn between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-03-05 08:32:03,910 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:32:03,911 get_states: Getting commanded states ['hetg'] between 2025:050:13:31:35.062 - 2025:064:13:11:50.367
2025-03-05 08:32:03,911 get_cmds: Getting commands from 2025:050:13:31:35.062 to 2025:064:13:11:50.367 for scenario=None
2025-03-05 08:32:03,912 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:32:03,914 get_cmds: Getting commands from 2025:043:13:31:35.062 to 2025:050:13:31:35.062 for scenario=None
2025-03-05 08:32:03,916 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:35.062
2025-03-05 08:32:03,917 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:03,926 get_cmds: Getting commands from 2025:020:13:31:35.062 to 2025:050:13:31:35.062 for scenario=None
2025-03-05 08:32:03,928 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:020:13:31:35.062
2025-03-05 08:32:03,930 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:03,949 get_cmds: Getting commands from 2024:236:13:31:35.062 to 2025:050:13:31:35.062 for scenario=None
2025-03-05 08:32:03,950 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2024:236:13:31:35.062
2025-03-05 08:32:03,955 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:04,339 get_plot_figure: Compressing Telem data for state hetg
2025-03-05 08:32:04,402 get_plot_figure: Creating Telem scatter plot for state hetg
2025-03-05 08:32:04,404 get_plot_figure: Compressing State data for state hetg
2025-03-05 08:32:04,468 get_plot_figure: Creating State scatter plot for state hetg
2025-03-05 08:32:04,476 get_plot_html: Creating HTML for state hetg
2025-03-05 08:32:04,484 run_validators: Validating sun_pos_mon
2025-03-05 08:32:04,493 tlm: Fetching telemetry for ['aopssupm'] between 2025:050:13:31:07.958 and 2025:064:13:31:07.958
_get_data: Getting data for aopssupm between 2025:050:13:16:07.958 to 2025:064:13:46:07.958
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [531:133484]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-03-05 08:32:04,919 get_states: Using kadi.commands.states to get cmd_states
2025-03-05 08:32:04,919 get_states: Getting commanded states ['sun_pos_mon'] between 2025:050:13:31:10.462 - 2025:064:13:11:58.054
2025-03-05 08:32:04,919 get_cmds: Getting commands from 2025:050:13:31:10.462 to 2025:064:13:11:58.054 for scenario=None
2025-03-05 08:32:04,921 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-03-05 08:32:04,923 get_cmds: Getting commands from 2025:043:13:31:10.462 to 2025:050:13:31:10.462 for scenario=None
2025-03-05 08:32:04,924 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:043:13:31:10.462
2025-03-05 08:32:04,926 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-03-05 08:32:05,850 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-03-05 08:32:06,117 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-03-05 08:32:06,120 get_plot_figure: Compressing State data for state sun_pos_mon
2025-03-05 08:32:06,375 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-03-05 08:32:06,388 get_plot_html: Creating HTML for state sun_pos_mon