Prev
Index
Next
kadi: Sat Aug 2 08:37:06 2025
File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kadi |
OK
|
0.09 | 1.5 |
Sat Aug 2 08:37:06 2025 |
No errors
File contents:
2025-08-02 08:36:07,347 run_validators: Validating pitch
2025-08-02 08:36:07,347 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:200:12:20:37.347 to 2025:214:12:51:37.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [2916:1131584]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-08-02 08:36:08,683 tlm: Fetching telemetry for ['pitch_comp'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for pitch_comp between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:200:12:05:37.347 to 2025:214:13:06:37.347
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 869314006.531 to 870527266.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [2038:1131584]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [2946:1131584]
_get_data: Getting data for orbitephem0_x between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [5762:9804]
_get_data: Getting data for orbitephem0_y between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Using times_cache for orbitephem0 869314216.5309998 to 870527056.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [5762:9804]
_get_data: Getting data for orbitephem0_z between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Using times_cache for orbitephem0 869314216.5309998 to 870527056.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [5762:9804]
_get_data: Getting data for solarephem0_x between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [5762:9804]
_get_data: Getting data for solarephem0_y between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Using times_cache for solarephem0 869314216.5309998 to 870527056.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [5762:9804]
_get_data: Getting data for solarephem0_z between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Using times_cache for solarephem0 869314216.5309998 to 870527056.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [5762:9804]
_get_data: Getting data for aoattqt1 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2243:1131584]
_get_data: Getting data for aoattqt2 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Using times_cache for pcad3eng 869314216.5309998 to 870527056.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2243:1131584]
_get_data: Getting data for aoattqt3 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Using times_cache for pcad3eng 869314216.5309998 to 870527056.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2243:1131584]
_get_data: Getting data for aoattqt4 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_msid_data_from_cxc: Using times_cache for pcad3eng 869314216.5309998 to 870527056.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2243:1131584]
fetch: Setting bads because of gaps in aoattqt1 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
fetch: Setting bads because of gaps in aoattqt2 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
fetch: Setting bads because of gaps in aoattqt3 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
fetch: Setting bads because of gaps in aoattqt4 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-08-02 08:36:13,613 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:13,613 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:200:12:36:08.116 - 2025:214:07:05:12.266
2025-08-02 08:36:13,613 get_cmds: Getting commands from 2025:200:12:36:08.116 to 2025:214:07:05:12.266 for scenario=None
2025-08-02 08:36:13,613 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:13,615 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-08-02 08:36:13,615 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-08-02 08:36:14,048 get_cmd_events_from_sheet: Writing 155 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-08-02 08:36:14,059 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/JUL with cache=False
2025-08-02 08:36:14,420 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL0725B.pkl.gz
2025-08-02 08:36:14,426 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL1425A.pkl.gz
2025-08-02 08:36:14,433 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL2125A.pkl.gz
2025-08-02 08:36:14,438 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL2825A.pkl.gz
2025-08-02 08:36:14,443 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/AUG with cache=False
2025-08-02 08:36:14,490 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/AUG0425A.pkl.gz
2025-08-02 08:36:14,496 update_cmd_events_and_loads_and_get_cmds_recent: Including loads JUL0725B, JUL1425A, JUL2125A, JUL2825A, AUG0425A
2025-08-02 08:36:14,499 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL0725B has 1862 commands with RLTT=2025:187:17:23:00.000
2025-08-02 08:36:14,504 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL1425A has 3384 commands with RLTT=2025:195:01:16:43.803
2025-08-02 08:36:14,507 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL2125A has 2074 commands with RLTT=2025:202:00:04:37.696
2025-08-02 08:36:14,511 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL2825A has 2085 commands with RLTT=2025:208:21:31:00.000
2025-08-02 08:36:14,515 update_cmd_events_and_loads_and_get_cmds_recent: Load AUG0425A has 2121 commands with RLTT=2025:216:00:58:48.432
2025-08-02 08:36:14,547 update_cmd_events_and_loads_and_get_cmds_recent: No cmd_events to include
2025-08-02 08:36:14,547 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL0725B with 1862 commands
2025-08-02 08:36:14,548 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1862 commands from JUL0725B
2025-08-02 08:36:14,548 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL1425A with 3384 commands
2025-08-02 08:36:14,548 update_cmd_events_and_loads_and_get_cmds_recent: Adding 3384 commands from JUL1425A
2025-08-02 08:36:14,548 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL2125A with 2074 commands
2025-08-02 08:36:14,548 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2074 commands from JUL2125A
2025-08-02 08:36:14,548 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL2825A with 2085 commands
2025-08-02 08:36:14,549 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2085 commands from JUL2825A
2025-08-02 08:36:14,549 update_cmd_events_and_loads_and_get_cmds_recent: Processing AUG0425A with 2121 commands
2025-08-02 08:36:14,549 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2121 commands from AUG0425A
2025-08-02 08:36:14,935 load_pars_dict: Loaded /export/tom/kadi-validate/data/kadi/cmds2.pkl with 182050 pars
2025-08-02 08:36:14,958 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:14,960 get_cmds: Getting commands from 2025:193:12:36:08.116 to 2025:200:12:36:08.116 for scenario=None
2025-08-02 08:36:14,960 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:14,961 get_cmds: Getting recent commands from cache
2025-08-02 08:36:14,962 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:21,123 get_plot_figure: Compressing Telem data for state pitch
2025-08-02 08:36:23,377 get_plot_figure: Creating Telem scatter plot for state pitch
2025-08-02 08:36:23,447 get_plot_figure: Compressing State data for state pitch
2025-08-02 08:36:25,439 get_plot_figure: Creating State scatter plot for state pitch
2025-08-02 08:36:25,524 get_plot_html: Creating HTML for state pitch
2025-08-02 08:36:25,541 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:200:12:20:37.347 to 2025:214:12:51:37.347
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-08-02 08:36:25,733 tlm: Fetching telemetry for ['roll_comp'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for roll_comp between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:200:12:05:37.347 to 2025:214:13:06:37.347
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_data: Getting data for orbitephem0_x between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for orbitephem0_y between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for orbitephem0_z between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for solarephem0_x between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for solarephem0_y between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for solarephem0_z between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for aoattqt1 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for aoattqt2 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for aoattqt3 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
_get_data: Getting data for aoattqt4 between 2025:200:12:09:07.347 to 2025:214:13:03:07.347
fetch: Setting bads because of gaps in aoattqt1 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
fetch: Setting bads because of gaps in aoattqt2 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
fetch: Setting bads because of gaps in aoattqt3 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
fetch: Setting bads because of gaps in aoattqt4 between 2025:214:07:05:17.391 to 2025:214:13:03:07.041
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-08-02 08:36:26,782 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:26,782 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:200:12:36:08.116 - 2025:214:07:05:12.266
2025-08-02 08:36:26,782 get_cmds: Getting commands from 2025:200:12:36:08.116 to 2025:214:07:05:12.266 for scenario=None
2025-08-02 08:36:26,782 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:26,783 get_cmds: Getting recent commands from cache
2025-08-02 08:36:26,783 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:26,786 get_cmds: Getting commands from 2025:193:12:36:08.116 to 2025:200:12:36:08.116 for scenario=None
2025-08-02 08:36:26,786 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:26,787 get_cmds: Getting recent commands from cache
2025-08-02 08:36:26,787 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:31,003 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-08-02 08:36:33,078 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-08-02 08:36:33,097 get_plot_figure: Compressing State data for state off_nom_roll
2025-08-02 08:36:35,102 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-08-02 08:36:35,160 get_plot_html: Creating HTML for state off_nom_roll
2025-08-02 08:36:35,169 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:200:12:20:37.347 to 2025:214:12:51:37.347
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-08-02 08:36:35,347 get_cmds: Getting commands from 2025:200:12:16:07.347 to 2025:214:12:36:07.347 for scenario=None
2025-08-02 08:36:35,347 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:35,347 get_cmds: Getting recent commands from cache
2025-08-02 08:36:35,348 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:35,408 add_exclude_interval: dither: excluding interval 2025:201:02:14:59.000 - 2025:201:02:27:59.000: SRDC
2025-08-02 08:36:35,410 add_exclude_interval: dither: excluding interval 2025:203:21:54:00.000 - 2025:203:22:07:00.000: SRDC
2025-08-02 08:36:35,411 add_exclude_interval: dither: excluding interval 2025:208:23:53:15.000 - 2025:209:00:06:15.000: SRDC
2025-08-02 08:36:35,411 tlm: Fetching telemetry for ['aodithen'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for aodithen between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [369:144964]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-08-02 08:36:35,574 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:35,575 get_states: Getting commanded states ['dither'] between 2025:200:12:36:08.315 - 2025:214:07:05:05.994
2025-08-02 08:36:35,575 get_cmds: Getting commands from 2025:200:12:36:08.315 to 2025:214:07:05:05.994 for scenario=None
2025-08-02 08:36:35,575 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:35,575 get_cmds: Getting recent commands from cache
2025-08-02 08:36:35,576 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:35,578 get_cmds: Getting commands from 2025:193:12:36:08.315 to 2025:200:12:36:08.315 for scenario=None
2025-08-02 08:36:35,579 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:35,579 get_cmds: Getting recent commands from cache
2025-08-02 08:36:35,580 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:36,269 get_plot_figure: Compressing Telem data for state dither
2025-08-02 08:36:36,518 get_plot_figure: Creating Telem scatter plot for state dither
2025-08-02 08:36:36,519 get_plot_figure: Compressing State data for state dither
2025-08-02 08:36:36,769 get_plot_figure: Creating State scatter plot for state dither
2025-08-02 08:36:36,828 get_plot_html: Creating HTML for state dither
2025-08-02 08:36:36,832 run_validators: Validating pcad_mode
2025-08-02 08:36:36,843 get_cmds: Getting commands from 2025:200:12:16:07.347 to 2025:214:12:36:07.347 for scenario=None
2025-08-02 08:36:36,843 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:36,844 get_cmds: Getting recent commands from cache
2025-08-02 08:36:36,844 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:36,889 add_exclude_interval: pcad_mode: excluding interval 2025:201:02:14:59.000 - 2025:201:02:27:59.000: SRDC
2025-08-02 08:36:36,891 add_exclude_interval: pcad_mode: excluding interval 2025:203:21:54:00.000 - 2025:203:22:07:00.000: SRDC
2025-08-02 08:36:36,892 add_exclude_interval: pcad_mode: excluding interval 2025:208:23:53:15.000 - 2025:209:00:06:15.000: SRDC
2025-08-02 08:36:36,893 tlm: Fetching telemetry for ['aopcadmd'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for aopcadmd between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [2946:1131584]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-08-02 08:36:37,113 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:37,114 get_states: Getting commanded states ['pcad_mode'] between 2025:200:12:36:08.315 - 2025:214:07:05:13.168
2025-08-02 08:36:37,114 get_cmds: Getting commands from 2025:200:12:36:08.315 to 2025:214:07:05:13.168 for scenario=None
2025-08-02 08:36:37,114 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:37,115 get_cmds: Getting recent commands from cache
2025-08-02 08:36:37,115 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:37,117 get_cmds: Getting commands from 2025:193:12:36:08.315 to 2025:200:12:36:08.315 for scenario=None
2025-08-02 08:36:37,118 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:37,118 get_cmds: Getting recent commands from cache
2025-08-02 08:36:37,119 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:45,059 get_plot_figure: Compressing Telem data for state pcad_mode
2025-08-02 08:36:47,097 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-08-02 08:36:47,100 get_plot_figure: Compressing State data for state pcad_mode
2025-08-02 08:36:49,069 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-08-02 08:36:49,112 get_plot_html: Creating HTML for state pcad_mode
2025-08-02 08:36:49,116 run_validators: Validating simpos
2025-08-02 08:36:49,123 tlm: Fetching telemetry for ['3tscpos'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for 3tscpos between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [92:36170]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-08-02 08:36:49,327 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:49,328 get_states: Getting commanded states ['simpos'] between 2025:200:12:36:24.715 - 2025:214:07:04:41.906
2025-08-02 08:36:49,328 get_cmds: Getting commands from 2025:200:12:36:24.715 to 2025:214:07:04:41.906 for scenario=None
2025-08-02 08:36:49,328 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:49,328 get_cmds: Getting recent commands from cache
2025-08-02 08:36:49,329 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:49,331 get_cmds: Getting commands from 2025:193:12:36:24.715 to 2025:200:12:36:24.715 for scenario=None
2025-08-02 08:36:49,331 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:49,332 get_cmds: Getting recent commands from cache
2025-08-02 08:36:49,332 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:49,464 get_plot_figure: Compressing Telem data for state simpos
2025-08-02 08:36:49,529 get_plot_figure: Creating Telem scatter plot for state simpos
2025-08-02 08:36:49,532 get_plot_figure: Compressing State data for state simpos
2025-08-02 08:36:49,595 get_plot_figure: Creating State scatter plot for state simpos
2025-08-02 08:36:49,604 get_plot_html: Creating HTML for state simpos
2025-08-02 08:36:49,608 run_validators: Validating obsid
2025-08-02 08:36:49,614 tlm: Fetching telemetry for ['cobsrqid'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for cobsrqid between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [1473:565792]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-08-02 08:36:50,070 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:50,070 get_states: Getting commanded states ['obsid'] between 2025:200:12:36:08.315 - 2025:214:07:05:11.887
2025-08-02 08:36:50,070 get_cmds: Getting commands from 2025:200:12:36:08.315 to 2025:214:07:05:11.887 for scenario=None
2025-08-02 08:36:50,070 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:50,071 get_cmds: Getting recent commands from cache
2025-08-02 08:36:50,071 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:50,074 get_cmds: Getting commands from 2025:193:12:36:08.315 to 2025:200:12:36:08.315 for scenario=None
2025-08-02 08:36:50,074 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:50,075 get_cmds: Getting recent commands from cache
2025-08-02 08:36:50,076 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:52,133 get_plot_figure: Compressing Telem data for state obsid
2025-08-02 08:36:53,112 get_plot_figure: Creating Telem scatter plot for state obsid
2025-08-02 08:36:53,114 get_plot_figure: Compressing State data for state obsid
2025-08-02 08:36:54,089 get_plot_figure: Creating State scatter plot for state obsid
2025-08-02 08:36:54,104 get_plot_html: Creating HTML for state obsid
2025-08-02 08:36:54,108 run_validators: Validating letg
2025-08-02 08:36:54,115 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for 4ootgsel between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [93:36241]
_get_data: Getting data for 4ootgmtn between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Using times_cache for tel2eng 869314936.5310001 to 870526336.531
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [93:36241]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-08-02 08:36:54,418 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:54,418 get_states: Getting commanded states ['letg'] between 2025:200:12:36:24.715 - 2025:214:07:05:03.687
2025-08-02 08:36:54,418 get_cmds: Getting commands from 2025:200:12:36:24.715 to 2025:214:07:05:03.687 for scenario=None
2025-08-02 08:36:54,419 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:54,419 get_cmds: Getting recent commands from cache
2025-08-02 08:36:54,420 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:54,422 get_cmds: Getting commands from 2025:193:12:36:24.715 to 2025:200:12:36:24.715 for scenario=None
2025-08-02 08:36:54,422 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:54,423 get_cmds: Getting recent commands from cache
2025-08-02 08:36:54,423 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:54,431 get_cmds: Getting commands from 2025:170:12:36:24.715 to 2025:200:12:36:24.715 for scenario=None
2025-08-02 08:36:54,432 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:54,432 get_cmds: Getting recent commands from cache
2025-08-02 08:36:54,433 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:170:12:36:24.715
2025-08-02 08:36:55,885 load_idx_cmds: Loaded /export/tom/kadi-validate/data/kadi/cmds2.h5 with 1731552 commands
2025-08-02 08:36:55,893 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-08-02 08:36:56,333 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-08-02 08:36:56,333 get_matching_block_idx: Match(a=0, b=0, size=1)
2025-08-02 08:36:56,333 get_matching_block_idx: Match(a=2, b=1, size=16)
2025-08-02 08:36:56,333 get_matching_block_idx: Match(a=19, b=17, size=11734)
2025-08-02 08:36:56,333 get_matching_block_idx: Match(a=11753, b=11751, size=0)
2025-08-02 08:36:56,333 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-08-02 08:36:56,333 get_matching_block_idx: ('equal', 0, 1, 0, 1)
2025-08-02 08:36:56,333 get_matching_block_idx: ('delete', 1, 2, 1, 1)
2025-08-02 08:36:56,333 get_matching_block_idx: ('equal', 2, 18, 1, 17)
2025-08-02 08:36:56,333 get_matching_block_idx: ('delete', 18, 19, 17, 17)
2025-08-02 08:36:56,333 get_matching_block_idx: ('equal', 19, 11753, 17, 11751)
2025-08-02 08:36:56,337 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-08-02 08:36:56,562 get_plot_figure: Compressing Telem data for state letg
2025-08-02 08:36:56,624 get_plot_figure: Creating Telem scatter plot for state letg
2025-08-02 08:36:56,625 get_plot_figure: Compressing State data for state letg
2025-08-02 08:36:56,687 get_plot_figure: Creating State scatter plot for state letg
2025-08-02 08:36:56,694 get_plot_html: Creating HTML for state letg
2025-08-02 08:36:56,697 run_validators: Validating hetg
2025-08-02 08:36:56,703 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for 4ootgsel between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_data: Getting data for 4ootgmtn between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-08-02 08:36:56,717 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:56,717 get_states: Getting commanded states ['hetg'] between 2025:200:12:36:24.715 - 2025:214:07:05:03.687
2025-08-02 08:36:56,717 get_cmds: Getting commands from 2025:200:12:36:24.715 to 2025:214:07:05:03.687 for scenario=None
2025-08-02 08:36:56,717 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:56,718 get_cmds: Getting recent commands from cache
2025-08-02 08:36:56,718 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:56,720 get_cmds: Getting commands from 2025:193:12:36:24.715 to 2025:200:12:36:24.715 for scenario=None
2025-08-02 08:36:56,720 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:56,721 get_cmds: Getting recent commands from cache
2025-08-02 08:36:56,722 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:56,729 get_cmds: Getting commands from 2025:170:12:36:24.715 to 2025:200:12:36:24.715 for scenario=None
2025-08-02 08:36:56,730 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:56,730 get_cmds: Getting recent commands from cache
2025-08-02 08:36:56,731 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:170:12:36:24.715
2025-08-02 08:36:56,732 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-08-02 08:36:56,960 get_plot_figure: Compressing Telem data for state hetg
2025-08-02 08:36:57,022 get_plot_figure: Creating Telem scatter plot for state hetg
2025-08-02 08:36:57,023 get_plot_figure: Compressing State data for state hetg
2025-08-02 08:36:57,085 get_plot_figure: Creating State scatter plot for state hetg
2025-08-02 08:36:57,093 get_plot_html: Creating HTML for state hetg
2025-08-02 08:36:57,096 run_validators: Validating sun_pos_mon
2025-08-02 08:36:57,103 tlm: Fetching telemetry for ['aopssupm'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for aopssupm between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [369:144964]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-08-02 08:36:57,329 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:36:57,329 get_states: Getting commanded states ['sun_pos_mon'] between 2025:200:12:36:08.315 - 2025:214:07:05:11.375
2025-08-02 08:36:57,329 get_cmds: Getting commands from 2025:200:12:36:08.315 to 2025:214:07:05:11.375 for scenario=None
2025-08-02 08:36:57,329 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:57,330 get_cmds: Getting recent commands from cache
2025-08-02 08:36:57,331 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:57,333 get_cmds: Getting commands from 2025:193:12:36:08.315 to 2025:200:12:36:08.315 for scenario=None
2025-08-02 08:36:57,333 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:57,334 get_cmds: Getting recent commands from cache
2025-08-02 08:36:57,334 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:36:57,347 get_cmds: Getting commands from 2025:170:12:36:08.315 to 2025:200:12:36:08.315 for scenario=None
2025-08-02 08:36:57,347 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:57,348 get_cmds: Getting recent commands from cache
2025-08-02 08:36:57,348 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:170:12:36:08.315
2025-08-02 08:36:57,350 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-08-02 08:36:57,373 get_cmds: Getting commands from 2025:020:12:36:08.315 to 2025:200:12:36:08.315 for scenario=None
2025-08-02 08:36:57,374 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:36:57,374 get_cmds: Getting recent commands from cache
2025-08-02 08:36:57,375 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:020:12:36:08.315
2025-08-02 08:36:57,379 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-08-02 08:36:58,272 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-08-02 08:36:58,517 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-08-02 08:36:58,520 get_plot_figure: Compressing State data for state sun_pos_mon
2025-08-02 08:36:58,765 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-08-02 08:36:58,779 get_plot_html: Creating HTML for state sun_pos_mon
2025-08-02 08:36:58,782 run_validators: Validating dpa_power
2025-08-02 08:37:03,180 tlm: Fetching telemetry for ['dpa_power'] between 2025:200:12:36:07.347 and 2025:214:12:36:07.347
_get_data: Getting data for dpa_power between 2025:200:12:21:07.347 to 2025:214:12:51:07.347
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/dp_acispow128/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/dp_acispow128/DP_DPA_POWER.h5
_get_msid_data_from_cxc: Slicing DP_DPA_POWER arrays [218:35380]
interpolate: Interpolating index for dpa_power
interpolate: Slicing on indexes
2025-08-02 08:37:03,506 get_states: Using kadi.commands.states to get cmd_states
2025-08-02 08:37:03,506 get_states: Getting commanded states ['ccd_count', 'clocking', 'feps', 'ccds', 'fep_count', 'si_mode'] between 2025:200:12:36:20.416 - 2025:214:07:05:06.762
2025-08-02 08:37:03,506 get_cmds: Getting commands from 2025:200:12:36:20.416 to 2025:214:07:05:06.762 for scenario=None
2025-08-02 08:37:03,506 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:37:03,507 get_cmds: Getting recent commands from cache
2025-08-02 08:37:03,508 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:37:03,510 get_cmds: Getting commands from 2025:193:12:36:20.416 to 2025:200:12:36:20.416 for scenario=None
2025-08-02 08:37:03,510 get_cmds: Cache key: (None, None, 30.0, None)
2025-08-02 08:37:03,511 get_cmds: Getting recent commands from cache
2025-08-02 08:37:03,512 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-08-02 08:37:04,283 get_plot_figure: Compressing Telem data for state dpa_power
2025-08-02 08:37:04,922 get_plot_figure: Creating Telem scatter plot for state dpa_power
2025-08-02 08:37:05,168 get_plot_figure: Compressing State data for state dpa_power
2025-08-02 08:37:05,236 get_plot_figure: Creating State scatter plot for state dpa_power
2025-08-02 08:37:05,302 get_plot_html: Creating HTML for state dpa_power