Prev
Index
Next
kadi: Mon Jul 21 08:37:25 2025
File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kadi |
OK
|
0.09 | 1.5 |
Mon Jul 21 08:37:25 2025 |
No errors
File contents:
2025-07-21 08:36:18,444 run_validators: Validating pitch
2025-07-21 08:36:18,445 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:188:12:20:48.444 to 2025:202:12:51:48.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4055:1146752]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-07-21 08:36:20,032 tlm: Fetching telemetry for ['pitch_comp'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for pitch_comp between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:188:12:05:48.444 to 2025:202:13:06:48.444
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 868277217.6279997 to 869490477.628
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3177:1146752]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4084:1146752]
_get_data: Getting data for orbitephem0_x between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [6338:10380]
_get_data: Getting data for orbitephem0_y between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Using times_cache for orbitephem0 868277427.6279999 to 869490267.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [6338:10380]
_get_data: Getting data for orbitephem0_z between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Using times_cache for orbitephem0 868277427.6279999 to 869490267.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [6338:10380]
_get_data: Getting data for solarephem0_x between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [6338:10380]
_get_data: Getting data for solarephem0_y between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Using times_cache for solarephem0 868277427.6279999 to 869490267.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [6338:10380]
_get_data: Getting data for solarephem0_z between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Using times_cache for solarephem0 868277427.6279999 to 869490267.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [6338:10380]
_get_data: Getting data for aoattqt1 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [3382:1146752]
_get_data: Getting data for aoattqt2 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Using times_cache for pcad3eng 868277427.6279999 to 869490267.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [3382:1146752]
_get_data: Getting data for aoattqt3 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Using times_cache for pcad3eng 868277427.6279999 to 869490267.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [3382:1146752]
_get_data: Getting data for aoattqt4 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_msid_data_from_cxc: Using times_cache for pcad3eng 868277427.6279999 to 869490267.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [3382:1146752]
fetch: Setting bads because of gaps in aoattqt1 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
fetch: Setting bads because of gaps in aoattqt2 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
fetch: Setting bads because of gaps in aoattqt3 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
fetch: Setting bads because of gaps in aoattqt4 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-07-21 08:36:24,196 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:36:24,196 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:188:12:36:18.566 - 2025:202:11:15:19.491
2025-07-21 08:36:24,196 get_cmds: Getting commands from 2025:188:12:36:18.566 to 2025:202:11:15:19.491 for scenario=None
2025-07-21 08:36:24,197 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:24,198 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-07-21 08:36:24,198 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-07-21 08:36:24,584 get_cmd_events_from_sheet: Writing 155 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-07-21 08:36:24,595 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/JUN with cache=False
2025-07-21 08:36:25,119 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUN2325A.pkl.gz
2025-07-21 08:36:25,124 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUN3025A.pkl.gz
2025-07-21 08:36:25,129 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/JUL with cache=False
2025-07-21 08:36:25,187 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL0725B.pkl.gz
2025-07-21 08:36:25,192 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL1425A.pkl.gz
2025-07-21 08:36:25,198 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL2125A.pkl.gz
2025-07-21 08:36:25,203 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/AUG with cache=False
2025-07-21 08:36:25,243 update_cmd_events_and_loads_and_get_cmds_recent: Including loads JUN2325A, JUN3025A, JUL0725B, JUL1425A, JUL2125A
2025-07-21 08:36:25,246 update_cmd_events_and_loads_and_get_cmds_recent: Load JUN2325A has 2100 commands with RLTT=2025:174:00:04:24.719
2025-07-21 08:36:25,249 update_cmd_events_and_loads_and_get_cmds_recent: Load JUN3025A has 1732 commands with RLTT=2025:181:00:15:08.508
2025-07-21 08:36:25,253 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL0725B has 1862 commands with RLTT=2025:187:17:23:00.000
2025-07-21 08:36:25,258 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL1425A has 3384 commands with RLTT=2025:195:01:16:43.803
2025-07-21 08:36:25,261 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL2125A has 2074 commands with RLTT=2025:202:00:04:37.696
2025-07-21 08:36:25,292 update_cmd_events_and_loads_and_get_cmds_recent: No cmd_events to include
2025-07-21 08:36:25,292 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUN2325A with 2100 commands
2025-07-21 08:36:25,293 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2100 commands from JUN2325A
2025-07-21 08:36:25,293 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUN3025A with 1732 commands
2025-07-21 08:36:25,293 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1732 commands from JUN3025A
2025-07-21 08:36:25,293 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL0725B with 1862 commands
2025-07-21 08:36:25,293 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1862 commands from JUL0725B
2025-07-21 08:36:25,293 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL1425A with 3384 commands
2025-07-21 08:36:25,294 update_cmd_events_and_loads_and_get_cmds_recent: Adding 3384 commands from JUL1425A
2025-07-21 08:36:25,294 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL2125A with 2074 commands
2025-07-21 08:36:25,294 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2074 commands from JUL2125A
2025-07-21 08:36:25,722 load_pars_dict: Loaded /export/tom/kadi-validate/data/kadi/cmds2.pkl with 181700 pars
2025-07-21 08:36:25,745 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:25,747 get_cmds: Getting commands from 2025:181:12:36:18.566 to 2025:188:12:36:18.566 for scenario=None
2025-07-21 08:36:25,748 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:25,748 get_cmds: Getting recent commands from cache
2025-07-21 08:36:25,749 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:32,631 get_plot_figure: Compressing Telem data for state pitch
2025-07-21 08:36:34,855 get_plot_figure: Creating Telem scatter plot for state pitch
2025-07-21 08:36:34,931 get_plot_figure: Compressing State data for state pitch
2025-07-21 08:36:36,895 get_plot_figure: Creating State scatter plot for state pitch
2025-07-21 08:36:37,023 get_plot_html: Creating HTML for state pitch
2025-07-21 08:36:37,041 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:188:12:20:48.444 to 2025:202:12:51:48.444
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-07-21 08:36:37,240 tlm: Fetching telemetry for ['roll_comp'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for roll_comp between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:188:12:05:48.444 to 2025:202:13:06:48.444
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_data: Getting data for orbitephem0_x between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for orbitephem0_y between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for orbitephem0_z between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for solarephem0_x between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for solarephem0_y between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for solarephem0_z between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for aoattqt1 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for aoattqt2 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for aoattqt3 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
_get_data: Getting data for aoattqt4 between 2025:188:12:09:18.444 to 2025:202:13:03:18.444
fetch: Setting bads because of gaps in aoattqt1 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
fetch: Setting bads because of gaps in aoattqt2 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
fetch: Setting bads because of gaps in aoattqt3 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
fetch: Setting bads because of gaps in aoattqt4 between 2025:202:11:15:24.616 to 2025:202:13:03:17.491
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-07-21 08:36:38,910 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:36:38,911 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:188:12:36:18.566 - 2025:202:11:15:19.491
2025-07-21 08:36:38,911 get_cmds: Getting commands from 2025:188:12:36:18.566 to 2025:202:11:15:19.491 for scenario=None
2025-07-21 08:36:38,911 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:38,912 get_cmds: Getting recent commands from cache
2025-07-21 08:36:38,912 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:38,915 get_cmds: Getting commands from 2025:181:12:36:18.566 to 2025:188:12:36:18.566 for scenario=None
2025-07-21 08:36:38,915 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:38,916 get_cmds: Getting recent commands from cache
2025-07-21 08:36:38,917 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:43,556 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-07-21 08:36:45,619 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-07-21 08:36:45,641 get_plot_figure: Compressing State data for state off_nom_roll
2025-07-21 08:36:47,612 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-07-21 08:36:47,680 get_plot_html: Creating HTML for state off_nom_roll
2025-07-21 08:36:47,690 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:188:12:20:48.444 to 2025:202:12:51:48.444
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-07-21 08:36:47,887 get_cmds: Getting commands from 2025:188:12:16:18.444 to 2025:202:12:36:18.444 for scenario=None
2025-07-21 08:36:47,888 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:47,888 get_cmds: Getting recent commands from cache
2025-07-21 08:36:47,889 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:47,958 add_exclude_interval: dither: excluding interval 2025:193:01:04:59.000 - 2025:193:01:17:59.000: SRDC
2025-07-21 08:36:47,960 add_exclude_interval: dither: excluding interval 2025:201:02:14:59.000 - 2025:201:02:27:59.000: SRDC
2025-07-21 08:36:47,960 tlm: Fetching telemetry for ['aodithen'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for aodithen between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [511:143344]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-07-21 08:36:48,309 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:36:48,309 get_states: Getting commanded states ['dither'] between 2025:188:12:36:24.846 - 2025:202:11:15:20.700
2025-07-21 08:36:48,309 get_cmds: Getting commands from 2025:188:12:36:24.846 to 2025:202:11:15:20.700 for scenario=None
2025-07-21 08:36:48,309 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:48,310 get_cmds: Getting recent commands from cache
2025-07-21 08:36:48,311 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:48,313 get_cmds: Getting commands from 2025:181:12:36:24.846 to 2025:188:12:36:24.846 for scenario=None
2025-07-21 08:36:48,313 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:48,314 get_cmds: Getting recent commands from cache
2025-07-21 08:36:48,314 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:49,094 get_plot_figure: Compressing Telem data for state dither
2025-07-21 08:36:49,343 get_plot_figure: Creating Telem scatter plot for state dither
2025-07-21 08:36:49,346 get_plot_figure: Compressing State data for state dither
2025-07-21 08:36:49,589 get_plot_figure: Creating State scatter plot for state dither
2025-07-21 08:36:49,657 get_plot_html: Creating HTML for state dither
2025-07-21 08:36:49,661 run_validators: Validating pcad_mode
2025-07-21 08:36:49,673 add_exclude_interval: pcad_mode: excluding interval 2025:190:10:31:09.337 - 2025:190:10:49:32.228: PEA patch uplink ground command NMM
2025-07-21 08:36:49,674 get_cmds: Getting commands from 2025:188:12:16:18.444 to 2025:202:12:36:18.444 for scenario=None
2025-07-21 08:36:49,674 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:49,675 get_cmds: Getting recent commands from cache
2025-07-21 08:36:49,676 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:49,753 add_exclude_interval: pcad_mode: excluding interval 2025:193:01:04:59.000 - 2025:193:01:17:59.000: SRDC
2025-07-21 08:36:49,755 add_exclude_interval: pcad_mode: excluding interval 2025:201:02:14:59.000 - 2025:201:02:27:59.000: SRDC
2025-07-21 08:36:49,755 tlm: Fetching telemetry for ['aopcadmd'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for aopcadmd between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4084:1146752]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-07-21 08:36:50,085 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:36:50,085 get_states: Getting commanded states ['pcad_mode'] between 2025:188:12:36:18.696 - 2025:202:11:15:20.700
2025-07-21 08:36:50,085 get_cmds: Getting commands from 2025:188:12:36:18.696 to 2025:202:11:15:20.700 for scenario=None
2025-07-21 08:36:50,085 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:50,086 get_cmds: Getting recent commands from cache
2025-07-21 08:36:50,087 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:50,089 get_cmds: Getting commands from 2025:181:12:36:18.696 to 2025:188:12:36:18.696 for scenario=None
2025-07-21 08:36:50,090 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:36:50,090 get_cmds: Getting recent commands from cache
2025-07-21 08:36:50,091 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:36:58,575 get_plot_figure: Compressing Telem data for state pcad_mode
2025-07-21 08:37:00,526 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-07-21 08:37:00,530 get_plot_figure: Compressing State data for state pcad_mode
2025-07-21 08:37:02,510 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-07-21 08:37:02,583 get_plot_html: Creating HTML for state pcad_mode
2025-07-21 08:37:02,589 run_validators: Validating simpos
2025-07-21 08:37:02,596 tlm: Fetching telemetry for ['3tscpos'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for 3tscpos between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [128:35759]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-07-21 08:37:02,770 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:37:02,770 get_states: Getting commanded states ['simpos'] between 2025:188:12:36:49.446 - 2025:202:11:14:56.612
2025-07-21 08:37:02,770 get_cmds: Getting commands from 2025:188:12:36:49.446 to 2025:202:11:14:56.612 for scenario=None
2025-07-21 08:37:02,770 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:02,771 get_cmds: Getting recent commands from cache
2025-07-21 08:37:02,772 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:02,774 get_cmds: Getting commands from 2025:181:12:36:49.446 to 2025:188:12:36:49.446 for scenario=None
2025-07-21 08:37:02,775 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:02,776 get_cmds: Getting recent commands from cache
2025-07-21 08:37:02,776 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:02,922 get_plot_figure: Compressing Telem data for state simpos
2025-07-21 08:37:02,985 get_plot_figure: Creating Telem scatter plot for state simpos
2025-07-21 08:37:02,988 get_plot_figure: Compressing State data for state simpos
2025-07-21 08:37:03,049 get_plot_figure: Creating State scatter plot for state simpos
2025-07-21 08:37:03,059 get_plot_html: Creating HTML for state simpos
2025-07-21 08:37:03,063 run_validators: Validating obsid
2025-07-21 08:37:03,070 tlm: Fetching telemetry for ['cobsrqid'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for cobsrqid between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [2042:573376]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-07-21 08:37:03,326 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:37:03,326 get_states: Getting commanded states ['obsid'] between 2025:188:12:36:18.696 - 2025:202:11:15:20.443
2025-07-21 08:37:03,326 get_cmds: Getting commands from 2025:188:12:36:18.696 to 2025:202:11:15:20.443 for scenario=None
2025-07-21 08:37:03,326 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:03,327 get_cmds: Getting recent commands from cache
2025-07-21 08:37:03,328 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:03,330 get_cmds: Getting commands from 2025:181:12:36:18.696 to 2025:188:12:36:18.696 for scenario=None
2025-07-21 08:37:03,331 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:03,332 get_cmds: Getting recent commands from cache
2025-07-21 08:37:03,332 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:05,600 get_plot_figure: Compressing Telem data for state obsid
2025-07-21 08:37:06,584 get_plot_figure: Creating Telem scatter plot for state obsid
2025-07-21 08:37:06,587 get_plot_figure: Compressing State data for state obsid
2025-07-21 08:37:07,559 get_plot_figure: Creating State scatter plot for state obsid
2025-07-21 08:37:07,579 get_plot_html: Creating HTML for state obsid
2025-07-21 08:37:07,583 run_validators: Validating letg
2025-07-21 08:37:07,590 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for 4ootgsel between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [128:35836]
_get_data: Getting data for 4ootgmtn between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Using times_cache for tel2eng 868278147.6279999 to 869489547.6279999
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [128:35836]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-07-21 08:37:08,091 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:37:08,091 get_states: Getting commanded states ['letg'] between 2025:188:12:36:49.446 - 2025:202:11:15:18.393
2025-07-21 08:37:08,091 get_cmds: Getting commands from 2025:188:12:36:49.446 to 2025:202:11:15:18.393 for scenario=None
2025-07-21 08:37:08,091 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:08,092 get_cmds: Getting recent commands from cache
2025-07-21 08:37:08,093 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:08,095 get_cmds: Getting commands from 2025:181:12:36:49.446 to 2025:188:12:36:49.446 for scenario=None
2025-07-21 08:37:08,096 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:08,096 get_cmds: Getting recent commands from cache
2025-07-21 08:37:08,097 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:08,106 get_cmds: Getting commands from 2025:158:12:36:49.446 to 2025:188:12:36:49.446 for scenario=None
2025-07-21 08:37:08,106 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:08,107 get_cmds: Getting recent commands from cache
2025-07-21 08:37:08,107 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:158:12:36:49.446
2025-07-21 08:37:09,927 load_idx_cmds: Loaded /export/tom/kadi-validate/data/kadi/cmds2.h5 with 1727258 commands
2025-07-21 08:37:09,938 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-07-21 08:37:10,388 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-07-21 08:37:10,389 get_matching_block_idx: Match(a=0, b=0, size=3)
2025-07-21 08:37:10,389 get_matching_block_idx: Match(a=6, b=3, size=78)
2025-07-21 08:37:10,389 get_matching_block_idx: Match(a=85, b=81, size=11295)
2025-07-21 08:37:10,389 get_matching_block_idx: Match(a=11380, b=11376, size=0)
2025-07-21 08:37:10,389 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-07-21 08:37:10,389 get_matching_block_idx: ('equal', 0, 3, 0, 3)
2025-07-21 08:37:10,389 get_matching_block_idx: ('delete', 3, 6, 3, 3)
2025-07-21 08:37:10,389 get_matching_block_idx: ('equal', 6, 84, 3, 81)
2025-07-21 08:37:10,389 get_matching_block_idx: ('delete', 84, 85, 81, 81)
2025-07-21 08:37:10,389 get_matching_block_idx: ('equal', 85, 11380, 81, 11376)
2025-07-21 08:37:10,395 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-21 08:37:10,638 get_plot_figure: Compressing Telem data for state letg
2025-07-21 08:37:10,698 get_plot_figure: Creating Telem scatter plot for state letg
2025-07-21 08:37:10,700 get_plot_figure: Compressing State data for state letg
2025-07-21 08:37:10,760 get_plot_figure: Creating State scatter plot for state letg
2025-07-21 08:37:10,769 get_plot_html: Creating HTML for state letg
2025-07-21 08:37:10,772 run_validators: Validating hetg
2025-07-21 08:37:10,779 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for 4ootgsel between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_data: Getting data for 4ootgmtn between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-07-21 08:37:10,795 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:37:10,795 get_states: Getting commanded states ['hetg'] between 2025:188:12:36:49.446 - 2025:202:11:15:18.393
2025-07-21 08:37:10,795 get_cmds: Getting commands from 2025:188:12:36:49.446 to 2025:202:11:15:18.393 for scenario=None
2025-07-21 08:37:10,795 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:10,796 get_cmds: Getting recent commands from cache
2025-07-21 08:37:10,797 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:10,799 get_cmds: Getting commands from 2025:181:12:36:49.446 to 2025:188:12:36:49.446 for scenario=None
2025-07-21 08:37:10,799 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:10,800 get_cmds: Getting recent commands from cache
2025-07-21 08:37:10,800 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:10,809 get_cmds: Getting commands from 2025:158:12:36:49.446 to 2025:188:12:36:49.446 for scenario=None
2025-07-21 08:37:10,809 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:10,810 get_cmds: Getting recent commands from cache
2025-07-21 08:37:10,810 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:158:12:36:49.446
2025-07-21 08:37:10,812 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-21 08:37:11,055 get_plot_figure: Compressing Telem data for state hetg
2025-07-21 08:37:11,116 get_plot_figure: Creating Telem scatter plot for state hetg
2025-07-21 08:37:11,117 get_plot_figure: Compressing State data for state hetg
2025-07-21 08:37:11,178 get_plot_figure: Creating State scatter plot for state hetg
2025-07-21 08:37:11,186 get_plot_html: Creating HTML for state hetg
2025-07-21 08:37:11,190 run_validators: Validating sun_pos_mon
2025-07-21 08:37:11,197 tlm: Fetching telemetry for ['aopssupm'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for aopssupm between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [511:143344]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-07-21 08:37:11,592 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:37:11,592 get_states: Getting commanded states ['sun_pos_mon'] between 2025:188:12:36:24.846 - 2025:202:11:15:17.881
2025-07-21 08:37:11,593 get_cmds: Getting commands from 2025:188:12:36:24.846 to 2025:202:11:15:17.881 for scenario=None
2025-07-21 08:37:11,593 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:11,593 get_cmds: Getting recent commands from cache
2025-07-21 08:37:11,594 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:11,596 get_cmds: Getting commands from 2025:181:12:36:24.846 to 2025:188:12:36:24.846 for scenario=None
2025-07-21 08:37:11,597 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:11,598 get_cmds: Getting recent commands from cache
2025-07-21 08:37:11,598 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:11,611 get_cmds: Getting commands from 2025:158:12:36:24.846 to 2025:188:12:36:24.846 for scenario=None
2025-07-21 08:37:11,612 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:11,612 get_cmds: Getting recent commands from cache
2025-07-21 08:37:11,613 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:158:12:36:24.846
2025-07-21 08:37:11,615 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-21 08:37:11,638 get_cmds: Getting commands from 2025:008:12:36:24.846 to 2025:188:12:36:24.846 for scenario=None
2025-07-21 08:37:11,639 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:11,639 get_cmds: Getting recent commands from cache
2025-07-21 08:37:11,640 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:008:12:36:24.846
2025-07-21 08:37:11,644 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-21 08:37:12,596 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-07-21 08:37:12,841 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-07-21 08:37:12,844 get_plot_figure: Compressing State data for state sun_pos_mon
2025-07-21 08:37:13,086 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-07-21 08:37:13,103 get_plot_html: Creating HTML for state sun_pos_mon
2025-07-21 08:37:13,107 run_validators: Validating dpa_power
2025-07-21 08:37:21,993 tlm: Fetching telemetry for ['dpa_power'] between 2025:188:12:36:18.444 and 2025:202:12:36:18.444
_get_data: Getting data for dpa_power between 2025:188:12:21:18.444 to 2025:202:12:51:18.444
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/dp_acispow128/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/dp_acispow128/DP_DPA_POWER.h5
_get_msid_data_from_cxc: Slicing DP_DPA_POWER arrays [23:35685]
interpolate: Interpolating index for dpa_power
interpolate: Slicing on indexes
2025-07-21 08:37:22,402 get_states: Using kadi.commands.states to get cmd_states
2025-07-21 08:37:22,402 get_states: Getting commanded states ['ccd_count', 'clocking', 'feps', 'ccds', 'fep_count', 'si_mode'] between 2025:188:12:36:45.216 - 2025:202:11:14:48.668
2025-07-21 08:37:22,402 get_cmds: Getting commands from 2025:188:12:36:45.216 to 2025:202:11:14:48.668 for scenario=None
2025-07-21 08:37:22,403 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:22,403 get_cmds: Getting recent commands from cache
2025-07-21 08:37:22,404 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:22,407 get_cmds: Getting commands from 2025:181:12:36:45.216 to 2025:188:12:36:45.216 for scenario=None
2025-07-21 08:37:22,407 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-21 08:37:22,408 get_cmds: Getting recent commands from cache
2025-07-21 08:37:22,408 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-21 08:37:23,099 get_plot_figure: Compressing Telem data for state dpa_power
2025-07-21 08:37:23,671 get_plot_figure: Creating Telem scatter plot for state dpa_power
2025-07-21 08:37:23,901 get_plot_figure: Compressing State data for state dpa_power
2025-07-21 08:37:23,966 get_plot_figure: Creating State scatter plot for state dpa_power
2025-07-21 08:37:24,020 get_plot_html: Creating HTML for state dpa_power