Prev
Index
Next
kadi: Thu Jul 17 08:37:22 2025
File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kadi |
OK
|
0.09 | 1.5 |
Thu Jul 17 08:37:22 2025 |
No errors
File contents:
2025-07-17 08:36:13,745 run_validators: Validating pitch
2025-07-17 08:36:13,746 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:184:12:20:43.745 to 2025:198:12:51:43.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4800:1143264]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-07-17 08:36:14,963 tlm: Fetching telemetry for ['pitch_comp'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for pitch_comp between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:184:12:05:43.745 to 2025:198:13:06:43.745
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 867931612.929 to 869144872.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3922:1143264]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4829:1143264]
_get_data: Getting data for orbitephem0_x between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [5186:9228]
_get_data: Getting data for orbitephem0_y between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Using times_cache for orbitephem0 867931822.9290001 to 869144662.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [5186:9228]
_get_data: Getting data for orbitephem0_z between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Using times_cache for orbitephem0 867931822.9290001 to 869144662.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [5186:9228]
_get_data: Getting data for solarephem0_x between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [5186:9228]
_get_data: Getting data for solarephem0_y between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Using times_cache for solarephem0 867931822.9290001 to 869144662.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [5186:9228]
_get_data: Getting data for solarephem0_z between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Using times_cache for solarephem0 867931822.9290001 to 869144662.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [5186:9228]
_get_data: Getting data for aoattqt1 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [4126:1143264]
_get_data: Getting data for aoattqt2 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Using times_cache for pcad3eng 867931822.9290001 to 869144662.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [4126:1143264]
_get_data: Getting data for aoattqt3 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Using times_cache for pcad3eng 867931822.9290001 to 869144662.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [4126:1143264]
_get_data: Getting data for aoattqt4 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_msid_data_from_cxc: Using times_cache for pcad3eng 867931822.9290001 to 869144662.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [4126:1143264]
fetch: Setting bads because of gaps in aoattqt1 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
fetch: Setting bads because of gaps in aoattqt2 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
fetch: Setting bads because of gaps in aoattqt3 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
fetch: Setting bads because of gaps in aoattqt4 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-07-17 08:36:18,733 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:36:18,734 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:184:12:36:14.191 - 2025:198:11:10:31.191
2025-07-17 08:36:18,734 get_cmds: Getting commands from 2025:184:12:36:14.191 to 2025:198:11:10:31.191 for scenario=None
2025-07-17 08:36:18,734 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:18,736 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-07-17 08:36:18,736 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-07-17 08:36:19,120 get_cmd_events_from_sheet: Writing 155 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-07-17 08:36:19,130 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/JUN with cache=False
2025-07-17 08:36:19,737 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUN2325A.pkl.gz
2025-07-17 08:36:19,743 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUN3025A.pkl.gz
2025-07-17 08:36:19,747 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/JUL with cache=False
2025-07-17 08:36:19,795 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL0725B.pkl.gz
2025-07-17 08:36:19,801 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/JUL1425A.pkl.gz
2025-07-17 08:36:19,807 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/AUG with cache=False
2025-07-17 08:36:19,835 update_cmd_events_and_loads_and_get_cmds_recent: Including loads JUN2325A, JUN3025A, JUL0725B, JUL1425A
2025-07-17 08:36:19,839 update_cmd_events_and_loads_and_get_cmds_recent: Load JUN2325A has 2100 commands with RLTT=2025:174:00:04:24.719
2025-07-17 08:36:19,842 update_cmd_events_and_loads_and_get_cmds_recent: Load JUN3025A has 1732 commands with RLTT=2025:181:00:15:08.508
2025-07-17 08:36:19,845 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL0725B has 1862 commands with RLTT=2025:187:17:23:00.000
2025-07-17 08:36:19,850 update_cmd_events_and_loads_and_get_cmds_recent: Load JUL1425A has 3384 commands with RLTT=2025:195:01:16:43.803
2025-07-17 08:36:19,882 update_cmd_events_and_loads_and_get_cmds_recent: No cmd_events to include
2025-07-17 08:36:19,882 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUN2325A with 2100 commands
2025-07-17 08:36:19,883 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2100 commands from JUN2325A
2025-07-17 08:36:19,883 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUN3025A with 1732 commands
2025-07-17 08:36:19,883 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1732 commands from JUN3025A
2025-07-17 08:36:19,883 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL0725B with 1862 commands
2025-07-17 08:36:19,883 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1862 commands from JUL0725B
2025-07-17 08:36:19,883 update_cmd_events_and_loads_and_get_cmds_recent: Processing JUL1425A with 3384 commands
2025-07-17 08:36:19,884 update_cmd_events_and_loads_and_get_cmds_recent: Adding 3384 commands from JUL1425A
2025-07-17 08:36:20,269 load_pars_dict: Loaded /export/tom/kadi-validate/data/kadi/cmds2.pkl with 181546 pars
2025-07-17 08:36:20,288 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:20,290 get_cmds: Getting commands from 2025:177:12:36:14.191 to 2025:184:12:36:14.191 for scenario=None
2025-07-17 08:36:20,291 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:20,292 get_cmds: Getting recent commands from cache
2025-07-17 08:36:20,292 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:29,395 get_plot_figure: Compressing Telem data for state pitch
2025-07-17 08:36:31,818 get_plot_figure: Creating Telem scatter plot for state pitch
2025-07-17 08:36:32,154 get_plot_figure: Compressing State data for state pitch
2025-07-17 08:36:34,416 get_plot_figure: Creating State scatter plot for state pitch
2025-07-17 08:36:34,656 get_plot_html: Creating HTML for state pitch
2025-07-17 08:36:34,677 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:184:12:20:43.745 to 2025:198:12:51:43.745
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-07-17 08:36:34,876 tlm: Fetching telemetry for ['roll_comp'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for roll_comp between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:184:12:05:43.745 to 2025:198:13:06:43.745
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_data: Getting data for orbitephem0_x between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for orbitephem0_y between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for orbitephem0_z between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for solarephem0_x between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for solarephem0_y between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for solarephem0_z between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for aoattqt1 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for aoattqt2 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for aoattqt3 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
_get_data: Getting data for aoattqt4 between 2025:184:12:09:13.745 to 2025:198:13:03:13.745
fetch: Setting bads because of gaps in aoattqt1 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
fetch: Setting bads because of gaps in aoattqt2 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
fetch: Setting bads because of gaps in aoattqt3 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
fetch: Setting bads because of gaps in aoattqt4 between 2025:198:11:10:36.316 to 2025:198:13:03:13.116
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-07-17 08:36:36,139 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:36:36,140 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:184:12:36:14.191 - 2025:198:11:10:31.191
2025-07-17 08:36:36,140 get_cmds: Getting commands from 2025:184:12:36:14.191 to 2025:198:11:10:31.191 for scenario=None
2025-07-17 08:36:36,140 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:36,141 get_cmds: Getting recent commands from cache
2025-07-17 08:36:36,142 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:36,144 get_cmds: Getting commands from 2025:177:12:36:14.191 to 2025:184:12:36:14.191 for scenario=None
2025-07-17 08:36:36,145 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:36,145 get_cmds: Getting recent commands from cache
2025-07-17 08:36:36,146 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:40,527 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-07-17 08:36:42,679 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-07-17 08:36:42,701 get_plot_figure: Compressing State data for state off_nom_roll
2025-07-17 08:36:44,746 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-07-17 08:36:44,804 get_plot_html: Creating HTML for state off_nom_roll
2025-07-17 08:36:44,813 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:184:12:20:43.745 to 2025:198:12:51:43.745
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-07-17 08:36:44,997 get_cmds: Getting commands from 2025:184:12:16:13.745 to 2025:198:12:36:13.745 for scenario=None
2025-07-17 08:36:44,997 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:44,998 get_cmds: Getting recent commands from cache
2025-07-17 08:36:44,998 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:45,052 add_exclude_interval: dither: excluding interval 2025:185:03:04:59.000 - 2025:185:03:17:59.000: SRDC
2025-07-17 08:36:45,053 add_exclude_interval: dither: excluding interval 2025:188:01:29:59.000 - 2025:188:01:42:59.000: SRDC
2025-07-17 08:36:45,055 add_exclude_interval: dither: excluding interval 2025:193:01:04:59.000 - 2025:193:01:17:59.000: SRDC
2025-07-17 08:36:45,055 tlm: Fetching telemetry for ['aodithen'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for aodithen between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [604:142908]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-07-17 08:36:46,267 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:36:46,267 get_states: Getting commanded states ['dither'] between 2025:184:12:36:19.424 - 2025:198:11:10:27.871
2025-07-17 08:36:46,267 get_cmds: Getting commands from 2025:184:12:36:19.424 to 2025:198:11:10:27.871 for scenario=None
2025-07-17 08:36:46,267 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:46,268 get_cmds: Getting recent commands from cache
2025-07-17 08:36:46,268 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:46,270 get_cmds: Getting commands from 2025:177:12:36:19.424 to 2025:184:12:36:19.424 for scenario=None
2025-07-17 08:36:46,271 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:46,272 get_cmds: Getting recent commands from cache
2025-07-17 08:36:46,272 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:47,116 get_plot_figure: Compressing Telem data for state dither
2025-07-17 08:36:47,369 get_plot_figure: Creating Telem scatter plot for state dither
2025-07-17 08:36:47,370 get_plot_figure: Compressing State data for state dither
2025-07-17 08:36:47,626 get_plot_figure: Creating State scatter plot for state dither
2025-07-17 08:36:47,685 get_plot_html: Creating HTML for state dither
2025-07-17 08:36:47,689 run_validators: Validating pcad_mode
2025-07-17 08:36:47,700 add_exclude_interval: pcad_mode: excluding interval 2025:190:10:31:09.337 - 2025:190:10:49:32.228: PEA patch uplink ground command NMM
2025-07-17 08:36:47,701 get_cmds: Getting commands from 2025:184:12:16:13.745 to 2025:198:12:36:13.745 for scenario=None
2025-07-17 08:36:47,702 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:47,702 get_cmds: Getting recent commands from cache
2025-07-17 08:36:47,703 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:47,753 add_exclude_interval: pcad_mode: excluding interval 2025:185:03:04:59.000 - 2025:185:03:17:59.000: SRDC
2025-07-17 08:36:47,755 add_exclude_interval: pcad_mode: excluding interval 2025:188:01:29:59.000 - 2025:188:01:42:59.000: SRDC
2025-07-17 08:36:47,756 add_exclude_interval: pcad_mode: excluding interval 2025:193:01:04:59.000 - 2025:193:01:17:59.000: SRDC
2025-07-17 08:36:47,757 tlm: Fetching telemetry for ['aopcadmd'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for aopcadmd between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4829:1143264]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-07-17 08:36:47,979 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:36:47,980 get_states: Getting commanded states ['pcad_mode'] between 2025:184:12:36:14.299 - 2025:198:11:10:30.946
2025-07-17 08:36:47,980 get_cmds: Getting commands from 2025:184:12:36:14.299 to 2025:198:11:10:30.946 for scenario=None
2025-07-17 08:36:47,980 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:47,981 get_cmds: Getting recent commands from cache
2025-07-17 08:36:47,981 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:47,983 get_cmds: Getting commands from 2025:177:12:36:14.299 to 2025:184:12:36:14.299 for scenario=None
2025-07-17 08:36:47,984 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:36:47,984 get_cmds: Getting recent commands from cache
2025-07-17 08:36:47,985 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:36:55,955 get_plot_figure: Compressing Telem data for state pcad_mode
2025-07-17 08:36:57,968 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-07-17 08:36:57,972 get_plot_figure: Compressing State data for state pcad_mode
2025-07-17 08:36:59,972 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-07-17 08:37:00,025 get_plot_html: Creating HTML for state pcad_mode
2025-07-17 08:37:00,030 run_validators: Validating simpos
2025-07-17 08:37:00,036 tlm: Fetching telemetry for ['3tscpos'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for 3tscpos between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [150:35653]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-07-17 08:37:00,170 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:37:00,171 get_states: Getting commanded states ['simpos'] between 2025:184:12:36:35.824 - 2025:198:11:10:20.184
2025-07-17 08:37:00,171 get_cmds: Getting commands from 2025:184:12:36:35.824 to 2025:198:11:10:20.184 for scenario=None
2025-07-17 08:37:00,171 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:00,172 get_cmds: Getting recent commands from cache
2025-07-17 08:37:00,172 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:00,175 get_cmds: Getting commands from 2025:177:12:36:35.824 to 2025:184:12:36:35.824 for scenario=None
2025-07-17 08:37:00,175 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:00,176 get_cmds: Getting recent commands from cache
2025-07-17 08:37:00,176 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:00,309 get_plot_figure: Compressing Telem data for state simpos
2025-07-17 08:37:00,374 get_plot_figure: Creating Telem scatter plot for state simpos
2025-07-17 08:37:00,377 get_plot_figure: Compressing State data for state simpos
2025-07-17 08:37:00,440 get_plot_figure: Creating State scatter plot for state simpos
2025-07-17 08:37:00,448 get_plot_html: Creating HTML for state simpos
2025-07-17 08:37:00,452 run_validators: Validating obsid
2025-07-17 08:37:00,458 tlm: Fetching telemetry for ['cobsrqid'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for cobsrqid between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [2415:571632]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-07-17 08:37:00,679 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:37:00,679 get_states: Getting commanded states ['obsid'] between 2025:184:12:36:15.324 - 2025:198:11:10:31.715
2025-07-17 08:37:00,679 get_cmds: Getting commands from 2025:184:12:36:15.324 to 2025:198:11:10:31.715 for scenario=None
2025-07-17 08:37:00,679 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:00,680 get_cmds: Getting recent commands from cache
2025-07-17 08:37:00,681 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:00,683 get_cmds: Getting commands from 2025:177:12:36:15.324 to 2025:184:12:36:15.324 for scenario=None
2025-07-17 08:37:00,683 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:00,684 get_cmds: Getting recent commands from cache
2025-07-17 08:37:00,684 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:02,762 get_plot_figure: Compressing Telem data for state obsid
2025-07-17 08:37:03,781 get_plot_figure: Creating Telem scatter plot for state obsid
2025-07-17 08:37:03,784 get_plot_figure: Compressing State data for state obsid
2025-07-17 08:37:04,818 get_plot_figure: Creating State scatter plot for state obsid
2025-07-17 08:37:04,834 get_plot_html: Creating HTML for state obsid
2025-07-17 08:37:04,838 run_validators: Validating letg
2025-07-17 08:37:04,846 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for 4ootgsel between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [151:35727]
_get_data: Getting data for 4ootgmtn between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Using times_cache for tel2eng 867932542.9290001 to 869143942.929
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [151:35727]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-07-17 08:37:05,223 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:37:05,223 get_states: Getting commanded states ['letg'] between 2025:184:12:36:35.824 - 2025:198:11:10:09.165
2025-07-17 08:37:05,223 get_cmds: Getting commands from 2025:184:12:36:35.824 to 2025:198:11:10:09.165 for scenario=None
2025-07-17 08:37:05,223 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:05,224 get_cmds: Getting recent commands from cache
2025-07-17 08:37:05,225 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:05,227 get_cmds: Getting commands from 2025:177:12:36:35.824 to 2025:184:12:36:35.824 for scenario=None
2025-07-17 08:37:05,227 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:05,228 get_cmds: Getting recent commands from cache
2025-07-17 08:37:05,228 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:05,236 get_cmds: Getting commands from 2025:154:12:36:35.824 to 2025:184:12:36:35.824 for scenario=None
2025-07-17 08:37:05,237 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:05,237 get_cmds: Getting recent commands from cache
2025-07-17 08:37:05,238 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:154:12:36:35.824
2025-07-17 08:37:06,824 load_idx_cmds: Loaded /export/tom/kadi-validate/data/kadi/cmds2.h5 with 1725146 commands
2025-07-17 08:37:06,833 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-07-17 08:37:07,188 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-07-17 08:37:07,188 get_matching_block_idx: Match(a=0, b=0, size=3)
2025-07-17 08:37:07,188 get_matching_block_idx: Match(a=6, b=3, size=78)
2025-07-17 08:37:07,188 get_matching_block_idx: Match(a=85, b=81, size=9183)
2025-07-17 08:37:07,188 get_matching_block_idx: Match(a=9268, b=9264, size=0)
2025-07-17 08:37:07,188 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-07-17 08:37:07,188 get_matching_block_idx: ('equal', 0, 3, 0, 3)
2025-07-17 08:37:07,188 get_matching_block_idx: ('delete', 3, 6, 3, 3)
2025-07-17 08:37:07,188 get_matching_block_idx: ('equal', 6, 84, 3, 81)
2025-07-17 08:37:07,188 get_matching_block_idx: ('delete', 84, 85, 81, 81)
2025-07-17 08:37:07,188 get_matching_block_idx: ('equal', 85, 9268, 81, 9264)
2025-07-17 08:37:07,192 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-17 08:37:07,425 get_plot_figure: Compressing Telem data for state letg
2025-07-17 08:37:07,501 get_plot_figure: Creating Telem scatter plot for state letg
2025-07-17 08:37:07,503 get_plot_figure: Compressing State data for state letg
2025-07-17 08:37:07,566 get_plot_figure: Creating State scatter plot for state letg
2025-07-17 08:37:07,574 get_plot_html: Creating HTML for state letg
2025-07-17 08:37:07,577 run_validators: Validating hetg
2025-07-17 08:37:07,584 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for 4ootgsel between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_data: Getting data for 4ootgmtn between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-07-17 08:37:07,600 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:37:07,600 get_states: Getting commanded states ['hetg'] between 2025:184:12:36:35.824 - 2025:198:11:10:09.165
2025-07-17 08:37:07,600 get_cmds: Getting commands from 2025:184:12:36:35.824 to 2025:198:11:10:09.165 for scenario=None
2025-07-17 08:37:07,600 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:07,601 get_cmds: Getting recent commands from cache
2025-07-17 08:37:07,602 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:07,604 get_cmds: Getting commands from 2025:177:12:36:35.824 to 2025:184:12:36:35.824 for scenario=None
2025-07-17 08:37:07,604 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:07,605 get_cmds: Getting recent commands from cache
2025-07-17 08:37:07,605 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:07,613 get_cmds: Getting commands from 2025:154:12:36:35.824 to 2025:184:12:36:35.824 for scenario=None
2025-07-17 08:37:07,613 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:07,614 get_cmds: Getting recent commands from cache
2025-07-17 08:37:07,615 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:154:12:36:35.824
2025-07-17 08:37:07,616 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-17 08:37:07,852 get_plot_figure: Compressing Telem data for state hetg
2025-07-17 08:37:07,917 get_plot_figure: Creating Telem scatter plot for state hetg
2025-07-17 08:37:07,919 get_plot_figure: Compressing State data for state hetg
2025-07-17 08:37:07,983 get_plot_figure: Creating State scatter plot for state hetg
2025-07-17 08:37:07,991 get_plot_html: Creating HTML for state hetg
2025-07-17 08:37:07,994 run_validators: Validating sun_pos_mon
2025-07-17 08:37:08,002 tlm: Fetching telemetry for ['aopssupm'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for aopssupm between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [604:142908]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-07-17 08:37:08,303 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:37:08,303 get_states: Getting commanded states ['sun_pos_mon'] between 2025:184:12:36:19.424 - 2025:198:11:10:25.053
2025-07-17 08:37:08,303 get_cmds: Getting commands from 2025:184:12:36:19.424 to 2025:198:11:10:25.053 for scenario=None
2025-07-17 08:37:08,303 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:08,304 get_cmds: Getting recent commands from cache
2025-07-17 08:37:08,305 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:08,307 get_cmds: Getting commands from 2025:177:12:36:19.424 to 2025:184:12:36:19.424 for scenario=None
2025-07-17 08:37:08,307 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:08,308 get_cmds: Getting recent commands from cache
2025-07-17 08:37:08,308 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:08,321 get_cmds: Getting commands from 2025:154:12:36:19.424 to 2025:184:12:36:19.424 for scenario=None
2025-07-17 08:37:08,322 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:08,322 get_cmds: Getting recent commands from cache
2025-07-17 08:37:08,323 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:154:12:36:19.424
2025-07-17 08:37:08,324 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-17 08:37:08,348 get_cmds: Getting commands from 2025:004:12:36:19.424 to 2025:184:12:36:19.424 for scenario=None
2025-07-17 08:37:08,348 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:08,349 get_cmds: Getting recent commands from cache
2025-07-17 08:37:08,350 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:004:12:36:19.424
2025-07-17 08:37:08,353 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-07-17 08:37:09,255 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-07-17 08:37:09,505 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-07-17 08:37:09,508 get_plot_figure: Compressing State data for state sun_pos_mon
2025-07-17 08:37:09,758 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-07-17 08:37:09,772 get_plot_html: Creating HTML for state sun_pos_mon
2025-07-17 08:37:09,776 run_validators: Validating dpa_power
2025-07-17 08:37:20,359 tlm: Fetching telemetry for ['dpa_power'] between 2025:184:12:36:13.745 and 2025:198:12:36:13.745
_get_data: Getting data for dpa_power between 2025:184:12:21:13.745 to 2025:198:12:51:13.745
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/dp_acispow128/TIME.h5
_get_msid_data_from_cxc: Reading /export/tom/kadi-validate/data/eng_archive/data/dp_acispow128/DP_DPA_POWER.h5
_get_msid_data_from_cxc: Slicing DP_DPA_POWER arrays [162:35685]
interpolate: Interpolating index for dpa_power
interpolate: Slicing on indexes
2025-07-17 08:37:20,642 get_states: Using kadi.commands.states to get cmd_states
2025-07-17 08:37:20,642 get_states: Getting commanded states ['ccd_count', 'clocking', 'feps', 'ccds', 'fep_count', 'si_mode'] between 2025:184:12:36:31.616 - 2025:198:11:10:12.240
2025-07-17 08:37:20,642 get_cmds: Getting commands from 2025:184:12:36:31.616 to 2025:198:11:10:12.240 for scenario=None
2025-07-17 08:37:20,642 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:20,643 get_cmds: Getting recent commands from cache
2025-07-17 08:37:20,644 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:20,646 get_cmds: Getting commands from 2025:177:12:36:31.616 to 2025:184:12:36:31.616 for scenario=None
2025-07-17 08:37:20,647 get_cmds: Cache key: (None, None, 30.0, None)
2025-07-17 08:37:20,647 get_cmds: Getting recent commands from cache
2025-07-17 08:37:20,648 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-07-17 08:37:21,327 get_plot_figure: Compressing Telem data for state dpa_power
2025-07-17 08:37:21,806 get_plot_figure: Creating Telem scatter plot for state dpa_power
2025-07-17 08:37:22,035 get_plot_figure: Compressing State data for state dpa_power
2025-07-17 08:37:22,113 get_plot_figure: Creating State scatter plot for state dpa_power
2025-07-17 08:37:22,170 get_plot_html: Creating HTML for state dpa_power