Prev   Index   Next

kadi: Thu May 8 08:32:00 2025

File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log

Task Status AgeMaxAge Last Date
kadi OK 0.091.5 Thu May 8 08:32:00 2025

No errors

File contents:

2025-05-08 08:31:08,102 run_validators: Validating pitch
2025-05-08 08:31:08,103 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:114:12:15:38.102 to 2025:128:12:46:38.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3502:1149504]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-05-08 08:31:09,242 tlm: Fetching telemetry for ['pitch_comp'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for pitch_comp between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:114:12:00:38.102 to 2025:128:13:01:38.102
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 861883307.2860001 to 863096567.2860001
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [2624:1149504]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [3531:1149504]
_get_data: Getting data for orbitephem0_x between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [5185:9227]
_get_data: Getting data for orbitephem0_y between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Using times_cache for orbitephem0 861883517.286 to 863096357.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [5185:9227]
_get_data: Getting data for orbitephem0_z between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Using times_cache for orbitephem0 861883517.286 to 863096357.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [5185:9227]
_get_data: Getting data for solarephem0_x between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [5185:9227]
_get_data: Getting data for solarephem0_y between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Using times_cache for solarephem0 861883517.286 to 863096357.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [5185:9227]
_get_data: Getting data for solarephem0_z between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Using times_cache for solarephem0 861883517.286 to 863096357.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [5185:9227]
_get_data: Getting data for aoattqt1 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2829:1149504]
_get_data: Getting data for aoattqt2 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Using times_cache for pcad3eng 861883517.286 to 863096357.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2829:1149504]
_get_data: Getting data for aoattqt3 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Using times_cache for pcad3eng 861883517.286 to 863096357.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2829:1149504]
_get_data: Getting data for aoattqt4 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_msid_data_from_cxc: Using times_cache for pcad3eng 861883517.286 to 863096357.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2829:1149504]
fetch: Setting bads because of gaps in aoattqt1 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
fetch: Setting bads because of gaps in aoattqt2 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
fetch: Setting bads because of gaps in aoattqt3 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
fetch: Setting bads because of gaps in aoattqt4 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-05-08 08:31:13,881 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:13,882 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:114:12:31:08.541 - 2025:128:11:16:37.941
2025-05-08 08:31:13,882 get_cmds: Getting commands from 2025:114:12:31:08.541 to 2025:128:11:16:37.941 for scenario=None
2025-05-08 08:31:13,882 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:13,884 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-05-08 08:31:13,884 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-05-08 08:31:14,221 get_cmd_events_from_sheet: Writing 151 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-05-08 08:31:14,265 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/APR with cache=False
2025-05-08 08:31:14,853 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR1425A.pkl.gz
2025-05-08 08:31:14,869 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR2125A.pkl.gz
2025-05-08 08:31:14,889 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR2825A.pkl.gz
2025-05-08 08:31:14,900 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAY with cache=False
2025-05-08 08:31:14,989 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAY0525A.pkl.gz
2025-05-08 08:31:15,001 update_cmd_events_and_loads_and_get_cmds_recent: Including loads APR1425A, APR2125A, APR2825A, MAY0525A
2025-05-08 08:31:15,008 update_cmd_events_and_loads_and_get_cmds_recent: Load APR1425A has 2192 commands with RLTT=2025:103:21:58:07.076
2025-05-08 08:31:15,012 update_cmd_events_and_loads_and_get_cmds_recent: Load APR2125A has 2082 commands with RLTT=2025:111:00:41:00.000
2025-05-08 08:31:15,020 update_cmd_events_and_loads_and_get_cmds_recent: Load APR2825A has 1894 commands with RLTT=2025:118:00:24:12.365
2025-05-08 08:31:15,028 update_cmd_events_and_loads_and_get_cmds_recent: Load MAY0525A has 1709 commands with RLTT=2025:125:01:52:24.962
2025-05-08 08:31:15,059 update_cmd_events_and_loads_and_get_cmds_recent: No cmd_events to include
2025-05-08 08:31:15,059 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR1425A with 2192 commands
2025-05-08 08:31:15,059 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2192 commands from APR1425A
2025-05-08 08:31:15,059 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR2125A with 2082 commands
2025-05-08 08:31:15,059 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2082 commands from APR2125A
2025-05-08 08:31:15,059 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR2825A with 1894 commands
2025-05-08 08:31:15,060 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1894 commands from APR2825A
2025-05-08 08:31:15,060 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAY0525A with 1709 commands
2025-05-08 08:31:15,060 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1709 commands from MAY0525A
2025-05-08 08:31:15,442 load_pars_dict: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.pkl with 179501 pars
2025-05-08 08:31:15,461 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:15,464 get_cmds: Getting commands from 2025:107:12:31:08.541 to 2025:114:12:31:08.541 for scenario=None
2025-05-08 08:31:15,465 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:15,466 get_cmds: Getting recent commands from cache
2025-05-08 08:31:15,466 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:20,639 get_plot_figure: Compressing Telem data for state pitch
2025-05-08 08:31:22,938 get_plot_figure: Creating Telem scatter plot for state pitch
2025-05-08 08:31:23,063 get_plot_figure: Compressing State data for state pitch
2025-05-08 08:31:25,180 get_plot_figure: Creating State scatter plot for state pitch
2025-05-08 08:31:25,575 get_plot_html: Creating HTML for state pitch
2025-05-08 08:31:25,673 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:114:12:15:38.102 to 2025:128:12:46:38.102
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-05-08 08:31:25,867 tlm: Fetching telemetry for ['roll_comp'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for roll_comp between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:114:12:00:38.102 to 2025:128:13:01:38.102
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_data: Getting data for orbitephem0_x between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for orbitephem0_y between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for orbitephem0_z between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for solarephem0_x between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for solarephem0_y between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for solarephem0_z between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for aoattqt1 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for aoattqt2 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for aoattqt3 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
_get_data: Getting data for aoattqt4 between 2025:114:12:04:08.102 to 2025:128:12:58:08.102
fetch: Setting bads because of gaps in aoattqt1 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
fetch: Setting bads because of gaps in aoattqt2 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
fetch: Setting bads because of gaps in aoattqt3 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
fetch: Setting bads because of gaps in aoattqt4 between 2025:128:11:16:43.066 to 2025:128:12:58:07.466
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-05-08 08:31:27,540 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:27,540 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:114:12:31:08.541 - 2025:128:11:16:37.941
2025-05-08 08:31:27,540 get_cmds: Getting commands from 2025:114:12:31:08.541 to 2025:128:11:16:37.941 for scenario=None
2025-05-08 08:31:27,541 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:27,541 get_cmds: Getting recent commands from cache
2025-05-08 08:31:27,542 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:27,544 get_cmds: Getting commands from 2025:107:12:31:08.541 to 2025:114:12:31:08.541 for scenario=None
2025-05-08 08:31:27,545 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:27,545 get_cmds: Getting recent commands from cache
2025-05-08 08:31:27,546 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:31,778 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-05-08 08:31:33,934 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-05-08 08:31:33,956 get_plot_figure: Compressing State data for state off_nom_roll
2025-05-08 08:31:35,973 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-05-08 08:31:36,031 get_plot_html: Creating HTML for state off_nom_roll
2025-05-08 08:31:36,041 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:114:12:15:38.102 to 2025:128:12:46:38.102
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-05-08 08:31:36,223 get_cmds: Getting commands from 2025:114:12:11:08.102 to 2025:128:12:31:08.102 for scenario=None
2025-05-08 08:31:36,223 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:36,224 get_cmds: Getting recent commands from cache
2025-05-08 08:31:36,224 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:36,288 add_exclude_interval: dither: excluding interval 2025:121:19:04:59.000 - 2025:121:19:17:59.000: SRDC
2025-05-08 08:31:36,289 tlm: Fetching telemetry for ['aodithen'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for aodithen between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [442:143688]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-05-08 08:31:36,595 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:36,595 get_states: Getting commanded states ['dither'] between 2025:114:12:31:15.425 - 2025:128:11:16:36.669
2025-05-08 08:31:36,596 get_cmds: Getting commands from 2025:114:12:31:15.425 to 2025:128:11:16:36.669 for scenario=None
2025-05-08 08:31:36,596 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:36,596 get_cmds: Getting recent commands from cache
2025-05-08 08:31:36,597 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:36,599 get_cmds: Getting commands from 2025:107:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:36,599 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:36,600 get_cmds: Getting recent commands from cache
2025-05-08 08:31:36,601 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:37,345 get_plot_figure: Compressing Telem data for state dither
2025-05-08 08:31:37,598 get_plot_figure: Creating Telem scatter plot for state dither
2025-05-08 08:31:37,599 get_plot_figure: Compressing State data for state dither
2025-05-08 08:31:37,851 get_plot_figure: Creating State scatter plot for state dither
2025-05-08 08:31:38,041 get_plot_html: Creating HTML for state dither
2025-05-08 08:31:38,045 run_validators: Validating pcad_mode
2025-05-08 08:31:38,056 get_cmds: Getting commands from 2025:114:12:11:08.102 to 2025:128:12:31:08.102 for scenario=None
2025-05-08 08:31:38,056 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:38,057 get_cmds: Getting recent commands from cache
2025-05-08 08:31:38,058 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:38,102 add_exclude_interval: pcad_mode: excluding interval 2025:121:19:04:59.000 - 2025:121:19:17:59.000: SRDC
2025-05-08 08:31:38,103 tlm: Fetching telemetry for ['aopcadmd'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for aopcadmd between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [3531:1149504]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-05-08 08:31:38,325 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:38,325 get_states: Getting commanded states ['pcad_mode'] between 2025:114:12:31:08.250 - 2025:128:11:16:37.694
2025-05-08 08:31:38,326 get_cmds: Getting commands from 2025:114:12:31:08.250 to 2025:128:11:16:37.694 for scenario=None
2025-05-08 08:31:38,326 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:38,326 get_cmds: Getting recent commands from cache
2025-05-08 08:31:38,327 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:38,329 get_cmds: Getting commands from 2025:107:12:31:08.250 to 2025:114:12:31:08.250 for scenario=None
2025-05-08 08:31:38,329 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:38,330 get_cmds: Getting recent commands from cache
2025-05-08 08:31:38,330 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:46,330 get_plot_figure: Compressing Telem data for state pcad_mode
2025-05-08 08:31:48,321 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-05-08 08:31:48,325 get_plot_figure: Compressing State data for state pcad_mode
2025-05-08 08:31:50,323 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-05-08 08:31:50,356 get_plot_html: Creating HTML for state pcad_mode
2025-05-08 08:31:50,361 run_validators: Validating simpos
2025-05-08 08:31:50,368 tlm: Fetching telemetry for ['3tscpos'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for 3tscpos between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [111:35845]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-05-08 08:31:50,538 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:50,538 get_states: Getting commanded states ['simpos'] between 2025:114:12:31:15.425 - 2025:128:11:16:28.982
2025-05-08 08:31:50,538 get_cmds: Getting commands from 2025:114:12:31:15.425 to 2025:128:11:16:28.982 for scenario=None
2025-05-08 08:31:50,539 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:50,539 get_cmds: Getting recent commands from cache
2025-05-08 08:31:50,540 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:50,542 get_cmds: Getting commands from 2025:107:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:50,542 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:50,543 get_cmds: Getting recent commands from cache
2025-05-08 08:31:50,543 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:50,676 get_plot_figure: Compressing Telem data for state simpos
2025-05-08 08:31:50,740 get_plot_figure: Creating Telem scatter plot for state simpos
2025-05-08 08:31:50,743 get_plot_figure: Compressing State data for state simpos
2025-05-08 08:31:50,805 get_plot_figure: Creating State scatter plot for state simpos
2025-05-08 08:31:50,813 get_plot_html: Creating HTML for state simpos
2025-05-08 08:31:50,816 run_validators: Validating obsid
2025-05-08 08:31:50,823 tlm: Fetching telemetry for ['cobsrqid'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for cobsrqid between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [1766:574752]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-05-08 08:31:51,076 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:51,076 get_states: Getting commanded states ['obsid'] between 2025:114:12:31:09.275 - 2025:128:11:16:38.463
2025-05-08 08:31:51,076 get_cmds: Getting commands from 2025:114:12:31:09.275 to 2025:128:11:16:38.463 for scenario=None
2025-05-08 08:31:51,076 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:51,077 get_cmds: Getting recent commands from cache
2025-05-08 08:31:51,078 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:51,080 get_cmds: Getting commands from 2025:107:12:31:09.275 to 2025:114:12:31:09.275 for scenario=None
2025-05-08 08:31:51,081 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:51,081 get_cmds: Getting recent commands from cache
2025-05-08 08:31:51,082 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:53,142 get_plot_figure: Compressing Telem data for state obsid
2025-05-08 08:31:54,269 get_plot_figure: Creating Telem scatter plot for state obsid
2025-05-08 08:31:54,272 get_plot_figure: Compressing State data for state obsid
2025-05-08 08:31:55,304 get_plot_figure: Creating State scatter plot for state obsid
2025-05-08 08:31:55,324 get_plot_html: Creating HTML for state obsid
2025-05-08 08:31:55,328 run_validators: Validating letg
2025-05-08 08:31:55,335 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for 4ootgsel between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [111:35922]
_get_data: Getting data for 4ootgmtn between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Using times_cache for tel2eng 861884237.286 to 863095637.286
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [111:35922]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-05-08 08:31:55,765 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:55,765 get_states: Getting commanded states ['letg'] between 2025:114:12:31:15.425 - 2025:128:11:16:17.963
2025-05-08 08:31:55,765 get_cmds: Getting commands from 2025:114:12:31:15.425 to 2025:128:11:16:17.963 for scenario=None
2025-05-08 08:31:55,765 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:55,766 get_cmds: Getting recent commands from cache
2025-05-08 08:31:55,766 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:55,768 get_cmds: Getting commands from 2025:107:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:55,769 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:55,769 get_cmds: Getting recent commands from cache
2025-05-08 08:31:55,770 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:55,778 get_cmds: Getting commands from 2025:084:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:55,778 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:55,779 get_cmds: Getting recent commands from cache
2025-05-08 08:31:55,779 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:084:12:31:15.425
2025-05-08 08:31:57,245 load_idx_cmds: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.h5 with 1703046 commands
2025-05-08 08:31:57,254 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-05-08 08:31:57,574 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-05-08 08:31:57,574 get_matching_block_idx: Match(a=0, b=0, size=1)
2025-05-08 08:31:57,574 get_matching_block_idx: Match(a=4, b=1, size=21)
2025-05-08 08:31:57,574 get_matching_block_idx: Match(a=26, b=22, size=8029)
2025-05-08 08:31:57,574 get_matching_block_idx: Match(a=8055, b=8051, size=0)
2025-05-08 08:31:57,574 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-05-08 08:31:57,574 get_matching_block_idx: ('equal', 0, 1, 0, 1)
2025-05-08 08:31:57,574 get_matching_block_idx: ('delete', 1, 4, 1, 1)
2025-05-08 08:31:57,575 get_matching_block_idx: ('equal', 4, 25, 1, 22)
2025-05-08 08:31:57,575 get_matching_block_idx: ('delete', 25, 26, 22, 22)
2025-05-08 08:31:57,575 get_matching_block_idx: ('equal', 26, 8055, 22, 8051)
2025-05-08 08:31:57,578 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-05-08 08:31:57,810 get_plot_figure: Compressing Telem data for state letg
2025-05-08 08:31:57,872 get_plot_figure: Creating Telem scatter plot for state letg
2025-05-08 08:31:57,873 get_plot_figure: Compressing State data for state letg
2025-05-08 08:31:57,936 get_plot_figure: Creating State scatter plot for state letg
2025-05-08 08:31:57,944 get_plot_html: Creating HTML for state letg
2025-05-08 08:31:57,956 run_validators: Validating hetg
2025-05-08 08:31:57,962 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for 4ootgsel between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_data: Getting data for 4ootgmtn between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-05-08 08:31:57,977 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:57,978 get_states: Getting commanded states ['hetg'] between 2025:114:12:31:15.425 - 2025:128:11:16:17.963
2025-05-08 08:31:57,978 get_cmds: Getting commands from 2025:114:12:31:15.425 to 2025:128:11:16:17.963 for scenario=None
2025-05-08 08:31:57,978 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:57,979 get_cmds: Getting recent commands from cache
2025-05-08 08:31:57,979 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:57,981 get_cmds: Getting commands from 2025:107:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:57,981 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:57,982 get_cmds: Getting recent commands from cache
2025-05-08 08:31:57,982 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:57,990 get_cmds: Getting commands from 2025:084:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:57,990 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:57,991 get_cmds: Getting recent commands from cache
2025-05-08 08:31:57,992 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:084:12:31:15.425
2025-05-08 08:31:57,993 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-05-08 08:31:58,228 get_plot_figure: Compressing Telem data for state hetg
2025-05-08 08:31:58,291 get_plot_figure: Creating Telem scatter plot for state hetg
2025-05-08 08:31:58,292 get_plot_figure: Compressing State data for state hetg
2025-05-08 08:31:58,354 get_plot_figure: Creating State scatter plot for state hetg
2025-05-08 08:31:58,362 get_plot_html: Creating HTML for state hetg
2025-05-08 08:31:58,366 run_validators: Validating sun_pos_mon
2025-05-08 08:31:58,373 tlm: Fetching telemetry for ['aopssupm'] between 2025:114:12:31:08.102 and 2025:128:12:31:08.102
_get_data: Getting data for aopssupm between 2025:114:12:16:08.102 to 2025:128:12:46:08.102
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [442:143688]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-05-08 08:31:58,701 get_states: Using kadi.commands.states to get cmd_states
2025-05-08 08:31:58,701 get_states: Getting commanded states ['sun_pos_mon'] between 2025:114:12:31:15.425 - 2025:128:11:16:33.851
2025-05-08 08:31:58,701 get_cmds: Getting commands from 2025:114:12:31:15.425 to 2025:128:11:16:33.851 for scenario=None
2025-05-08 08:31:58,701 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:58,702 get_cmds: Getting recent commands from cache
2025-05-08 08:31:58,703 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:58,704 get_cmds: Getting commands from 2025:107:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:58,705 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:58,705 get_cmds: Getting recent commands from cache
2025-05-08 08:31:58,706 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-05-08 08:31:58,720 get_cmds: Getting commands from 2025:084:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:58,720 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:58,721 get_cmds: Getting recent commands from cache
2025-05-08 08:31:58,721 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:084:12:31:15.425
2025-05-08 08:31:58,723 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-05-08 08:31:58,748 get_cmds: Getting commands from 2024:300:12:31:15.425 to 2025:114:12:31:15.425 for scenario=None
2025-05-08 08:31:58,748 get_cmds: Cache key: (None, None, 30.0, None)
2025-05-08 08:31:58,749 get_cmds: Getting recent commands from cache
2025-05-08 08:31:58,749 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2024:300:12:31:15.425
2025-05-08 08:31:58,754 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-05-08 08:31:59,650 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-05-08 08:31:59,896 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-05-08 08:31:59,899 get_plot_figure: Compressing State data for state sun_pos_mon
2025-05-08 08:32:00,147 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-05-08 08:32:00,162 get_plot_html: Creating HTML for state sun_pos_mon