Prev   Index   Next

kadi: Thu Apr 10 08:57:44 2025

File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log

Task Status AgeMaxAge Last Date
kadi OK 0.081.5 Thu Apr 10 08:57:44 2025

No errors

File contents:

2025-04-07 08:31:09,414 run_validators: Validating pitch
2025-04-07 08:31:09,414 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:083:12:15:39.414 to 2025:097:12:46:39.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [6174:1141120]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-07 08:31:10,468 tlm: Fetching telemetry for ['pitch_comp'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for pitch_comp between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:083:12:00:39.414 to 2025:097:13:01:39.414
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 859204908.5979998 to 860418168.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [5296:1141120]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [6204:1141120]
_get_data: Getting data for orbitephem0_x between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [6337:10379]
_get_data: Getting data for orbitephem0_y between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859205118.598 to 860417958.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [6337:10379]
_get_data: Getting data for orbitephem0_z between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859205118.598 to 860417958.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [6337:10379]
_get_data: Getting data for solarephem0_x between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [6337:10379]
_get_data: Getting data for solarephem0_y between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Using times_cache for solarephem0 859205118.598 to 860417958.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [6337:10379]
_get_data: Getting data for solarephem0_z between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Using times_cache for solarephem0 859205118.598 to 860417958.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [6337:10379]
_get_data: Getting data for aoattqt1 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [5501:1141120]
_get_data: Getting data for aoattqt2 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859205118.598 to 860417958.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [5501:1141120]
_get_data: Getting data for aoattqt3 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859205118.598 to 860417958.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [5501:1141120]
_get_data: Getting data for aoattqt4 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859205118.598 to 860417958.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [5501:1141120]
fetch: Setting bads because of gaps in aoattqt1 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
fetch: Setting bads because of gaps in aoattqt2 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
fetch: Setting bads because of gaps in aoattqt3 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
fetch: Setting bads because of gaps in aoattqt4 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-04-07 08:31:14,231 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:14,232 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:083:12:31:09.741 - 2025:097:03:12:19.366
2025-04-07 08:31:14,232 get_cmds: Getting commands from 2025:083:12:31:09.741 to 2025:097:03:12:19.366 for scenario=None
2025-04-07 08:31:14,234 update_cmd_events: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-04-07 08:31:14,571 update_cmd_events: Writing 151 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-04-07 08:31:14,579 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR with cache=False
2025-04-07 08:31:14,721 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR1025B.pkl.gz
2025-04-07 08:31:14,727 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR1725A.pkl.gz
2025-04-07 08:31:14,732 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2325A.pkl.gz
2025-04-07 08:31:14,737 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2625A.pkl.gz
2025-04-07 08:31:14,741 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR3125A.pkl.gz
2025-04-07 08:31:14,746 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/APR with cache=False
2025-04-07 08:31:14,803 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR0725A.pkl.gz
2025-04-07 08:31:14,809 update_archive_and_get_cmds_recent: Including loads MAR1025B, MAR1725A, MAR2325A, MAR2625A, MAR3125A, APR0725A
2025-04-07 08:31:14,813 update_archive_and_get_cmds_recent: Load MAR1025B has 2536 commands with RLTT=2025:068:17:45:00.000
2025-04-07 08:31:14,817 update_archive_and_get_cmds_recent: Load MAR1725A has 2442 commands with RLTT=2025:075:23:56:28.009
2025-04-07 08:31:14,820 update_archive_and_get_cmds_recent: Load MAR2325A has 2538 commands with RLTT=2025:082:02:14:59.000
2025-04-07 08:31:14,824 update_archive_and_get_cmds_recent: Load MAR2625A has 1617 commands with RLTT=2025:085:03:14:00.000
2025-04-07 08:31:14,828 update_archive_and_get_cmds_recent: Load MAR3125A has 2214 commands with RLTT=2025:089:21:13:00.000
2025-04-07 08:31:14,831 update_archive_and_get_cmds_recent: Load APR0725A has 1871 commands with RLTT=2025:097:00:25:37.986
2025-04-07 08:31:14,861 update_archive_and_get_cmds_recent: Including cmd_events:
SCS-107 at 2025:083:21:34:08.000
2025-04-07 08:31:14,867 update_archive_and_get_cmds_recent: Processing MAR1025B with 2536 commands
2025-04-07 08:31:14,867 update_archive_and_get_cmds_recent: Adding 2536 commands from MAR1025B
2025-04-07 08:31:14,867 update_archive_and_get_cmds_recent: Processing MAR1725A with 2442 commands
2025-04-07 08:31:14,868 update_archive_and_get_cmds_recent: Adding 2442 commands from MAR1725A
2025-04-07 08:31:14,868 update_archive_and_get_cmds_recent: Processing MAR2325A with 2538 commands
2025-04-07 08:31:14,868 update_archive_and_get_cmds_recent: Removing 322 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR1725A due to RLTT in MAR2325A
2025-04-07 08:31:14,869 update_archive_and_get_cmds_recent: Adding 2538 commands from MAR2325A
2025-04-07 08:31:14,869 update_archive_and_get_cmds_recent: Processing CMD_EVT SCS-107 at 2025:083:21:34:08.000 with 9 commands
2025-04-07 08:31:14,869 update_archive_and_get_cmds_recent: Removing 960 cmds in SCS slots [131, 132, 133] from MAR2325A due to DISABLE SCS in CMD_EVT at 2025:083:21:34:08.000
2025-04-07 08:31:14,869 update_archive_and_get_cmds_recent: Adding 9 commands from CMD_EVT SCS-107 at 2025:083:21:34:08.000
2025-04-07 08:31:14,869 update_archive_and_get_cmds_recent: Processing MAR2625A with 1617 commands
2025-04-07 08:31:14,870 update_archive_and_get_cmds_recent: Removing 812 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR2325A due to RLTT in MAR2625A
2025-04-07 08:31:14,871 update_archive_and_get_cmds_recent: Adding 1617 commands from MAR2625A
2025-04-07 08:31:14,871 update_archive_and_get_cmds_recent: Processing MAR3125A with 2214 commands
2025-04-07 08:31:14,871 update_archive_and_get_cmds_recent: Adding 2214 commands from MAR3125A
2025-04-07 08:31:14,871 update_archive_and_get_cmds_recent: Processing APR0725A with 1871 commands
2025-04-07 08:31:14,872 update_archive_and_get_cmds_recent: Adding 1871 commands from APR0725A
2025-04-07 08:31:15,241 load_pars_dict: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.pkl with 178804 pars
2025-04-07 08:31:15,266 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:15,268 get_cmds: Getting commands from 2025:076:12:31:09.741 to 2025:083:12:31:09.741 for scenario=None
2025-04-07 08:31:15,270 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:20,581 get_plot_figure: Compressing Telem data for state pitch
2025-04-07 08:31:22,794 get_plot_figure: Creating Telem scatter plot for state pitch
2025-04-07 08:31:22,917 get_plot_figure: Compressing State data for state pitch
2025-04-07 08:31:24,850 get_plot_figure: Creating State scatter plot for state pitch
2025-04-07 08:31:25,351 get_plot_html: Creating HTML for state pitch
2025-04-07 08:31:25,418 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:083:12:15:39.414 to 2025:097:12:46:39.414
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-07 08:31:25,598 tlm: Fetching telemetry for ['roll_comp'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for roll_comp between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:083:12:00:39.414 to 2025:097:13:01:39.414
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_data: Getting data for orbitephem0_x between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for orbitephem0_y between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for orbitephem0_z between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for solarephem0_x between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for solarephem0_y between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for solarephem0_z between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for aoattqt1 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for aoattqt2 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for aoattqt3 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
_get_data: Getting data for aoattqt4 between 2025:083:12:04:09.414 to 2025:097:12:58:09.414
fetch: Setting bads because of gaps in aoattqt1 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
fetch: Setting bads because of gaps in aoattqt2 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
fetch: Setting bads because of gaps in aoattqt3 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
fetch: Setting bads because of gaps in aoattqt4 between 2025:097:03:12:24.491 to 2025:097:12:58:08.666
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-04-07 08:31:26,950 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:26,950 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:083:12:31:09.741 - 2025:097:03:12:19.366
2025-04-07 08:31:26,951 get_cmds: Getting commands from 2025:083:12:31:09.741 to 2025:097:03:12:19.366 for scenario=None
2025-04-07 08:31:26,952 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:26,954 get_cmds: Getting commands from 2025:076:12:31:09.741 to 2025:083:12:31:09.741 for scenario=None
2025-04-07 08:31:26,956 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:31,266 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-04-07 08:31:33,367 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-04-07 08:31:33,392 get_plot_figure: Compressing State data for state off_nom_roll
2025-04-07 08:31:35,337 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-04-07 08:31:35,388 get_plot_html: Creating HTML for state off_nom_roll
2025-04-07 08:31:35,399 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:083:12:15:39.414 to 2025:097:12:46:39.414
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-07 08:31:35,568 get_cmds: Getting commands from 2025:083:12:11:09.414 to 2025:097:12:31:09.414 for scenario=None
2025-04-07 08:31:35,570 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:35,630 add_exclude_interval: dither: excluding interval 2025:084:20:34:59.000 - 2025:084:20:47:59.000: SRDC
2025-04-07 08:31:35,632 add_exclude_interval: dither: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-07 08:31:35,633 add_exclude_interval: dither: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-07 08:31:35,634 tlm: Fetching telemetry for ['aodithen'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for aodithen between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [776:142640]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-04-07 08:31:35,786 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:35,786 get_states: Getting commanded states ['dither'] between 2025:083:12:31:16.449 - 2025:097:03:12:16.862
2025-04-07 08:31:35,786 get_cmds: Getting commands from 2025:083:12:31:16.449 to 2025:097:03:12:16.862 for scenario=None
2025-04-07 08:31:35,787 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:35,789 get_cmds: Getting commands from 2025:076:12:31:16.449 to 2025:083:12:31:16.449 for scenario=None
2025-04-07 08:31:35,791 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:36,484 get_plot_figure: Compressing Telem data for state dither
2025-04-07 08:31:36,724 get_plot_figure: Creating Telem scatter plot for state dither
2025-04-07 08:31:36,726 get_plot_figure: Compressing State data for state dither
2025-04-07 08:31:36,968 get_plot_figure: Creating State scatter plot for state dither
2025-04-07 08:31:37,039 get_plot_html: Creating HTML for state dither
2025-04-07 08:31:37,043 run_validators: Validating pcad_mode
2025-04-07 08:31:37,054 get_cmds: Getting commands from 2025:083:12:11:09.414 to 2025:097:12:31:09.414 for scenario=None
2025-04-07 08:31:37,055 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:37,100 add_exclude_interval: pcad_mode: excluding interval 2025:084:20:34:59.000 - 2025:084:20:47:59.000: SRDC
2025-04-07 08:31:37,102 add_exclude_interval: pcad_mode: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-07 08:31:37,103 add_exclude_interval: pcad_mode: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-07 08:31:37,104 tlm: Fetching telemetry for ['aopcadmd'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for aopcadmd between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [6204:1141120]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-04-07 08:31:37,352 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:37,352 get_states: Getting commanded states ['pcad_mode'] between 2025:083:12:31:10.299 - 2025:097:03:12:19.937
2025-04-07 08:31:37,352 get_cmds: Getting commands from 2025:083:12:31:10.299 to 2025:097:03:12:19.937 for scenario=None
2025-04-07 08:31:37,354 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:37,356 get_cmds: Getting commands from 2025:076:12:31:10.299 to 2025:083:12:31:10.299 for scenario=None
2025-04-07 08:31:37,357 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:45,156 get_plot_figure: Compressing Telem data for state pcad_mode
2025-04-07 08:31:47,076 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-04-07 08:31:47,080 get_plot_figure: Compressing State data for state pcad_mode
2025-04-07 08:31:48,993 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-04-07 08:31:49,039 get_plot_html: Creating HTML for state pcad_mode
2025-04-07 08:31:49,055 run_validators: Validating simpos
2025-04-07 08:31:49,061 tlm: Fetching telemetry for ['3tscpos'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for 3tscpos between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [193:35584]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-04-07 08:31:49,300 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:49,301 get_states: Getting commanded states ['simpos'] between 2025:083:12:31:32.849 - 2025:097:03:11:52.774
2025-04-07 08:31:49,301 get_cmds: Getting commands from 2025:083:12:31:32.849 to 2025:097:03:11:52.774 for scenario=None
2025-04-07 08:31:49,302 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:49,304 get_cmds: Getting commands from 2025:076:12:31:32.849 to 2025:083:12:31:32.849 for scenario=None
2025-04-07 08:31:49,305 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:49,439 get_plot_figure: Compressing Telem data for state simpos
2025-04-07 08:31:49,499 get_plot_figure: Creating Telem scatter plot for state simpos
2025-04-07 08:31:49,503 get_plot_figure: Compressing State data for state simpos
2025-04-07 08:31:49,563 get_plot_figure: Creating State scatter plot for state simpos
2025-04-07 08:31:49,570 get_plot_html: Creating HTML for state simpos
2025-04-07 08:31:49,574 run_validators: Validating obsid
2025-04-07 08:31:49,580 tlm: Fetching telemetry for ['cobsrqid'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for cobsrqid between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [3102:570560]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-04-07 08:31:49,739 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:49,739 get_states: Getting commanded states ['obsid'] between 2025:083:12:31:10.299 - 2025:097:03:12:18.655
2025-04-07 08:31:49,740 get_cmds: Getting commands from 2025:083:12:31:10.299 to 2025:097:03:12:18.655 for scenario=None
2025-04-07 08:31:49,741 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:49,743 get_cmds: Getting commands from 2025:076:12:31:10.299 to 2025:083:12:31:10.299 for scenario=None
2025-04-07 08:31:49,744 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:51,819 get_plot_figure: Compressing Telem data for state obsid
2025-04-07 08:31:52,781 get_plot_figure: Creating Telem scatter plot for state obsid
2025-04-07 08:31:52,783 get_plot_figure: Compressing State data for state obsid
2025-04-07 08:31:53,740 get_plot_figure: Creating State scatter plot for state obsid
2025-04-07 08:31:53,755 get_plot_html: Creating HTML for state obsid
2025-04-07 08:31:53,767 run_validators: Validating letg
2025-04-07 08:31:53,774 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for 4ootgsel between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [194:35660]
_get_data: Getting data for 4ootgmtn between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Using times_cache for tel2eng 859205838.598 to 860417238.5979997
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [194:35660]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-07 08:31:54,647 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:54,647 get_states: Getting commanded states ['letg'] between 2025:083:12:31:32.849 - 2025:097:03:12:14.555
2025-04-07 08:31:54,647 get_cmds: Getting commands from 2025:083:12:31:32.849 to 2025:097:03:12:14.555 for scenario=None
2025-04-07 08:31:54,648 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:54,650 get_cmds: Getting commands from 2025:076:12:31:32.849 to 2025:083:12:31:32.849 for scenario=None
2025-04-07 08:31:54,652 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:54,862 get_plot_figure: Compressing Telem data for state letg
2025-04-07 08:31:54,924 get_plot_figure: Creating Telem scatter plot for state letg
2025-04-07 08:31:54,925 get_plot_figure: Compressing State data for state letg
2025-04-07 08:31:54,986 get_plot_figure: Creating State scatter plot for state letg
2025-04-07 08:31:54,993 get_plot_html: Creating HTML for state letg
2025-04-07 08:31:54,996 run_validators: Validating hetg
2025-04-07 08:31:55,002 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for 4ootgsel between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_data: Getting data for 4ootgmtn between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-07 08:31:55,016 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:55,016 get_states: Getting commanded states ['hetg'] between 2025:083:12:31:32.849 - 2025:097:03:12:14.555
2025-04-07 08:31:55,016 get_cmds: Getting commands from 2025:083:12:31:32.849 to 2025:097:03:12:14.555 for scenario=None
2025-04-07 08:31:55,017 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:55,019 get_cmds: Getting commands from 2025:076:12:31:32.849 to 2025:083:12:31:32.849 for scenario=None
2025-04-07 08:31:55,020 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:55,230 get_plot_figure: Compressing Telem data for state hetg
2025-04-07 08:31:55,290 get_plot_figure: Creating Telem scatter plot for state hetg
2025-04-07 08:31:55,292 get_plot_figure: Compressing State data for state hetg
2025-04-07 08:31:55,352 get_plot_figure: Creating State scatter plot for state hetg
2025-04-07 08:31:55,360 get_plot_html: Creating HTML for state hetg
2025-04-07 08:31:55,363 run_validators: Validating sun_pos_mon
2025-04-07 08:31:55,370 tlm: Fetching telemetry for ['aopssupm'] between 2025:083:12:31:09.414 and 2025:097:12:31:09.414
_get_data: Getting data for aopssupm between 2025:083:12:16:09.414 to 2025:097:12:46:09.414
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [776:142640]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-04-07 08:31:55,592 get_states: Using kadi.commands.states to get cmd_states
2025-04-07 08:31:55,592 get_states: Getting commanded states ['sun_pos_mon'] between 2025:083:12:31:16.449 - 2025:097:03:12:14.043
2025-04-07 08:31:55,592 get_cmds: Getting commands from 2025:083:12:31:16.449 to 2025:097:03:12:14.043 for scenario=None
2025-04-07 08:31:55,593 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:55,595 get_cmds: Getting commands from 2025:076:12:31:16.449 to 2025:083:12:31:16.449 for scenario=None
2025-04-07 08:31:55,597 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-07 08:31:55,609 get_cmds: Getting commands from 2025:053:12:31:16.449 to 2025:083:12:31:16.449 for scenario=None
2025-04-07 08:31:55,611 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:053:12:31:16.449
2025-04-07 08:31:57,209 load_idx_cmds: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.h5 with 1694988 commands
2025-04-07 08:31:57,217 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-04-07 08:31:57,624 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-04-07 08:31:57,625 get_matching_block_idx: Match(a=1, b=0, size=38)
2025-04-07 08:31:57,625 get_matching_block_idx: Match(a=40, b=38, size=11293)
2025-04-07 08:31:57,625 get_matching_block_idx: Match(a=11333, b=11331, size=0)
2025-04-07 08:31:57,625 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-04-07 08:31:57,625 get_matching_block_idx: ('delete', 0, 1, 0, 0)
2025-04-07 08:31:57,625 get_matching_block_idx: ('equal', 1, 39, 0, 38)
2025-04-07 08:31:57,625 get_matching_block_idx: ('delete', 39, 40, 38, 38)
2025-04-07 08:31:57,625 get_matching_block_idx: ('equal', 40, 11333, 38, 11331)
2025-04-07 08:31:57,629 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-07 08:31:58,451 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-04-07 08:31:58,687 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-04-07 08:31:58,690 get_plot_figure: Compressing State data for state sun_pos_mon
2025-04-07 08:31:58,925 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-04-07 08:31:58,939 get_plot_html: Creating HTML for state sun_pos_mon
2025-04-08 08:31:08,601 run_validators: Validating pitch
2025-04-08 08:31:08,602 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:084:12:15:38.601 to 2025:098:12:46:38.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4226:1149792]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-08 08:31:09,690 tlm: Fetching telemetry for ['pitch_comp'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for pitch_comp between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:084:12:00:38.601 to 2025:098:13:01:38.601
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 859291307.7850001 to 860504567.7850001
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3348:1149792]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4255:1149792]
_get_data: Getting data for orbitephem0_x between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [4609:8651]
_get_data: Getting data for orbitephem0_y between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859291517.785 to 860504357.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [4609:8651]
_get_data: Getting data for orbitephem0_z between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859291517.785 to 860504357.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [4609:8651]
_get_data: Getting data for solarephem0_x between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [4609:8651]
_get_data: Getting data for solarephem0_y between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Using times_cache for solarephem0 859291517.785 to 860504357.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [4609:8651]
_get_data: Getting data for solarephem0_z between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Using times_cache for solarephem0 859291517.785 to 860504357.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [4609:8651]
_get_data: Getting data for aoattqt1 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [3553:1149792]
_get_data: Getting data for aoattqt2 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859291517.785 to 860504357.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [3553:1149792]
_get_data: Getting data for aoattqt3 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859291517.785 to 860504357.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [3553:1149792]
_get_data: Getting data for aoattqt4 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859291517.785 to 860504357.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [3553:1149792]
fetch: Setting bads because of gaps in aoattqt1 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
fetch: Setting bads because of gaps in aoattqt2 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
fetch: Setting bads because of gaps in aoattqt3 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
fetch: Setting bads because of gaps in aoattqt4 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-04-08 08:31:13,141 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:13,141 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:084:12:31:09.041 - 2025:098:02:41:42.891
2025-04-08 08:31:13,141 get_cmds: Getting commands from 2025:084:12:31:09.041 to 2025:098:02:41:42.891 for scenario=None
2025-04-08 08:31:13,142 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:13,143 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-04-08 08:31:13,143 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-04-08 08:31:13,487 get_cmd_events_from_sheet: Writing 151 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-04-08 08:31:13,497 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR with cache=False
2025-04-08 08:31:13,647 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR1025B.pkl.gz
2025-04-08 08:31:13,653 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR1725A.pkl.gz
2025-04-08 08:31:13,659 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2325A.pkl.gz
2025-04-08 08:31:13,664 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2625A.pkl.gz
2025-04-08 08:31:13,668 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR3125A.pkl.gz
2025-04-08 08:31:13,673 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/APR with cache=False
2025-04-08 08:31:13,733 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR0725A.pkl.gz
2025-04-08 08:31:13,739 update_cmd_events_and_loads_and_get_cmds_recent: Including loads MAR1025B, MAR1725A, MAR2325A, MAR2625A, MAR3125A, APR0725A
2025-04-08 08:31:13,743 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR1025B has 2536 commands with RLTT=2025:068:17:45:00.000
2025-04-08 08:31:13,747 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR1725A has 2442 commands with RLTT=2025:075:23:56:28.009
2025-04-08 08:31:13,751 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR2325A has 2538 commands with RLTT=2025:082:02:14:59.000
2025-04-08 08:31:13,754 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR2625A has 1617 commands with RLTT=2025:085:03:14:00.000
2025-04-08 08:31:13,758 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR3125A has 2214 commands with RLTT=2025:089:21:13:00.000
2025-04-08 08:31:13,762 update_cmd_events_and_loads_and_get_cmds_recent: Load APR0725A has 1871 commands with RLTT=2025:097:00:25:37.986
2025-04-08 08:31:13,793 update_cmd_events_and_loads_and_get_cmds_recent: Including cmd_events:
SCS-107 at 2025:083:21:34:08.000
2025-04-08 08:31:13,803 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR1025B with 2536 commands
2025-04-08 08:31:13,803 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2536 commands from MAR1025B
2025-04-08 08:31:13,803 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR1725A with 2442 commands
2025-04-08 08:31:13,804 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2442 commands from MAR1725A
2025-04-08 08:31:13,804 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR2325A with 2538 commands
2025-04-08 08:31:13,804 update_cmd_events_and_loads_and_get_cmds_recent: Removing 322 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR1725A due to RLTT in MAR2325A
2025-04-08 08:31:13,805 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2538 commands from MAR2325A
2025-04-08 08:31:13,805 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT SCS-107 at 2025:083:21:34:08.000 with 16 commands
2025-04-08 08:31:13,805 update_cmd_events_and_loads_and_get_cmds_recent: Removing 960 cmds in SCS slots [131, 132, 133] from MAR2325A due to DISABLE SCS in CMD_EVT at 2025:083:21:34:08.000
2025-04-08 08:31:13,805 update_cmd_events_and_loads_and_get_cmds_recent: Adding 16 commands from CMD_EVT SCS-107 at 2025:083:21:34:08.000
2025-04-08 08:31:13,805 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR2625A with 1617 commands
2025-04-08 08:31:13,806 update_cmd_events_and_loads_and_get_cmds_recent: Removing 812 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR2325A due to RLTT in MAR2625A
2025-04-08 08:31:13,807 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1617 commands from MAR2625A
2025-04-08 08:31:13,807 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR3125A with 2214 commands
2025-04-08 08:31:13,807 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2214 commands from MAR3125A
2025-04-08 08:31:13,808 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR0725A with 1871 commands
2025-04-08 08:31:13,808 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1871 commands from APR0725A
2025-04-08 08:31:14,194 load_pars_dict: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.pkl with 178804 pars
2025-04-08 08:31:14,220 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:14,222 get_cmds: Getting commands from 2025:077:12:31:09.041 to 2025:084:12:31:09.041 for scenario=None
2025-04-08 08:31:14,223 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:14,223 get_cmds: Getting recent commands from cache
2025-04-08 08:31:14,224 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:19,211 get_plot_figure: Compressing Telem data for state pitch
2025-04-08 08:31:21,448 get_plot_figure: Creating Telem scatter plot for state pitch
2025-04-08 08:31:21,517 get_plot_figure: Compressing State data for state pitch
2025-04-08 08:31:23,452 get_plot_figure: Creating State scatter plot for state pitch
2025-04-08 08:31:23,732 get_plot_html: Creating HTML for state pitch
2025-04-08 08:31:23,761 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:084:12:15:38.601 to 2025:098:12:46:38.601
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-08 08:31:23,946 tlm: Fetching telemetry for ['roll_comp'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for roll_comp between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:084:12:00:38.601 to 2025:098:13:01:38.601
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_data: Getting data for orbitephem0_x between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for orbitephem0_y between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for orbitephem0_z between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for solarephem0_x between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for solarephem0_y between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for solarephem0_z between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for aoattqt1 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for aoattqt2 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for aoattqt3 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
_get_data: Getting data for aoattqt4 between 2025:084:12:04:08.601 to 2025:098:12:58:08.601
fetch: Setting bads because of gaps in aoattqt1 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
fetch: Setting bads because of gaps in aoattqt2 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
fetch: Setting bads because of gaps in aoattqt3 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
fetch: Setting bads because of gaps in aoattqt4 between 2025:098:02:41:48.016 to 2025:098:12:58:07.966
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-04-08 08:31:25,794 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:25,794 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:084:12:31:09.041 - 2025:098:02:41:42.891
2025-04-08 08:31:25,794 get_cmds: Getting commands from 2025:084:12:31:09.041 to 2025:098:02:41:42.891 for scenario=None
2025-04-08 08:31:25,794 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:25,795 get_cmds: Getting recent commands from cache
2025-04-08 08:31:25,796 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:25,798 get_cmds: Getting commands from 2025:077:12:31:09.041 to 2025:084:12:31:09.041 for scenario=None
2025-04-08 08:31:25,799 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:25,799 get_cmds: Getting recent commands from cache
2025-04-08 08:31:25,800 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:29,991 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-04-08 08:31:32,058 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-04-08 08:31:32,081 get_plot_figure: Compressing State data for state off_nom_roll
2025-04-08 08:31:34,012 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-04-08 08:31:34,068 get_plot_html: Creating HTML for state off_nom_roll
2025-04-08 08:31:34,079 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:084:12:15:38.601 to 2025:098:12:46:38.601
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-08 08:31:34,250 get_cmds: Getting commands from 2025:084:12:11:08.601 to 2025:098:12:31:08.601 for scenario=None
2025-04-08 08:31:34,250 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:34,251 get_cmds: Getting recent commands from cache
2025-04-08 08:31:34,251 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:34,316 add_exclude_interval: dither: excluding interval 2025:084:20:34:59.000 - 2025:084:20:47:59.000: SRDC
2025-04-08 08:31:34,317 add_exclude_interval: dither: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-08 08:31:34,318 add_exclude_interval: dither: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-08 08:31:34,320 add_exclude_interval: dither: excluding interval 2025:098:01:58:28.000 - 2025:098:02:11:28.000: SRDC
2025-04-08 08:31:34,320 tlm: Fetching telemetry for ['aodithen'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for aodithen between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [532:143724]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-04-08 08:31:34,454 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:34,454 get_states: Getting commanded states ['dither'] between 2025:084:12:31:11.655 - 2025:098:02:41:43.112
2025-04-08 08:31:34,455 get_cmds: Getting commands from 2025:084:12:31:11.655 to 2025:098:02:41:43.112 for scenario=None
2025-04-08 08:31:34,455 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:34,455 get_cmds: Getting recent commands from cache
2025-04-08 08:31:34,456 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:34,458 get_cmds: Getting commands from 2025:077:12:31:11.655 to 2025:084:12:31:11.655 for scenario=None
2025-04-08 08:31:34,458 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:34,459 get_cmds: Getting recent commands from cache
2025-04-08 08:31:34,459 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:35,140 get_plot_figure: Compressing Telem data for state dither
2025-04-08 08:31:35,389 get_plot_figure: Creating Telem scatter plot for state dither
2025-04-08 08:31:35,391 get_plot_figure: Compressing State data for state dither
2025-04-08 08:31:35,624 get_plot_figure: Creating State scatter plot for state dither
2025-04-08 08:31:35,736 get_plot_html: Creating HTML for state dither
2025-04-08 08:31:35,740 run_validators: Validating pcad_mode
2025-04-08 08:31:35,751 get_cmds: Getting commands from 2025:084:12:11:08.601 to 2025:098:12:31:08.601 for scenario=None
2025-04-08 08:31:35,751 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:35,752 get_cmds: Getting recent commands from cache
2025-04-08 08:31:35,752 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:35,815 add_exclude_interval: pcad_mode: excluding interval 2025:084:20:34:59.000 - 2025:084:20:47:59.000: SRDC
2025-04-08 08:31:35,816 add_exclude_interval: pcad_mode: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-08 08:31:35,817 add_exclude_interval: pcad_mode: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-08 08:31:35,819 add_exclude_interval: pcad_mode: excluding interval 2025:098:01:58:28.000 - 2025:098:02:11:28.000: SRDC
2025-04-08 08:31:35,819 tlm: Fetching telemetry for ['aopcadmd'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for aopcadmd between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [4255:1149792]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-04-08 08:31:36,031 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:36,031 get_states: Getting commanded states ['pcad_mode'] between 2025:084:12:31:09.605 - 2025:098:02:41:44.137
2025-04-08 08:31:36,031 get_cmds: Getting commands from 2025:084:12:31:09.605 to 2025:098:02:41:44.137 for scenario=None
2025-04-08 08:31:36,032 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:36,032 get_cmds: Getting recent commands from cache
2025-04-08 08:31:36,033 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:36,035 get_cmds: Getting commands from 2025:077:12:31:09.605 to 2025:084:12:31:09.605 for scenario=None
2025-04-08 08:31:36,035 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:36,036 get_cmds: Getting recent commands from cache
2025-04-08 08:31:36,037 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:44,036 get_plot_figure: Compressing Telem data for state pcad_mode
2025-04-08 08:31:45,946 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-04-08 08:31:45,950 get_plot_figure: Compressing State data for state pcad_mode
2025-04-08 08:31:47,840 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-04-08 08:31:47,892 get_plot_html: Creating HTML for state pcad_mode
2025-04-08 08:31:47,897 run_validators: Validating simpos
2025-04-08 08:31:47,903 tlm: Fetching telemetry for ['3tscpos'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for 3tscpos between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [132:35852]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-04-08 08:31:48,022 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:48,022 get_states: Getting commanded states ['simpos'] between 2025:084:12:31:28.055 - 2025:098:02:41:43.625
2025-04-08 08:31:48,022 get_cmds: Getting commands from 2025:084:12:31:28.055 to 2025:098:02:41:43.625 for scenario=None
2025-04-08 08:31:48,022 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:48,023 get_cmds: Getting recent commands from cache
2025-04-08 08:31:48,024 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:48,026 get_cmds: Getting commands from 2025:077:12:31:28.055 to 2025:084:12:31:28.055 for scenario=None
2025-04-08 08:31:48,026 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:48,027 get_cmds: Getting recent commands from cache
2025-04-08 08:31:48,027 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:48,154 get_plot_figure: Compressing Telem data for state simpos
2025-04-08 08:31:48,215 get_plot_figure: Creating Telem scatter plot for state simpos
2025-04-08 08:31:48,218 get_plot_figure: Compressing State data for state simpos
2025-04-08 08:31:48,277 get_plot_figure: Creating State scatter plot for state simpos
2025-04-08 08:31:48,285 get_plot_html: Creating HTML for state simpos
2025-04-08 08:31:48,289 run_validators: Validating obsid
2025-04-08 08:31:48,295 tlm: Fetching telemetry for ['cobsrqid'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for cobsrqid between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [2128:574896]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-04-08 08:31:48,481 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:48,482 get_states: Getting commanded states ['obsid'] between 2025:084:12:31:09.605 - 2025:098:02:41:42.856
2025-04-08 08:31:48,482 get_cmds: Getting commands from 2025:084:12:31:09.605 to 2025:098:02:41:42.856 for scenario=None
2025-04-08 08:31:48,482 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:48,483 get_cmds: Getting recent commands from cache
2025-04-08 08:31:48,485 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:48,487 get_cmds: Getting commands from 2025:077:12:31:09.605 to 2025:084:12:31:09.605 for scenario=None
2025-04-08 08:31:48,488 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:48,489 get_cmds: Getting recent commands from cache
2025-04-08 08:31:48,490 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:50,500 get_plot_figure: Compressing Telem data for state obsid
2025-04-08 08:31:51,445 get_plot_figure: Creating Telem scatter plot for state obsid
2025-04-08 08:31:51,448 get_plot_figure: Compressing State data for state obsid
2025-04-08 08:31:52,391 get_plot_figure: Creating State scatter plot for state obsid
2025-04-08 08:31:52,406 get_plot_html: Creating HTML for state obsid
2025-04-08 08:31:52,410 run_validators: Validating letg
2025-04-08 08:31:52,417 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for 4ootgsel between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [133:35931]
_get_data: Getting data for 4ootgmtn between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Using times_cache for tel2eng 859292237.785 to 860503637.785
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [133:35931]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-08 08:31:52,695 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:52,695 get_states: Getting commanded states ['letg'] between 2025:084:12:31:28.055 - 2025:098:02:41:32.606
2025-04-08 08:31:52,695 get_cmds: Getting commands from 2025:084:12:31:28.055 to 2025:098:02:41:32.606 for scenario=None
2025-04-08 08:31:52,695 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:52,696 get_cmds: Getting recent commands from cache
2025-04-08 08:31:52,696 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:52,698 get_cmds: Getting commands from 2025:077:12:31:28.055 to 2025:084:12:31:28.055 for scenario=None
2025-04-08 08:31:52,699 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:52,699 get_cmds: Getting recent commands from cache
2025-04-08 08:31:52,700 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:52,909 get_plot_figure: Compressing Telem data for state letg
2025-04-08 08:31:52,970 get_plot_figure: Creating Telem scatter plot for state letg
2025-04-08 08:31:52,971 get_plot_figure: Compressing State data for state letg
2025-04-08 08:31:53,030 get_plot_figure: Creating State scatter plot for state letg
2025-04-08 08:31:53,038 get_plot_html: Creating HTML for state letg
2025-04-08 08:31:53,042 run_validators: Validating hetg
2025-04-08 08:31:53,048 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for 4ootgsel between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_data: Getting data for 4ootgmtn between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-08 08:31:53,060 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:53,061 get_states: Getting commanded states ['hetg'] between 2025:084:12:31:28.055 - 2025:098:02:41:32.606
2025-04-08 08:31:53,061 get_cmds: Getting commands from 2025:084:12:31:28.055 to 2025:098:02:41:32.606 for scenario=None
2025-04-08 08:31:53,061 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:53,061 get_cmds: Getting recent commands from cache
2025-04-08 08:31:53,062 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:53,064 get_cmds: Getting commands from 2025:077:12:31:28.055 to 2025:084:12:31:28.055 for scenario=None
2025-04-08 08:31:53,064 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:53,065 get_cmds: Getting recent commands from cache
2025-04-08 08:31:53,065 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:53,272 get_plot_figure: Compressing Telem data for state hetg
2025-04-08 08:31:53,331 get_plot_figure: Creating Telem scatter plot for state hetg
2025-04-08 08:31:53,333 get_plot_figure: Compressing State data for state hetg
2025-04-08 08:31:53,392 get_plot_figure: Creating State scatter plot for state hetg
2025-04-08 08:31:53,400 get_plot_html: Creating HTML for state hetg
2025-04-08 08:31:53,403 run_validators: Validating sun_pos_mon
2025-04-08 08:31:53,411 tlm: Fetching telemetry for ['aopssupm'] between 2025:084:12:31:08.601 and 2025:098:12:31:08.601
_get_data: Getting data for aopssupm between 2025:084:12:16:08.601 to 2025:098:12:46:08.601
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [532:143724]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-04-08 08:31:53,582 get_states: Using kadi.commands.states to get cmd_states
2025-04-08 08:31:53,583 get_states: Getting commanded states ['sun_pos_mon'] between 2025:084:12:31:11.655 - 2025:098:02:41:40.294
2025-04-08 08:31:53,583 get_cmds: Getting commands from 2025:084:12:31:11.655 to 2025:098:02:41:40.294 for scenario=None
2025-04-08 08:31:53,583 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:53,584 get_cmds: Getting recent commands from cache
2025-04-08 08:31:53,584 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:53,586 get_cmds: Getting commands from 2025:077:12:31:11.655 to 2025:084:12:31:11.655 for scenario=None
2025-04-08 08:31:53,587 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:53,587 get_cmds: Getting recent commands from cache
2025-04-08 08:31:53,588 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-08 08:31:53,601 get_cmds: Getting commands from 2025:054:12:31:11.655 to 2025:084:12:31:11.655 for scenario=None
2025-04-08 08:31:53,601 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-08 08:31:53,602 get_cmds: Getting recent commands from cache
2025-04-08 08:31:53,603 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:054:12:31:11.655
2025-04-08 08:31:55,156 load_idx_cmds: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.h5 with 1694995 commands
2025-04-08 08:31:55,164 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-04-08 08:31:55,570 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-04-08 08:31:55,570 get_matching_block_idx: Match(a=1, b=0, size=38)
2025-04-08 08:31:55,570 get_matching_block_idx: Match(a=40, b=38, size=11300)
2025-04-08 08:31:55,570 get_matching_block_idx: Match(a=11340, b=11338, size=0)
2025-04-08 08:31:55,570 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-04-08 08:31:55,570 get_matching_block_idx: ('delete', 0, 1, 0, 0)
2025-04-08 08:31:55,571 get_matching_block_idx: ('equal', 1, 39, 0, 38)
2025-04-08 08:31:55,571 get_matching_block_idx: ('delete', 39, 40, 38, 38)
2025-04-08 08:31:55,571 get_matching_block_idx: ('equal', 40, 11340, 38, 11338)
2025-04-08 08:31:55,575 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-08 08:31:56,390 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-04-08 08:31:56,624 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-04-08 08:31:56,627 get_plot_figure: Compressing State data for state sun_pos_mon
2025-04-08 08:31:56,860 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-04-08 08:31:56,874 get_plot_html: Creating HTML for state sun_pos_mon
2025-04-09 08:31:13,868 run_validators: Validating pitch
2025-04-09 08:31:13,869 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:085:12:15:43.868 to 2025:099:12:46:43.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [5676:1110656]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-09 08:31:16,016 tlm: Fetching telemetry for ['pitch_comp'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for pitch_comp between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:085:12:00:43.868 to 2025:099:13:01:43.868
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 859377713.0519998 to 860590973.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4798:1110656]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [5705:1110656]
_get_data: Getting data for orbitephem0_x between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [4897:8939]
_get_data: Getting data for orbitephem0_y between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859377923.0519997 to 860590763.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [4897:8939]
_get_data: Getting data for orbitephem0_z between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859377923.0519997 to 860590763.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [4897:8939]
_get_data: Getting data for solarephem0_x between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [4897:8939]
_get_data: Getting data for solarephem0_y between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Using times_cache for solarephem0 859377923.0519997 to 860590763.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [4897:8939]
_get_data: Getting data for solarephem0_z between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Using times_cache for solarephem0 859377923.0519997 to 860590763.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [4897:8939]
_get_data: Getting data for aoattqt1 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [5003:1110656]
_get_data: Getting data for aoattqt2 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859377923.0519997 to 860590763.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [5003:1110656]
_get_data: Getting data for aoattqt3 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859377923.0519997 to 860590763.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [5003:1110656]
_get_data: Getting data for aoattqt4 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859377923.0519997 to 860590763.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [5003:1110656]
fetch: Setting bads because of gaps in aoattqt1 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
fetch: Setting bads because of gaps in aoattqt2 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
fetch: Setting bads because of gaps in aoattqt3 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
fetch: Setting bads because of gaps in aoattqt4 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-04-09 08:31:21,005 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:31:21,005 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:085:12:31:14.491 - 2025:099:11:10:10.291
2025-04-09 08:31:21,006 get_cmds: Getting commands from 2025:085:12:31:14.491 to 2025:099:11:10:10.291 for scenario=None
2025-04-09 08:31:21,006 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:21,007 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-04-09 08:31:21,007 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-04-09 08:31:21,335 get_cmd_events_from_sheet: Writing 151 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-04-09 08:31:21,363 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR with cache=False
2025-04-09 08:31:21,935 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR1725A.pkl.gz
2025-04-09 08:31:21,949 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2325A.pkl.gz
2025-04-09 08:31:21,967 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2625A.pkl.gz
2025-04-09 08:31:21,974 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR3125A.pkl.gz
2025-04-09 08:31:21,980 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/APR with cache=False
2025-04-09 08:31:22,042 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR0725A.pkl.gz
2025-04-09 08:31:22,049 update_cmd_events_and_loads_and_get_cmds_recent: Including loads MAR1725A, MAR2325A, MAR2625A, MAR3125A, APR0725A
2025-04-09 08:31:22,053 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR1725A has 2442 commands with RLTT=2025:075:23:56:28.009
2025-04-09 08:31:22,056 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR2325A has 2538 commands with RLTT=2025:082:02:14:59.000
2025-04-09 08:31:22,060 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR2625A has 1617 commands with RLTT=2025:085:03:14:00.000
2025-04-09 08:31:22,064 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR3125A has 2214 commands with RLTT=2025:089:21:13:00.000
2025-04-09 08:31:22,070 update_cmd_events_and_loads_and_get_cmds_recent: Load APR0725A has 1871 commands with RLTT=2025:097:00:25:37.986
2025-04-09 08:31:22,100 update_cmd_events_and_loads_and_get_cmds_recent: Including cmd_events:
SCS-107 at 2025:083:21:34:08.000
2025-04-09 08:31:22,111 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR1725A with 2442 commands
2025-04-09 08:31:22,111 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2442 commands from MAR1725A
2025-04-09 08:31:22,111 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR2325A with 2538 commands
2025-04-09 08:31:22,112 update_cmd_events_and_loads_and_get_cmds_recent: Removing 322 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR1725A due to RLTT in MAR2325A
2025-04-09 08:31:22,112 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2538 commands from MAR2325A
2025-04-09 08:31:22,112 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT SCS-107 at 2025:083:21:34:08.000 with 16 commands
2025-04-09 08:31:22,112 update_cmd_events_and_loads_and_get_cmds_recent: Removing 960 cmds in SCS slots [131, 132, 133] from MAR2325A due to DISABLE SCS in CMD_EVT at 2025:083:21:34:08.000
2025-04-09 08:31:22,113 update_cmd_events_and_loads_and_get_cmds_recent: Adding 16 commands from CMD_EVT SCS-107 at 2025:083:21:34:08.000
2025-04-09 08:31:22,113 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR2625A with 1617 commands
2025-04-09 08:31:22,113 update_cmd_events_and_loads_and_get_cmds_recent: Removing 812 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR2325A due to RLTT in MAR2625A
2025-04-09 08:31:22,114 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1617 commands from MAR2625A
2025-04-09 08:31:22,114 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR3125A with 2214 commands
2025-04-09 08:31:22,115 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2214 commands from MAR3125A
2025-04-09 08:31:22,115 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR0725A with 1871 commands
2025-04-09 08:31:22,115 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1871 commands from APR0725A
2025-04-09 08:31:22,477 load_pars_dict: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.pkl with 178804 pars
2025-04-09 08:31:22,517 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:31:22,520 get_cmds: Getting commands from 2025:078:12:31:14.491 to 2025:085:12:31:14.491 for scenario=None
2025-04-09 08:31:22,520 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:22,521 get_cmds: Getting recent commands from cache
2025-04-09 08:31:22,521 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:14.491
2025-04-09 08:31:25,523 load_idx_cmds: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.h5 with 1694995 commands
2025-04-09 08:31:25,530 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-04-09 08:31:26,079 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-04-09 08:31:26,080 get_matching_block_idx: Match(a=0, b=0, size=1)
2025-04-09 08:31:26,080 get_matching_block_idx: Match(a=4, b=1, size=14)
2025-04-09 08:31:26,080 get_matching_block_idx: Match(a=19, b=15, size=18)
2025-04-09 08:31:26,080 get_matching_block_idx: Match(a=38, b=34, size=8712)
2025-04-09 08:31:26,080 get_matching_block_idx: Match(a=8750, b=8746, size=0)
2025-04-09 08:31:26,080 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-04-09 08:31:26,080 get_matching_block_idx: ('equal', 0, 1, 0, 1)
2025-04-09 08:31:26,080 get_matching_block_idx: ('delete', 1, 4, 1, 1)
2025-04-09 08:31:26,080 get_matching_block_idx: ('equal', 4, 18, 1, 15)
2025-04-09 08:31:26,080 get_matching_block_idx: ('delete', 18, 19, 15, 15)
2025-04-09 08:31:26,080 get_matching_block_idx: ('equal', 19, 37, 15, 33)
2025-04-09 08:31:26,080 get_matching_block_idx: ('replace', 37, 38, 33, 34)
2025-04-09 08:31:26,080 get_matching_block_idx: ('equal', 38, 8750, 34, 8746)
2025-04-09 08:31:26,087 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:31:31,128 get_plot_figure: Compressing Telem data for state pitch
2025-04-09 08:31:33,590 get_plot_figure: Creating Telem scatter plot for state pitch
2025-04-09 08:31:33,698 get_plot_figure: Compressing State data for state pitch
2025-04-09 08:31:35,996 get_plot_figure: Creating State scatter plot for state pitch
2025-04-09 08:31:36,332 get_plot_html: Creating HTML for state pitch
2025-04-09 08:31:36,411 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:085:12:15:43.868 to 2025:099:12:46:43.868
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-09 08:31:36,713 tlm: Fetching telemetry for ['roll_comp'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for roll_comp between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:085:12:00:43.868 to 2025:099:13:01:43.868
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_data: Getting data for orbitephem0_x between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for orbitephem0_y between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for orbitephem0_z between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for solarephem0_x between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for solarephem0_y between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for solarephem0_z between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for aoattqt1 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for aoattqt2 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for aoattqt3 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
_get_data: Getting data for aoattqt4 between 2025:085:12:04:13.868 to 2025:099:12:58:13.868
fetch: Setting bads because of gaps in aoattqt1 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
fetch: Setting bads because of gaps in aoattqt2 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
fetch: Setting bads because of gaps in aoattqt3 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
fetch: Setting bads because of gaps in aoattqt4 between 2025:099:11:10:15.416 to 2025:099:12:58:13.416
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-04-09 08:31:38,189 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:31:38,189 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:085:12:31:14.491 - 2025:099:11:10:10.291
2025-04-09 08:31:38,190 get_cmds: Getting commands from 2025:085:12:31:14.491 to 2025:099:11:10:10.291 for scenario=None
2025-04-09 08:31:38,190 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:38,191 get_cmds: Getting recent commands from cache
2025-04-09 08:31:38,191 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:31:38,194 get_cmds: Getting commands from 2025:078:12:31:14.491 to 2025:085:12:31:14.491 for scenario=None
2025-04-09 08:31:38,194 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:38,195 get_cmds: Getting recent commands from cache
2025-04-09 08:31:38,195 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:14.491
2025-04-09 08:31:38,197 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:31:42,637 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-04-09 08:31:45,049 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-04-09 08:31:45,074 get_plot_figure: Compressing State data for state off_nom_roll
2025-04-09 08:31:47,361 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-04-09 08:31:47,410 get_plot_html: Creating HTML for state off_nom_roll
2025-04-09 08:31:47,421 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:085:12:15:43.868 to 2025:099:12:46:43.868
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-09 08:31:47,679 get_cmds: Getting commands from 2025:085:12:11:13.868 to 2025:099:12:31:13.868 for scenario=None
2025-04-09 08:31:47,679 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:47,680 get_cmds: Getting recent commands from cache
2025-04-09 08:31:47,681 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:31:47,746 add_exclude_interval: dither: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-09 08:31:47,748 add_exclude_interval: dither: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-09 08:31:47,749 add_exclude_interval: dither: excluding interval 2025:098:01:58:28.000 - 2025:098:02:11:28.000: SRDC
2025-04-09 08:31:47,750 tlm: Fetching telemetry for ['aodithen'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for aodithen between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [714:138832]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-04-09 08:31:47,983 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:31:47,983 get_states: Getting commanded states ['dither'] between 2025:085:12:31:15.061 - 2025:099:11:10:10.904
2025-04-09 08:31:47,984 get_cmds: Getting commands from 2025:085:12:31:15.061 to 2025:099:11:10:10.904 for scenario=None
2025-04-09 08:31:47,984 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:47,985 get_cmds: Getting recent commands from cache
2025-04-09 08:31:47,985 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:31:47,987 get_cmds: Getting commands from 2025:078:12:31:15.061 to 2025:085:12:31:15.061 for scenario=None
2025-04-09 08:31:47,987 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:47,988 get_cmds: Getting recent commands from cache
2025-04-09 08:31:47,989 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:15.061
2025-04-09 08:31:47,990 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:31:48,705 get_plot_figure: Compressing Telem data for state dither
2025-04-09 08:31:48,990 get_plot_figure: Creating Telem scatter plot for state dither
2025-04-09 08:31:48,991 get_plot_figure: Compressing State data for state dither
2025-04-09 08:31:49,273 get_plot_figure: Creating State scatter plot for state dither
2025-04-09 08:31:49,408 get_plot_html: Creating HTML for state dither
2025-04-09 08:31:49,412 run_validators: Validating pcad_mode
2025-04-09 08:31:49,424 get_cmds: Getting commands from 2025:085:12:11:13.868 to 2025:099:12:31:13.868 for scenario=None
2025-04-09 08:31:49,424 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:49,424 get_cmds: Getting recent commands from cache
2025-04-09 08:31:49,425 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:31:49,470 add_exclude_interval: pcad_mode: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-09 08:31:49,472 add_exclude_interval: pcad_mode: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-09 08:31:49,473 add_exclude_interval: pcad_mode: excluding interval 2025:098:01:58:28.000 - 2025:098:02:11:28.000: SRDC
2025-04-09 08:31:49,474 tlm: Fetching telemetry for ['aopcadmd'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for aopcadmd between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [5705:1110656]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-04-09 08:31:49,762 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:31:49,762 get_states: Getting commanded states ['pcad_mode'] between 2025:085:12:31:14.036 - 2025:099:11:10:10.904
2025-04-09 08:31:49,763 get_cmds: Getting commands from 2025:085:12:31:14.036 to 2025:099:11:10:10.904 for scenario=None
2025-04-09 08:31:49,763 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:49,763 get_cmds: Getting recent commands from cache
2025-04-09 08:31:49,764 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:31:49,766 get_cmds: Getting commands from 2025:078:12:31:14.036 to 2025:085:12:31:14.036 for scenario=None
2025-04-09 08:31:49,766 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:31:49,767 get_cmds: Getting recent commands from cache
2025-04-09 08:31:49,768 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:14.036
2025-04-09 08:31:49,769 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:31:57,886 get_plot_figure: Compressing Telem data for state pcad_mode
2025-04-09 08:32:00,169 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-04-09 08:32:00,173 get_plot_figure: Compressing State data for state pcad_mode
2025-04-09 08:32:02,539 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-04-09 08:32:02,588 get_plot_html: Creating HTML for state pcad_mode
2025-04-09 08:32:02,593 run_validators: Validating simpos
2025-04-09 08:32:02,600 tlm: Fetching telemetry for ['3tscpos'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for 3tscpos between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [179:34631]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-04-09 08:32:02,770 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:32:02,770 get_states: Getting commanded states ['simpos'] between 2025:085:12:31:23.261 - 2025:099:11:10:03.217
2025-04-09 08:32:02,770 get_cmds: Getting commands from 2025:085:12:31:23.261 to 2025:099:11:10:03.217 for scenario=None
2025-04-09 08:32:02,770 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:02,771 get_cmds: Getting recent commands from cache
2025-04-09 08:32:02,772 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:32:02,774 get_cmds: Getting commands from 2025:078:12:31:23.261 to 2025:085:12:31:23.261 for scenario=None
2025-04-09 08:32:02,774 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:02,775 get_cmds: Getting recent commands from cache
2025-04-09 08:32:02,775 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:23.261
2025-04-09 08:32:02,777 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:32:02,915 get_plot_figure: Compressing Telem data for state simpos
2025-04-09 08:32:02,987 get_plot_figure: Creating Telem scatter plot for state simpos
2025-04-09 08:32:02,990 get_plot_figure: Compressing State data for state simpos
2025-04-09 08:32:03,062 get_plot_figure: Creating State scatter plot for state simpos
2025-04-09 08:32:03,070 get_plot_html: Creating HTML for state simpos
2025-04-09 08:32:03,280 run_validators: Validating obsid
2025-04-09 08:32:03,287 tlm: Fetching telemetry for ['cobsrqid'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for cobsrqid between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [2853:555328]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-04-09 08:32:03,633 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:32:03,633 get_states: Getting commanded states ['obsid'] between 2025:085:12:31:15.061 - 2025:099:11:10:10.648
2025-04-09 08:32:03,633 get_cmds: Getting commands from 2025:085:12:31:15.061 to 2025:099:11:10:10.648 for scenario=None
2025-04-09 08:32:03,633 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:03,634 get_cmds: Getting recent commands from cache
2025-04-09 08:32:03,635 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:32:03,637 get_cmds: Getting commands from 2025:078:12:31:15.061 to 2025:085:12:31:15.061 for scenario=None
2025-04-09 08:32:03,637 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:03,638 get_cmds: Getting recent commands from cache
2025-04-09 08:32:03,638 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:15.061
2025-04-09 08:32:03,640 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:32:05,950 get_plot_figure: Compressing Telem data for state obsid
2025-04-09 08:32:07,083 get_plot_figure: Creating Telem scatter plot for state obsid
2025-04-09 08:32:07,086 get_plot_figure: Compressing State data for state obsid
2025-04-09 08:32:08,233 get_plot_figure: Creating State scatter plot for state obsid
2025-04-09 08:32:08,251 get_plot_html: Creating HTML for state obsid
2025-04-09 08:32:08,262 run_validators: Validating letg
2025-04-09 08:32:08,269 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for 4ootgsel between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [179:34708]
_get_data: Getting data for 4ootgmtn between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Using times_cache for tel2eng 859378643.0519998 to 860590043.052
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [179:34708]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-09 08:32:08,984 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:32:08,984 get_states: Getting commanded states ['letg'] between 2025:085:12:31:23.261 - 2025:099:11:09:52.198
2025-04-09 08:32:08,984 get_cmds: Getting commands from 2025:085:12:31:23.261 to 2025:099:11:09:52.198 for scenario=None
2025-04-09 08:32:08,984 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:08,985 get_cmds: Getting recent commands from cache
2025-04-09 08:32:08,985 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:32:08,987 get_cmds: Getting commands from 2025:078:12:31:23.261 to 2025:085:12:31:23.261 for scenario=None
2025-04-09 08:32:08,988 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:08,988 get_cmds: Getting recent commands from cache
2025-04-09 08:32:08,989 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:23.261
2025-04-09 08:32:08,991 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:32:09,211 get_plot_figure: Compressing Telem data for state letg
2025-04-09 08:32:09,282 get_plot_figure: Creating Telem scatter plot for state letg
2025-04-09 08:32:09,284 get_plot_figure: Compressing State data for state letg
2025-04-09 08:32:09,354 get_plot_figure: Creating State scatter plot for state letg
2025-04-09 08:32:09,361 get_plot_html: Creating HTML for state letg
2025-04-09 08:32:09,369 run_validators: Validating hetg
2025-04-09 08:32:09,376 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for 4ootgsel between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_data: Getting data for 4ootgmtn between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-09 08:32:09,391 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:32:09,391 get_states: Getting commanded states ['hetg'] between 2025:085:12:31:23.261 - 2025:099:11:09:52.198
2025-04-09 08:32:09,391 get_cmds: Getting commands from 2025:085:12:31:23.261 to 2025:099:11:09:52.198 for scenario=None
2025-04-09 08:32:09,391 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:09,392 get_cmds: Getting recent commands from cache
2025-04-09 08:32:09,393 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:32:09,394 get_cmds: Getting commands from 2025:078:12:31:23.261 to 2025:085:12:31:23.261 for scenario=None
2025-04-09 08:32:09,395 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:09,395 get_cmds: Getting recent commands from cache
2025-04-09 08:32:09,396 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:31:23.261
2025-04-09 08:32:09,398 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:32:09,618 get_plot_figure: Compressing Telem data for state hetg
2025-04-09 08:32:09,688 get_plot_figure: Creating Telem scatter plot for state hetg
2025-04-09 08:32:09,689 get_plot_figure: Compressing State data for state hetg
2025-04-09 08:32:09,760 get_plot_figure: Creating State scatter plot for state hetg
2025-04-09 08:32:09,768 get_plot_html: Creating HTML for state hetg
2025-04-09 08:32:09,772 run_validators: Validating sun_pos_mon
2025-04-09 08:32:09,780 tlm: Fetching telemetry for ['aopssupm'] between 2025:085:12:31:13.868 and 2025:099:12:31:13.868
_get_data: Getting data for aopssupm between 2025:085:12:16:13.868 to 2025:099:12:46:13.868
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [714:138832]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-04-09 08:32:10,367 get_states: Using kadi.commands.states to get cmd_states
2025-04-09 08:32:10,367 get_states: Getting commanded states ['sun_pos_mon'] between 2025:085:12:40:08.061 - 2025:099:11:10:08.086
2025-04-09 08:32:10,367 get_cmds: Getting commands from 2025:085:12:40:08.061 to 2025:099:11:10:08.086 for scenario=None
2025-04-09 08:32:10,368 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:10,368 get_cmds: Getting recent commands from cache
2025-04-09 08:32:10,369 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-09 08:32:10,371 get_cmds: Getting commands from 2025:078:12:40:08.061 to 2025:085:12:40:08.061 for scenario=None
2025-04-09 08:32:10,371 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:10,372 get_cmds: Getting recent commands from cache
2025-04-09 08:32:10,372 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:078:12:40:08.061
2025-04-09 08:32:10,374 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:32:10,391 get_cmds: Getting commands from 2025:055:12:40:08.061 to 2025:085:12:40:08.061 for scenario=None
2025-04-09 08:32:10,391 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-09 08:32:10,392 get_cmds: Getting recent commands from cache
2025-04-09 08:32:10,393 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:055:12:40:08.061
2025-04-09 08:32:10,394 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-09 08:32:11,265 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-04-09 08:32:11,545 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-04-09 08:32:11,548 get_plot_figure: Compressing State data for state sun_pos_mon
2025-04-09 08:32:11,824 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-04-09 08:32:11,839 get_plot_html: Creating HTML for state sun_pos_mon
2025-04-10 08:31:08,122 run_validators: Validating pitch
2025-04-10 08:31:08,122 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:086:12:15:38.121 to 2025:100:12:46:38.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3307:1155456]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-10 08:31:09,333 tlm: Fetching telemetry for ['pitch_comp'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for pitch_comp between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:086:12:00:38.121 to 2025:100:13:01:38.121
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 859464107.3050001 to 860677367.3050001
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [2429:1155456]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:086:12:16:08.121 to 2025:100:11:55:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [3336:1155456]
_get_data: Getting data for orbitephem0_x between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [5185:9217]
_get_data: Getting data for orbitephem0_y between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [5185:9217]
_get_data: Getting data for orbitephem0_z between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [5185:9217]
_get_data: Getting data for solarephem0_x between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [5185:9217]
_get_data: Getting data for solarephem0_y between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for solarephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [5185:9217]
_get_data: Getting data for solarephem0_z between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for solarephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [5185:9217]
_get_data: Getting data for aoattqt1 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2634:1155456]
_get_data: Getting data for aoattqt2 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2634:1155456]
_get_data: Getting data for aoattqt3 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2634:1155456]
_get_data: Getting data for aoattqt4 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2634:1155456]
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:100:11:55:15.133 to 2025:100:12:19:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [1728:1728]
_get_data: Getting data for orbitephem0_x between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9212:9222]
_get_data: Getting data for orbitephem0_y between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9212:9222]
_get_data: Getting data for orbitephem0_z between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9212:9222]
_get_data: Getting data for solarephem0_x between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9212:9222]
_get_data: Getting data for solarephem0_y between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for solarephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9212:9222]
_get_data: Getting data for solarephem0_z between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for solarephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9212:9222]
_get_data: Getting data for aoattqt1 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [1728:1728]
_get_data: Getting data for aoattqt2 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [1728:1728]
_get_data: Getting data for aoattqt3 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [1728:1728]
_get_data: Getting data for aoattqt4 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [1728:1728]
fetch: Setting bads because of gaps in aoattqt1 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
fetch: Setting bads because of gaps in aoattqt2 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
fetch: Setting bads because of gaps in aoattqt3 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
fetch: Setting bads because of gaps in aoattqt4 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:100:12:25:16.043 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860675185.227 to 860676437.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [1728:1728]
_get_data: Getting data for orbitephem0_x between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9218:9227]
_get_data: Getting data for orbitephem0_y between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9218:9227]
_get_data: Getting data for orbitephem0_z between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9218:9227]
_get_data: Getting data for solarephem0_x between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9218:9227]
_get_data: Getting data for solarephem0_y between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for solarephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9218:9227]
_get_data: Getting data for solarephem0_z between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for solarephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9218:9227]
_get_data: Getting data for aoattqt1 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [1728:1728]
_get_data: Getting data for aoattqt2 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [1728:1728]
_get_data: Getting data for aoattqt3 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [1728:1728]
_get_data: Getting data for aoattqt4 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [1728:1728]
fetch: Setting bads because of gaps in aoattqt1 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
fetch: Setting bads because of gaps in aoattqt2 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
fetch: Setting bads because of gaps in aoattqt3 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
fetch: Setting bads because of gaps in aoattqt4 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-04-10 08:31:16,104 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:16,105 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:086:12:31:08.666 - 2025:100:12:30:09.666
2025-04-10 08:31:16,105 get_cmds: Getting commands from 2025:086:12:31:08.666 to 2025:100:12:30:09.666 for scenario=None
2025-04-10 08:31:16,105 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:16,106 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-04-10 08:31:16,106 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-04-10 08:31:16,463 get_cmd_events_from_sheet: Writing 151 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-04-10 08:31:16,473 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR with cache=False
2025-04-10 08:31:16,615 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR1725A.pkl.gz
2025-04-10 08:31:16,621 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2325A.pkl.gz
2025-04-10 08:31:16,628 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR2625A.pkl.gz
2025-04-10 08:31:16,633 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/MAR3125A.pkl.gz
2025-04-10 08:31:16,637 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/APR with cache=False
2025-04-10 08:31:16,690 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR0725A.pkl.gz
2025-04-10 08:31:16,694 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAY with cache=False
2025-04-10 08:31:16,724 update_cmd_events_and_loads_and_get_cmds_recent: Including loads MAR1725A, MAR2325A, MAR2625A, MAR3125A, APR0725A
2025-04-10 08:31:16,728 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR1725A has 2442 commands with RLTT=2025:075:23:56:28.009
2025-04-10 08:31:16,732 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR2325A has 2538 commands with RLTT=2025:082:02:14:59.000
2025-04-10 08:31:16,735 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR2625A has 1617 commands with RLTT=2025:085:03:14:00.000
2025-04-10 08:31:16,739 update_cmd_events_and_loads_and_get_cmds_recent: Load MAR3125A has 2214 commands with RLTT=2025:089:21:13:00.000
2025-04-10 08:31:16,743 update_cmd_events_and_loads_and_get_cmds_recent: Load APR0725A has 1871 commands with RLTT=2025:097:00:25:37.986
2025-04-10 08:31:16,775 update_cmd_events_and_loads_and_get_cmds_recent: Including cmd_events:
SCS-107 at 2025:083:21:34:08.000
2025-04-10 08:31:16,785 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR1725A with 2442 commands
2025-04-10 08:31:16,785 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2442 commands from MAR1725A
2025-04-10 08:31:16,785 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR2325A with 2538 commands
2025-04-10 08:31:16,786 update_cmd_events_and_loads_and_get_cmds_recent: Removing 322 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR1725A due to RLTT in MAR2325A
2025-04-10 08:31:16,786 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2538 commands from MAR2325A
2025-04-10 08:31:16,786 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT SCS-107 at 2025:083:21:34:08.000 with 16 commands
2025-04-10 08:31:16,786 update_cmd_events_and_loads_and_get_cmds_recent: Removing 960 cmds in SCS slots [131, 132, 133] from MAR2325A due to DISABLE SCS in CMD_EVT at 2025:083:21:34:08.000
2025-04-10 08:31:16,787 update_cmd_events_and_loads_and_get_cmds_recent: Adding 16 commands from CMD_EVT SCS-107 at 2025:083:21:34:08.000
2025-04-10 08:31:16,787 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR2625A with 1617 commands
2025-04-10 08:31:16,787 update_cmd_events_and_loads_and_get_cmds_recent: Removing 812 cmds in SCS slots [128, 129, 130, 131, 132, 133] from MAR2325A due to RLTT in MAR2625A
2025-04-10 08:31:16,788 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1617 commands from MAR2625A
2025-04-10 08:31:16,788 update_cmd_events_and_loads_and_get_cmds_recent: Processing MAR3125A with 2214 commands
2025-04-10 08:31:16,789 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2214 commands from MAR3125A
2025-04-10 08:31:16,789 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR0725A with 1871 commands
2025-04-10 08:31:16,789 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1871 commands from APR0725A
2025-04-10 08:31:17,153 load_pars_dict: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.pkl with 178804 pars
2025-04-10 08:31:17,195 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:17,197 get_cmds: Getting commands from 2025:079:12:31:08.666 to 2025:086:12:31:08.666 for scenario=None
2025-04-10 08:31:17,197 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:17,198 get_cmds: Getting recent commands from cache
2025-04-10 08:31:17,199 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:23,107 get_plot_figure: Compressing Telem data for state pitch
2025-04-10 08:31:25,405 get_plot_figure: Creating Telem scatter plot for state pitch
2025-04-10 08:31:25,665 get_plot_figure: Compressing State data for state pitch
2025-04-10 08:31:27,669 get_plot_figure: Creating State scatter plot for state pitch
2025-04-10 08:31:27,975 get_plot_html: Creating HTML for state pitch
2025-04-10 08:31:28,037 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:086:12:15:38.121 to 2025:100:12:46:38.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3307:1155456]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-10 08:31:28,396 tlm: Fetching telemetry for ['roll_comp'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for roll_comp between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:086:12:00:38.121 to 2025:100:13:01:38.121
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 859464107.3050001 to 860677367.3050001
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [2429:1155456]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:086:12:16:08.121 to 2025:100:11:55:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [3336:1155456]
_get_data: Getting data for orbitephem0_x between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [5185:9217]
_get_data: Getting data for orbitephem0_y between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [5185:9217]
_get_data: Getting data for orbitephem0_z between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for orbitephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [5185:9217]
_get_data: Getting data for solarephem0_x between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [5185:9217]
_get_data: Getting data for solarephem0_y between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for solarephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [5185:9217]
_get_data: Getting data for solarephem0_z between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for solarephem0 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [5185:9217]
_get_data: Getting data for aoattqt1 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [2634:1155456]
_get_data: Getting data for aoattqt2 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [2634:1155456]
_get_data: Getting data for aoattqt3 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [2634:1155456]
_get_data: Getting data for aoattqt4 between 2025:086:12:04:08.121 to 2025:100:12:07:12.083
_get_msid_data_from_cxc: Using times_cache for pcad3eng 859464317.305 to 860674101.267
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [2634:1155456]
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:100:11:55:15.133 to 2025:100:12:19:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [1728:1728]
_get_data: Getting data for orbitephem0_x between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9212:9222]
_get_data: Getting data for orbitephem0_y between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9212:9222]
_get_data: Getting data for orbitephem0_z between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9212:9222]
_get_data: Getting data for solarephem0_x between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9212:9222]
_get_data: Getting data for solarephem0_y between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for solarephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9212:9222]
_get_data: Getting data for solarephem0_z between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for solarephem0 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9212:9222]
_get_data: Getting data for aoattqt1 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [1728:1728]
_get_data: Getting data for aoattqt2 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [1728:1728]
_get_data: Getting data for aoattqt3 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [1728:1728]
_get_data: Getting data for aoattqt4 between 2025:100:11:43:15.133 to 2025:100:12:31:43.971
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860672664.317 to 860675573.155
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [1728:1728]
fetch: Setting bads because of gaps in aoattqt1 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
fetch: Setting bads because of gaps in aoattqt2 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
fetch: Setting bads because of gaps in aoattqt3 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
fetch: Setting bads because of gaps in aoattqt4 between 2025:100:12:19:47.491 to 2025:100:12:31:43.966
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:100:12:25:16.043 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860675185.227 to 860676437.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [1728:1728]
_get_data: Getting data for orbitephem0_x between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [9218:9227]
_get_data: Getting data for orbitephem0_y between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [9218:9227]
_get_data: Getting data for orbitephem0_z between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for orbitephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [9218:9227]
_get_data: Getting data for solarephem0_x between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [9218:9227]
_get_data: Getting data for solarephem0_y between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for solarephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [9218:9227]
_get_data: Getting data for solarephem0_z between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for solarephem0 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [9218:9227]
_get_data: Getting data for aoattqt1 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [1728:1728]
_get_data: Getting data for aoattqt2 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [1728:1728]
_get_data: Getting data for aoattqt3 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [1728:1728]
_get_data: Getting data for aoattqt4 between 2025:100:12:13:16.043 to 2025:100:12:58:08.121
_get_msid_data_from_cxc: Using times_cache for pcad3eng 860674465.227 to 860677157.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [1728:1728]
fetch: Setting bads because of gaps in aoattqt1 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
fetch: Setting bads because of gaps in aoattqt2 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
fetch: Setting bads because of gaps in aoattqt3 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
fetch: Setting bads because of gaps in aoattqt4 between 2025:100:12:19:47.491 to 2025:100:12:58:07.591
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-04-10 08:31:30,843 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:30,843 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:086:12:31:08.666 - 2025:100:12:30:09.666
2025-04-10 08:31:30,843 get_cmds: Getting commands from 2025:086:12:31:08.666 to 2025:100:12:30:09.666 for scenario=None
2025-04-10 08:31:30,844 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:30,844 get_cmds: Getting recent commands from cache
2025-04-10 08:31:30,845 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:30,847 get_cmds: Getting commands from 2025:079:12:31:08.666 to 2025:086:12:31:08.666 for scenario=None
2025-04-10 08:31:30,848 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:30,848 get_cmds: Getting recent commands from cache
2025-04-10 08:31:30,849 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:35,061 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-04-10 08:31:37,282 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-04-10 08:31:37,309 get_plot_figure: Compressing State data for state off_nom_roll
2025-04-10 08:31:39,306 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-04-10 08:31:39,375 get_plot_html: Creating HTML for state off_nom_roll
2025-04-10 08:31:39,393 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:086:12:15:38.121 to 2025:100:12:46:38.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [3307:1155456]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-10 08:31:39,751 get_cmds: Getting commands from 2025:086:12:11:08.121 to 2025:100:12:31:08.121 for scenario=None
2025-04-10 08:31:39,751 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:39,752 get_cmds: Getting recent commands from cache
2025-04-10 08:31:39,752 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:39,813 add_exclude_interval: dither: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-10 08:31:39,815 add_exclude_interval: dither: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-10 08:31:39,816 add_exclude_interval: dither: excluding interval 2025:098:01:58:28.000 - 2025:098:02:11:28.000: SRDC
2025-04-10 08:31:39,817 add_exclude_interval: dither: excluding interval 2025:100:12:14:59.000 - 2025:100:12:27:59.000: SRDC
2025-04-10 08:31:39,818 tlm: Fetching telemetry for ['aodithen'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for aodithen between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [417:144432]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-04-10 08:31:40,045 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:40,045 get_states: Getting commanded states ['dither'] between 2025:086:12:31:10.266 - 2025:100:12:30:02.796
2025-04-10 08:31:40,045 get_cmds: Getting commands from 2025:086:12:31:10.266 to 2025:100:12:30:02.796 for scenario=None
2025-04-10 08:31:40,045 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:40,046 get_cmds: Getting recent commands from cache
2025-04-10 08:31:40,046 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:40,048 get_cmds: Getting commands from 2025:079:12:31:10.266 to 2025:086:12:31:10.266 for scenario=None
2025-04-10 08:31:40,049 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:40,049 get_cmds: Getting recent commands from cache
2025-04-10 08:31:40,050 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:40,799 get_plot_figure: Compressing Telem data for state dither
2025-04-10 08:31:41,046 get_plot_figure: Creating Telem scatter plot for state dither
2025-04-10 08:31:41,047 get_plot_figure: Compressing State data for state dither
2025-04-10 08:31:41,299 get_plot_figure: Creating State scatter plot for state dither
2025-04-10 08:31:41,595 get_plot_html: Creating HTML for state dither
2025-04-10 08:31:41,599 run_validators: Validating pcad_mode
2025-04-10 08:31:41,610 get_cmds: Getting commands from 2025:086:12:11:08.121 to 2025:100:12:31:08.121 for scenario=None
2025-04-10 08:31:41,611 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:41,611 get_cmds: Getting recent commands from cache
2025-04-10 08:31:41,612 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:41,669 add_exclude_interval: pcad_mode: excluding interval 2025:092:20:14:00.000 - 2025:092:20:27:00.000: SRDC
2025-04-10 08:31:41,671 add_exclude_interval: pcad_mode: excluding interval 2025:095:11:52:00.000 - 2025:095:12:05:00.000: SRDC
2025-04-10 08:31:41,672 add_exclude_interval: pcad_mode: excluding interval 2025:098:01:58:28.000 - 2025:098:02:11:28.000: SRDC
2025-04-10 08:31:41,673 add_exclude_interval: pcad_mode: excluding interval 2025:100:12:14:59.000 - 2025:100:12:27:59.000: SRDC
2025-04-10 08:31:41,674 tlm: Fetching telemetry for ['aopcadmd'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for aopcadmd between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [3336:1155456]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-04-10 08:31:42,047 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:42,048 get_states: Getting commanded states ['pcad_mode'] between 2025:086:12:31:08.216 - 2025:100:12:30:09.971
2025-04-10 08:31:42,048 get_cmds: Getting commands from 2025:086:12:31:08.216 to 2025:100:12:30:09.971 for scenario=None
2025-04-10 08:31:42,048 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:42,049 get_cmds: Getting recent commands from cache
2025-04-10 08:31:42,049 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:42,051 get_cmds: Getting commands from 2025:079:12:31:08.216 to 2025:086:12:31:08.216 for scenario=None
2025-04-10 08:31:42,052 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:42,052 get_cmds: Getting recent commands from cache
2025-04-10 08:31:42,053 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:49,987 get_plot_figure: Compressing Telem data for state pcad_mode
2025-04-10 08:31:51,941 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-04-10 08:31:51,946 get_plot_figure: Compressing State data for state pcad_mode
2025-04-10 08:31:53,897 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-04-10 08:31:53,965 get_plot_html: Creating HTML for state pcad_mode
2025-04-10 08:31:53,970 run_validators: Validating simpos
2025-04-10 08:31:53,976 tlm: Fetching telemetry for ['3tscpos'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for 3tscpos between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [104:36028]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-04-10 08:31:54,107 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:54,107 get_states: Getting commanded states ['simpos'] between 2025:086:12:31:18.466 - 2025:100:12:29:46.909
2025-04-10 08:31:54,108 get_cmds: Getting commands from 2025:086:12:31:18.466 to 2025:100:12:29:46.909 for scenario=None
2025-04-10 08:31:54,108 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:54,108 get_cmds: Getting recent commands from cache
2025-04-10 08:31:54,109 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:54,111 get_cmds: Getting commands from 2025:079:12:31:18.466 to 2025:086:12:31:18.466 for scenario=None
2025-04-10 08:31:54,111 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:54,112 get_cmds: Getting recent commands from cache
2025-04-10 08:31:54,113 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:54,243 get_plot_figure: Compressing Telem data for state simpos
2025-04-10 08:31:54,305 get_plot_figure: Creating Telem scatter plot for state simpos
2025-04-10 08:31:54,308 get_plot_figure: Compressing State data for state simpos
2025-04-10 08:31:54,370 get_plot_figure: Creating State scatter plot for state simpos
2025-04-10 08:31:54,377 get_plot_html: Creating HTML for state simpos
2025-04-10 08:31:54,381 run_validators: Validating obsid
2025-04-10 08:31:54,388 tlm: Fetching telemetry for ['cobsrqid'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for cobsrqid between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [1668:577728]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-04-10 08:31:54,621 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:54,621 get_states: Getting commanded states ['obsid'] between 2025:086:12:31:08.216 - 2025:100:12:30:08.690
2025-04-10 08:31:54,621 get_cmds: Getting commands from 2025:086:12:31:08.216 to 2025:100:12:30:08.690 for scenario=None
2025-04-10 08:31:54,621 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:54,622 get_cmds: Getting recent commands from cache
2025-04-10 08:31:54,623 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:54,625 get_cmds: Getting commands from 2025:079:12:31:08.216 to 2025:086:12:31:08.216 for scenario=None
2025-04-10 08:31:54,625 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:54,626 get_cmds: Getting recent commands from cache
2025-04-10 08:31:54,626 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:56,645 get_plot_figure: Compressing Telem data for state obsid
2025-04-10 08:31:57,630 get_plot_figure: Creating Telem scatter plot for state obsid
2025-04-10 08:31:57,633 get_plot_figure: Compressing State data for state obsid
2025-04-10 08:31:58,615 get_plot_figure: Creating State scatter plot for state obsid
2025-04-10 08:31:58,632 get_plot_html: Creating HTML for state obsid
2025-04-10 08:31:58,637 run_validators: Validating letg
2025-04-10 08:31:58,644 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for 4ootgsel between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [105:36108]
_get_data: Getting data for 4ootgmtn between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Using times_cache for tel2eng 859465037.305 to 860676437.305
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [105:36108]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-10 08:31:59,028 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:59,028 get_states: Getting commanded states ['letg'] between 2025:086:12:31:18.466 - 2025:100:12:30:08.690
2025-04-10 08:31:59,028 get_cmds: Getting commands from 2025:086:12:31:18.466 to 2025:100:12:30:08.690 for scenario=None
2025-04-10 08:31:59,028 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:59,029 get_cmds: Getting recent commands from cache
2025-04-10 08:31:59,030 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:59,032 get_cmds: Getting commands from 2025:079:12:31:18.466 to 2025:086:12:31:18.466 for scenario=None
2025-04-10 08:31:59,032 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:59,033 get_cmds: Getting recent commands from cache
2025-04-10 08:31:59,033 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:59,245 get_plot_figure: Compressing Telem data for state letg
2025-04-10 08:31:59,307 get_plot_figure: Creating Telem scatter plot for state letg
2025-04-10 08:31:59,308 get_plot_figure: Compressing State data for state letg
2025-04-10 08:31:59,370 get_plot_figure: Creating State scatter plot for state letg
2025-04-10 08:31:59,378 get_plot_html: Creating HTML for state letg
2025-04-10 08:31:59,382 run_validators: Validating hetg
2025-04-10 08:31:59,388 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for 4ootgsel between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_data: Getting data for 4ootgmtn between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-10 08:31:59,402 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:31:59,402 get_states: Getting commanded states ['hetg'] between 2025:086:12:31:18.466 - 2025:100:12:30:08.690
2025-04-10 08:31:59,402 get_cmds: Getting commands from 2025:086:12:31:18.466 to 2025:100:12:30:08.690 for scenario=None
2025-04-10 08:31:59,402 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:59,403 get_cmds: Getting recent commands from cache
2025-04-10 08:31:59,404 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:59,405 get_cmds: Getting commands from 2025:079:12:31:18.466 to 2025:086:12:31:18.466 for scenario=None
2025-04-10 08:31:59,406 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:31:59,406 get_cmds: Getting recent commands from cache
2025-04-10 08:31:59,407 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:31:59,618 get_plot_figure: Compressing Telem data for state hetg
2025-04-10 08:31:59,680 get_plot_figure: Creating Telem scatter plot for state hetg
2025-04-10 08:31:59,681 get_plot_figure: Compressing State data for state hetg
2025-04-10 08:31:59,743 get_plot_figure: Creating State scatter plot for state hetg
2025-04-10 08:31:59,750 get_plot_html: Creating HTML for state hetg
2025-04-10 08:31:59,754 run_validators: Validating sun_pos_mon
2025-04-10 08:31:59,761 tlm: Fetching telemetry for ['aopssupm'] between 2025:086:12:31:08.121 and 2025:100:12:31:08.121
_get_data: Getting data for aopssupm between 2025:086:12:16:08.121 to 2025:100:12:46:08.121
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [417:144432]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-04-10 08:32:00,040 get_states: Using kadi.commands.states to get cmd_states
2025-04-10 08:32:00,041 get_states: Getting commanded states ['sun_pos_mon'] between 2025:086:12:31:10.266 - 2025:100:12:30:08.177
2025-04-10 08:32:00,041 get_cmds: Getting commands from 2025:086:12:31:10.266 to 2025:100:12:30:08.177 for scenario=None
2025-04-10 08:32:00,041 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:32:00,042 get_cmds: Getting recent commands from cache
2025-04-10 08:32:00,042 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:32:00,044 get_cmds: Getting commands from 2025:079:12:31:10.266 to 2025:086:12:31:10.266 for scenario=None
2025-04-10 08:32:00,044 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:32:00,045 get_cmds: Getting recent commands from cache
2025-04-10 08:32:00,046 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-10 08:32:00,057 get_cmds: Getting commands from 2025:056:12:31:10.266 to 2025:086:12:31:10.266 for scenario=None
2025-04-10 08:32:00,058 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-10 08:32:00,058 get_cmds: Getting recent commands from cache
2025-04-10 08:32:00,059 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:056:12:31:10.266
2025-04-10 08:32:01,446 load_idx_cmds: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.h5 with 1694995 commands
2025-04-10 08:32:01,454 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-04-10 08:32:01,753 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-04-10 08:32:01,753 get_matching_block_idx: Match(a=0, b=0, size=1)
2025-04-10 08:32:01,754 get_matching_block_idx: Match(a=4, b=1, size=14)
2025-04-10 08:32:01,754 get_matching_block_idx: Match(a=19, b=15, size=18)
2025-04-10 08:32:01,754 get_matching_block_idx: Match(a=38, b=34, size=8712)
2025-04-10 08:32:01,754 get_matching_block_idx: Match(a=8750, b=8746, size=0)
2025-04-10 08:32:01,754 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-04-10 08:32:01,754 get_matching_block_idx: ('equal', 0, 1, 0, 1)
2025-04-10 08:32:01,754 get_matching_block_idx: ('delete', 1, 4, 1, 1)
2025-04-10 08:32:01,754 get_matching_block_idx: ('equal', 4, 18, 1, 15)
2025-04-10 08:32:01,754 get_matching_block_idx: ('delete', 18, 19, 15, 15)
2025-04-10 08:32:01,754 get_matching_block_idx: ('equal', 19, 37, 15, 33)
2025-04-10 08:32:01,754 get_matching_block_idx: ('replace', 37, 38, 33, 34)
2025-04-10 08:32:01,754 get_matching_block_idx: ('equal', 38, 8750, 34, 8746)
2025-04-10 08:32:01,758 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-10 08:32:02,623 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-04-10 08:32:02,871 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-04-10 08:32:02,873 get_plot_figure: Compressing State data for state sun_pos_mon
2025-04-10 08:32:03,118 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-04-10 08:32:03,133 get_plot_html: Creating HTML for state sun_pos_mon