Prev
Index
Next
kadi: Wed Apr 30 08:32:11 2025
File: /proj/sot/ska/data/kadi/logs/daily.0/kadi_validate.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kadi |
OK
|
0.09 | 1.5 |
Wed Apr 30 08:32:11 2025 |
No errors
File contents:
2025-04-30 08:31:16,546 run_validators: Validating pitch
2025-04-30 08:31:16,546 get_command_sheet_exclude_intervals: Getting exclude times from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv&id=19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ&gid=1681877928
_get_data: Getting data for conlofp between 2025:106:12:15:46.546 to 2025:120:12:46:46.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [5361:1154432]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-30 08:31:17,761 tlm: Fetching telemetry for ['pitch_comp'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for pitch_comp between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_comp_data: Getting computed values for pitch_comp
_get_data: Getting data for conlofp between 2025:106:12:00:46.546 to 2025:120:13:01:46.546
_get_msid_data_from_cxc: Using times_cache for ccdm8eng 861192115.73 to 862405375.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm8eng/CONLOFP.h5
_get_msid_data_from_cxc: Slicing CONLOFP arrays [4483:1154432]
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [5390:1154432]
_get_data: Getting data for orbitephem0_x between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_X.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_X arrays [4897:8939]
_get_data: Getting data for orbitephem0_y between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Using times_cache for orbitephem0 861192325.73 to 862405165.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Y arrays [4897:8939]
_get_data: Getting data for orbitephem0_z between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Using times_cache for orbitephem0 861192325.73 to 862405165.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/orbitephem0/ORBITEPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing ORBITEPHEM0_Z arrays [4897:8939]
_get_data: Getting data for solarephem0_x between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_X.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_X arrays [4897:8939]
_get_data: Getting data for solarephem0_y between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Using times_cache for solarephem0 861192325.73 to 862405165.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Y.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Y arrays [4897:8939]
_get_data: Getting data for solarephem0_z between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Using times_cache for solarephem0 861192325.73 to 862405165.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/solarephem0/SOLAREPHEM0_Z.h5
_get_msid_data_from_cxc: Slicing SOLAREPHEM0_Z arrays [4897:8939]
_get_data: Getting data for aoattqt1 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT1.h5
_get_msid_data_from_cxc: Slicing AOATTQT1 arrays [4688:1154432]
_get_data: Getting data for aoattqt2 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Using times_cache for pcad3eng 861192325.73 to 862405165.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT2.h5
_get_msid_data_from_cxc: Slicing AOATTQT2 arrays [4688:1154432]
_get_data: Getting data for aoattqt3 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Using times_cache for pcad3eng 861192325.73 to 862405165.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT3.h5
_get_msid_data_from_cxc: Slicing AOATTQT3 arrays [4688:1154432]
_get_data: Getting data for aoattqt4 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_msid_data_from_cxc: Using times_cache for pcad3eng 861192325.73 to 862405165.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOATTQT4.h5
_get_msid_data_from_cxc: Slicing AOATTQT4 arrays [4688:1154432]
fetch: Setting bads because of gaps in aoattqt1 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
fetch: Setting bads because of gaps in aoattqt2 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
fetch: Setting bads because of gaps in aoattqt3 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
fetch: Setting bads because of gaps in aoattqt4 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for pitch_comp
interpolate: Slicing on indexes
2025-04-30 08:31:22,155 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:31:22,155 get_states: Getting commanded states ['pitch', 'pcad_mode'] between 2025:106:12:31:17.216 - 2025:120:04:01:12.191
2025-04-30 08:31:22,156 get_cmds: Getting commands from 2025:106:12:31:17.216 to 2025:120:04:01:12.191 for scenario=None
2025-04-30 08:31:22,156 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:22,157 get_cmds: Recent commands not in cache: updating local cmd_events, loads and getting recent commands
2025-04-30 08:31:22,157 get_cmd_events_from_sheet: Getting cmd_events from https://docs.google.com/spreadsheets/d/19d6XqBhWoFjC-z1lS1nM6wLE_zjr4GYB1lOvrEGCbKQ/export?format=csv
2025-04-30 08:31:22,517 get_cmd_events_from_sheet: Writing 151 cmd_events to /home/aca/.kadi/cmd_events.csv
2025-04-30 08:31:22,531 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAR with cache=False
2025-04-30 08:31:22,837 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/APR with cache=False
2025-04-30 08:31:22,922 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR0725A.pkl.gz
2025-04-30 08:31:22,929 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR1425A.pkl.gz
2025-04-30 08:31:22,936 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR2125A.pkl.gz
2025-04-30 08:31:22,942 get_load_cmds_from_occweb_or_local: Already have /home/aca/.kadi/loads/APR2825A.pkl.gz
2025-04-30 08:31:22,947 get_occweb_page: Getting OCCweb FOT/mission_planning/PRODUCTS/APPR_LOADS/2025/MAY with cache=False
2025-04-30 08:31:23,006 update_cmd_events_and_loads_and_get_cmds_recent: Including loads APR0725A, APR1425A, APR2125A, APR2825A
2025-04-30 08:31:23,010 update_cmd_events_and_loads_and_get_cmds_recent: Load APR0725A has 1871 commands with RLTT=2025:097:00:25:37.986
2025-04-30 08:31:23,014 update_cmd_events_and_loads_and_get_cmds_recent: Load APR1425A has 2192 commands with RLTT=2025:103:21:58:07.076
2025-04-30 08:31:23,019 update_cmd_events_and_loads_and_get_cmds_recent: Load APR2125A has 2082 commands with RLTT=2025:111:00:41:00.000
2025-04-30 08:31:23,023 update_cmd_events_and_loads_and_get_cmds_recent: Load APR2825A has 1894 commands with RLTT=2025:118:00:24:12.365
2025-04-30 08:31:23,054 update_cmd_events_and_loads_and_get_cmds_recent: Including cmd_events:
SCS-107 at 2025:083:21:34:08.000
2025-04-30 08:31:23,064 update_cmd_events_and_loads_and_get_cmds_recent: Processing CMD_EVT SCS-107 at 2025:083:21:34:08.000 with 16 commands
2025-04-30 08:31:23,065 update_cmd_events_and_loads_and_get_cmds_recent: Adding 16 commands from CMD_EVT SCS-107 at 2025:083:21:34:08.000
2025-04-30 08:31:23,065 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR0725A with 1871 commands
2025-04-30 08:31:23,065 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1871 commands from APR0725A
2025-04-30 08:31:23,065 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR1425A with 2192 commands
2025-04-30 08:31:23,065 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2192 commands from APR1425A
2025-04-30 08:31:23,065 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR2125A with 2082 commands
2025-04-30 08:31:23,066 update_cmd_events_and_loads_and_get_cmds_recent: Adding 2082 commands from APR2125A
2025-04-30 08:31:23,066 update_cmd_events_and_loads_and_get_cmds_recent: Processing APR2825A with 1894 commands
2025-04-30 08:31:23,066 update_cmd_events_and_loads_and_get_cmds_recent: Adding 1894 commands from APR2825A
2025-04-30 08:31:23,458 load_pars_dict: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.pkl with 179343 pars
2025-04-30 08:31:23,476 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:31:23,479 get_cmds: Getting commands from 2025:099:12:31:17.216 to 2025:106:12:31:17.216 for scenario=None
2025-04-30 08:31:23,479 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:23,480 get_cmds: Getting recent commands from cache
2025-04-30 08:31:23,480 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:17.216
2025-04-30 08:31:26,603 load_idx_cmds: Loaded /proj/sot/ska3/flight/data/kadi/cmds2.h5 with 1701298 commands
2025-04-30 08:31:26,613 get_matching_block_idx: Selecting commands from cmds_arch[0:]
2025-04-30 08:31:27,309 get_matching_block_idx: Matching blocks for (a) recent commands and (b) existing HDF5
2025-04-30 08:31:27,310 get_matching_block_idx: Match(a=0, b=0, size=16)
2025-04-30 08:31:27,310 get_matching_block_idx: Match(a=4179, b=16, size=3)
2025-04-30 08:31:27,310 get_matching_block_idx: Match(a=4185, b=19, size=57)
2025-04-30 08:31:27,310 get_matching_block_idx: Match(a=4243, b=76, size=8166)
2025-04-30 08:31:27,310 get_matching_block_idx: Match(a=12409, b=8242, size=0)
2025-04-30 08:31:27,310 get_matching_block_idx: Diffs between (a) recent commands and (b) existing HDF5
2025-04-30 08:31:27,310 get_matching_block_idx: ('equal', 0, 16, 0, 16)
2025-04-30 08:31:27,310 get_matching_block_idx: ('delete', 16, 4179, 16, 16)
2025-04-30 08:31:27,310 get_matching_block_idx: ('equal', 4179, 4182, 16, 19)
2025-04-30 08:31:27,310 get_matching_block_idx: ('delete', 4182, 4185, 19, 19)
2025-04-30 08:31:27,310 get_matching_block_idx: ('equal', 4185, 4242, 19, 76)
2025-04-30 08:31:27,310 get_matching_block_idx: ('delete', 4242, 4243, 76, 76)
2025-04-30 08:31:27,310 get_matching_block_idx: ('equal', 4243, 12409, 76, 8242)
2025-04-30 08:31:27,316 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:31:33,152 get_plot_figure: Compressing Telem data for state pitch
2025-04-30 08:31:35,279 get_plot_figure: Creating Telem scatter plot for state pitch
2025-04-30 08:31:35,476 get_plot_figure: Compressing State data for state pitch
2025-04-30 08:31:37,434 get_plot_figure: Creating State scatter plot for state pitch
2025-04-30 08:31:37,682 get_plot_html: Creating HTML for state pitch
2025-04-30 08:31:37,738 run_validators: Validating off_nom_roll
_get_data: Getting data for conlofp between 2025:106:12:15:46.546 to 2025:120:12:46:46.546
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-30 08:31:37,926 tlm: Fetching telemetry for ['roll_comp'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for roll_comp between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_comp_data: Getting computed values for roll_comp
_get_data: Getting data for conlofp between 2025:106:12:00:46.546 to 2025:120:13:01:46.546
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
_get_data: Getting data for aopcadmd between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_data: Getting data for orbitephem0_x between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for orbitephem0_y between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for orbitephem0_z between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for solarephem0_x between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for solarephem0_y between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for solarephem0_z between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for aoattqt1 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for aoattqt2 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for aoattqt3 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
_get_data: Getting data for aoattqt4 between 2025:106:12:04:16.546 to 2025:120:12:58:16.546
fetch: Setting bads because of gaps in aoattqt1 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
fetch: Setting bads because of gaps in aoattqt2 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
fetch: Setting bads because of gaps in aoattqt3 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
fetch: Setting bads because of gaps in aoattqt4 between 2025:120:04:01:17.316 to 2025:120:12:58:16.141
interpolate: Interpolating index for orbitephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for orbitephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_x
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_y
interpolate: Slicing on indexes
interpolate: Interpolating index for solarephem0_z
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt1
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt2
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt3
interpolate: Slicing on indexes
interpolate: Interpolating index for aoattqt4
interpolate: Slicing on indexes
interpolate: Interpolating index for roll_comp
interpolate: Slicing on indexes
2025-04-30 08:31:39,361 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:31:39,362 get_states: Getting commanded states ['off_nom_roll', 'pitch', 'pcad_mode'] between 2025:106:12:31:17.216 - 2025:120:04:01:12.191
2025-04-30 08:31:39,362 get_cmds: Getting commands from 2025:106:12:31:17.216 to 2025:120:04:01:12.191 for scenario=None
2025-04-30 08:31:39,362 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:39,363 get_cmds: Getting recent commands from cache
2025-04-30 08:31:39,363 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:31:39,366 get_cmds: Getting commands from 2025:099:12:31:17.216 to 2025:106:12:31:17.216 for scenario=None
2025-04-30 08:31:39,366 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:39,367 get_cmds: Getting recent commands from cache
2025-04-30 08:31:39,367 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:17.216
2025-04-30 08:31:39,369 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:31:43,727 get_plot_figure: Compressing Telem data for state off_nom_roll
2025-04-30 08:31:45,802 get_plot_figure: Creating Telem scatter plot for state off_nom_roll
2025-04-30 08:31:45,825 get_plot_figure: Compressing State data for state off_nom_roll
2025-04-30 08:31:47,777 get_plot_figure: Creating State scatter plot for state off_nom_roll
2025-04-30 08:31:47,832 get_plot_html: Creating HTML for state off_nom_roll
2025-04-30 08:31:47,843 run_validators: Validating dither
_get_data: Getting data for conlofp between 2025:106:12:15:46.546 to 2025:120:12:46:46.546
interpolate: Interpolating index for conlofp
interpolate: Slicing on indexes
2025-04-30 08:31:48,082 get_cmds: Getting commands from 2025:106:12:11:16.546 to 2025:120:12:31:16.546 for scenario=None
2025-04-30 08:31:48,083 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:48,083 get_cmds: Getting recent commands from cache
2025-04-30 08:31:48,084 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:31:48,144 add_exclude_interval: dither: excluding interval 2025:108:11:19:59.000 - 2025:108:11:32:59.000: SRDC
2025-04-30 08:31:48,145 tlm: Fetching telemetry for ['aodithen'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for aodithen between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AODITHEN.h5
_get_msid_data_from_cxc: Slicing AODITHEN arrays [674:144304]
interpolate: Interpolating index for aodithen
interpolate: Slicing on indexes
2025-04-30 08:31:48,335 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:31:48,335 get_states: Getting commanded states ['dither'] between 2025:106:12:31:20.980 - 2025:120:04:01:08.801
2025-04-30 08:31:48,335 get_cmds: Getting commands from 2025:106:12:31:20.980 to 2025:120:04:01:08.801 for scenario=None
2025-04-30 08:31:48,335 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:48,336 get_cmds: Getting recent commands from cache
2025-04-30 08:31:48,337 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:31:48,338 get_cmds: Getting commands from 2025:099:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:31:48,339 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:48,339 get_cmds: Getting recent commands from cache
2025-04-30 08:31:48,340 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:20.980
2025-04-30 08:31:48,342 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:31:49,469 get_plot_figure: Compressing Telem data for state dither
2025-04-30 08:31:49,711 get_plot_figure: Creating Telem scatter plot for state dither
2025-04-30 08:31:49,712 get_plot_figure: Compressing State data for state dither
2025-04-30 08:31:49,954 get_plot_figure: Creating State scatter plot for state dither
2025-04-30 08:31:50,254 get_plot_html: Creating HTML for state dither
2025-04-30 08:31:50,259 run_validators: Validating pcad_mode
2025-04-30 08:31:50,270 get_cmds: Getting commands from 2025:106:12:11:16.546 to 2025:120:12:31:16.546 for scenario=None
2025-04-30 08:31:50,270 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:50,271 get_cmds: Getting recent commands from cache
2025-04-30 08:31:50,272 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:31:50,318 add_exclude_interval: pcad_mode: excluding interval 2025:108:11:19:59.000 - 2025:108:11:32:59.000: SRDC
2025-04-30 08:31:50,319 tlm: Fetching telemetry for ['aopcadmd'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for aopcadmd between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad3eng/AOPCADMD.h5
_get_msid_data_from_cxc: Slicing AOPCADMD arrays [5390:1154432]
interpolate: Interpolating index for aopcadmd
interpolate: Slicing on indexes
2025-04-30 08:31:50,549 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:31:50,549 get_states: Getting commanded states ['pcad_mode'] between 2025:106:12:31:16.880 - 2025:120:04:01:11.876
2025-04-30 08:31:50,549 get_cmds: Getting commands from 2025:106:12:31:16.880 to 2025:120:04:01:11.876 for scenario=None
2025-04-30 08:31:50,549 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:50,550 get_cmds: Getting recent commands from cache
2025-04-30 08:31:50,551 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:31:50,552 get_cmds: Getting commands from 2025:099:12:31:16.880 to 2025:106:12:31:16.880 for scenario=None
2025-04-30 08:31:50,553 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:31:50,553 get_cmds: Getting recent commands from cache
2025-04-30 08:31:50,554 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:16.880
2025-04-30 08:31:50,556 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:31:58,563 get_plot_figure: Compressing Telem data for state pcad_mode
2025-04-30 08:32:00,487 get_plot_figure: Creating Telem scatter plot for state pcad_mode
2025-04-30 08:32:00,491 get_plot_figure: Compressing State data for state pcad_mode
2025-04-30 08:32:02,457 get_plot_figure: Creating State scatter plot for state pcad_mode
2025-04-30 08:32:02,489 get_plot_html: Creating HTML for state pcad_mode
2025-04-30 08:32:02,723 run_validators: Validating simpos
2025-04-30 08:32:02,729 tlm: Fetching telemetry for ['3tscpos'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for 3tscpos between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/sim_mrg/3TSCPOS.h5
_get_msid_data_from_cxc: Slicing 3TSCPOS arrays [169:36005]
interpolate: Interpolating index for 3tscpos
interpolate: Slicing on indexes
2025-04-30 08:32:02,924 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:32:02,924 get_states: Getting commanded states ['simpos'] between 2025:106:12:31:20.980 - 2025:120:04:00:52.913
2025-04-30 08:32:02,925 get_cmds: Getting commands from 2025:106:12:31:20.980 to 2025:120:04:00:52.913 for scenario=None
2025-04-30 08:32:02,925 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:02,925 get_cmds: Getting recent commands from cache
2025-04-30 08:32:02,926 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:32:02,928 get_cmds: Getting commands from 2025:099:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:02,928 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:02,929 get_cmds: Getting recent commands from cache
2025-04-30 08:32:02,930 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:20.980
2025-04-30 08:32:02,931 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:03,064 get_plot_figure: Compressing Telem data for state simpos
2025-04-30 08:32:03,126 get_plot_figure: Creating Telem scatter plot for state simpos
2025-04-30 08:32:03,129 get_plot_figure: Compressing State data for state simpos
2025-04-30 08:32:03,191 get_plot_figure: Creating State scatter plot for state simpos
2025-04-30 08:32:03,199 get_plot_html: Creating HTML for state simpos
2025-04-30 08:32:03,207 run_validators: Validating obsid
2025-04-30 08:32:03,214 tlm: Fetching telemetry for ['cobsrqid'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for cobsrqid between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/ccdm10eng/COBSRQID.h5
_get_msid_data_from_cxc: Slicing COBSRQID arrays [2695:577216]
interpolate: Interpolating index for cobsrqid
interpolate: Slicing on indexes
2025-04-30 08:32:03,471 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:32:03,471 get_states: Getting commanded states ['obsid'] between 2025:106:12:31:16.880 - 2025:120:04:01:12.644
2025-04-30 08:32:03,471 get_cmds: Getting commands from 2025:106:12:31:16.880 to 2025:120:04:01:12.644 for scenario=None
2025-04-30 08:32:03,471 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:03,472 get_cmds: Getting recent commands from cache
2025-04-30 08:32:03,473 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:32:03,475 get_cmds: Getting commands from 2025:099:12:31:16.880 to 2025:106:12:31:16.880 for scenario=None
2025-04-30 08:32:03,475 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:03,476 get_cmds: Getting recent commands from cache
2025-04-30 08:32:03,476 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:16.880
2025-04-30 08:32:03,478 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:05,584 get_plot_figure: Compressing Telem data for state obsid
2025-04-30 08:32:06,554 get_plot_figure: Creating Telem scatter plot for state obsid
2025-04-30 08:32:06,556 get_plot_figure: Compressing State data for state obsid
2025-04-30 08:32:07,602 get_plot_figure: Creating State scatter plot for state obsid
2025-04-30 08:32:07,619 get_plot_html: Creating HTML for state obsid
2025-04-30 08:32:07,628 run_validators: Validating letg
2025-04-30 08:32:07,635 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for 4ootgsel between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGSEL.h5
_get_msid_data_from_cxc: Slicing 4OOTGSEL arrays [169:36076]
_get_data: Getting data for 4ootgmtn between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Using times_cache for tel2eng 861193045.73 to 862404445.73
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/tel2eng/4OOTGMTN.h5
_get_msid_data_from_cxc: Slicing 4OOTGMTN arrays [169:36076]
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-30 08:32:08,232 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:32:08,233 get_states: Getting commanded states ['letg'] between 2025:106:12:31:20.980 - 2025:120:04:00:41.894
2025-04-30 08:32:08,233 get_cmds: Getting commands from 2025:106:12:31:20.980 to 2025:120:04:00:41.894 for scenario=None
2025-04-30 08:32:08,233 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:08,233 get_cmds: Getting recent commands from cache
2025-04-30 08:32:08,234 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:32:08,236 get_cmds: Getting commands from 2025:099:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:08,237 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:08,237 get_cmds: Getting recent commands from cache
2025-04-30 08:32:08,238 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:20.980
2025-04-30 08:32:08,240 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:08,249 get_cmds: Getting commands from 2025:076:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:08,249 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:08,250 get_cmds: Getting recent commands from cache
2025-04-30 08:32:08,251 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:076:12:31:20.980
2025-04-30 08:32:08,252 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:08,484 get_plot_figure: Compressing Telem data for state letg
2025-04-30 08:32:08,545 get_plot_figure: Creating Telem scatter plot for state letg
2025-04-30 08:32:08,547 get_plot_figure: Compressing State data for state letg
2025-04-30 08:32:08,608 get_plot_figure: Creating State scatter plot for state letg
2025-04-30 08:32:08,615 get_plot_html: Creating HTML for state letg
2025-04-30 08:32:08,619 run_validators: Validating hetg
2025-04-30 08:32:08,626 tlm: Fetching telemetry for ['4ootgsel', '4ootgmtn'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for 4ootgsel between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_data: Getting data for 4ootgmtn between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
interpolate: Interpolating index for 4ootgsel
interpolate: Slicing on indexes
interpolate: Interpolating index for 4ootgmtn
interpolate: Slicing on indexes
2025-04-30 08:32:08,638 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:32:08,639 get_states: Getting commanded states ['hetg'] between 2025:106:12:31:20.980 - 2025:120:04:00:41.894
2025-04-30 08:32:08,639 get_cmds: Getting commands from 2025:106:12:31:20.980 to 2025:120:04:00:41.894 for scenario=None
2025-04-30 08:32:08,639 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:08,640 get_cmds: Getting recent commands from cache
2025-04-30 08:32:08,640 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:32:08,642 get_cmds: Getting commands from 2025:099:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:08,642 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:08,643 get_cmds: Getting recent commands from cache
2025-04-30 08:32:08,644 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:20.980
2025-04-30 08:32:08,645 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:08,654 get_cmds: Getting commands from 2025:076:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:08,654 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:08,655 get_cmds: Getting recent commands from cache
2025-04-30 08:32:08,656 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:076:12:31:20.980
2025-04-30 08:32:08,657 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:08,888 get_plot_figure: Compressing Telem data for state hetg
2025-04-30 08:32:08,949 get_plot_figure: Creating Telem scatter plot for state hetg
2025-04-30 08:32:08,950 get_plot_figure: Compressing State data for state hetg
2025-04-30 08:32:09,012 get_plot_figure: Creating State scatter plot for state hetg
2025-04-30 08:32:09,021 get_plot_html: Creating HTML for state hetg
2025-04-30 08:32:09,026 run_validators: Validating sun_pos_mon
2025-04-30 08:32:09,033 tlm: Fetching telemetry for ['aopssupm'] between 2025:106:12:31:16.546 and 2025:120:12:31:16.546
_get_data: Getting data for aopssupm between 2025:106:12:16:16.546 to 2025:120:12:46:16.546
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/TIME.h5
_get_msid_data_from_cxc: Reading /proj/sot/ska3/flight/data/eng_archive/data/pcad8eng/AOPSSUPM.h5
_get_msid_data_from_cxc: Slicing AOPSSUPM arrays [674:144304]
interpolate: Interpolating index for aopssupm
interpolate: Slicing on indexes
filter_bad: Filtering bad values for aopssupm
2025-04-30 08:32:09,289 get_states: Using kadi.commands.states to get cmd_states
2025-04-30 08:32:09,289 get_states: Getting commanded states ['sun_pos_mon'] between 2025:106:12:31:20.980 - 2025:120:04:01:05.982
2025-04-30 08:32:09,289 get_cmds: Getting commands from 2025:106:12:31:20.980 to 2025:120:04:01:05.982 for scenario=None
2025-04-30 08:32:09,289 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:09,290 get_cmds: Getting recent commands from cache
2025-04-30 08:32:09,291 get_cmds: Getting commands from recent only: start and stop are within recent commands for scenario=None
2025-04-30 08:32:09,293 get_cmds: Getting commands from 2025:099:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:09,293 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:09,294 get_cmds: Getting recent commands from cache
2025-04-30 08:32:09,295 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:099:12:31:20.980
2025-04-30 08:32:09,296 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:09,314 get_cmds: Getting commands from 2025:076:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:09,314 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:09,315 get_cmds: Getting recent commands from cache
2025-04-30 08:32:09,316 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2025:076:12:31:20.980
2025-04-30 08:32:09,317 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:09,342 get_cmds: Getting commands from 2024:292:12:31:20.980 to 2025:106:12:31:20.980 for scenario=None
2025-04-30 08:32:09,343 get_cmds: Cache key: (None, None, 30.0, None)
2025-04-30 08:32:09,343 get_cmds: Getting recent commands from cache
2025-04-30 08:32:09,344 _merge_cmds_archive_recent: Merging cmds_recent with archive commands from 2024:292:12:31:20.980
2025-04-30 08:32:09,348 get_cmds: Getting commands from archive + recent: start < recent loads start + 3 days for scenario=None
2025-04-30 08:32:10,244 get_plot_figure: Compressing Telem data for state sun_pos_mon
2025-04-30 08:32:10,483 get_plot_figure: Creating Telem scatter plot for state sun_pos_mon
2025-04-30 08:32:10,486 get_plot_figure: Compressing State data for state sun_pos_mon
2025-04-30 08:32:10,725 get_plot_figure: Creating State scatter plot for state sun_pos_mon
2025-04-30 08:32:10,739 get_plot_html: Creating HTML for state sun_pos_mon