Prev
Index
Next
kalman_watch3: Tue Oct 21 08:34:18 2025
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
| kalman_watch3 |
OK
|
0.09 | 1.0 |
Tue Oct 21 08:34:18 2025 |
No errors
File contents:
2025-10-21 08:31:14,328 log_run_info: ******************************************
2025-10-21 08:31:14,328 log_run_info: Running: /proj/sot/ska3/aca/lib/python3.12/site-packages/kalman_watch/kalman_perigee_mon.py
2025-10-21 08:31:14,328 log_run_info: Version: 0.6.1
2025-10-21 08:31:14,328 log_run_info: Time: Tue Oct 21 08:31:14 2025
2025-10-21 08:31:14,328 log_run_info: User: aca
2025-10-21 08:31:14,328 log_run_info: Machine: kady.cfa.harvard.edu
2025-10-21 08:31:14,328 log_run_info: Processing args:
2025-10-21 08:31:14,328 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca/www/ASPECT/kalman_watch3'),
2025-10-21 08:31:14,328 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2025-10-21 08:31:14,328 log_run_info: 'lookback': 14,
2025-10-21 08:31:14,328 log_run_info: 'make_html': True,
2025-10-21 08:31:14,328 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca/data/stk/radiation_data.fits'),
2025-10-21 08:31:14,328 log_run_info: 'stop': None}
2025-10-21 08:31:14,328 log_run_info: ******************************************
2025-10-21 08:31:14,330 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2025-10-21 08:31:14,348 get_evts_perigee: Getting perigee events between 2025:280:12:31:14.329 and 2025:294:12:31:14.329
2025-10-21 08:31:15,997 _get_tlm: Getting telemetry for 2025:293:17:24:20.673
2025-10-21 08:31:16,283 get_evts_perigee: No TLM found for perigee event at 2025:293:17:24:20.673, skipping
2025-10-21 08:31:16,283 get_evts_perigee: Found 0 new perigee event(s)
2025-10-21 08:31:16,283 main: No new perigee events, exiting
2025-10-21 08:31:20,303 get_manvrs_perigee: Getting maneuvers from 2025:249:12:31:20.302 to 2025:293:12:31:20.302
2025-10-21 08:31:24,258 get_manvrs_perigee: Getting intervals of Earth blocks from 2025:249:12:31:20.302 to 2025:293:12:31:20.302
2025-10-21 08:31:33,802 get_manvrs_perigee: Excluding Earth block from 2025:253:12:44:36.305 to 2025:253:12:48:27.955
2025-10-21 08:31:33,802 get_manvrs_perigee: Excluding Earth block from 2025:255:00:04:27.538 to 2025:255:00:09:17.613
2025-10-21 08:31:33,802 get_manvrs_perigee: Excluding Earth block from 2025:255:04:14:31.489 to 2025:255:04:17:03.189
2025-10-21 08:31:33,802 get_manvrs_perigee: Excluding Earth block from 2025:256:15:51:19.522 to 2025:256:16:44:39.573
2025-10-21 08:31:33,802 get_manvrs_perigee: Excluding Earth block from 2025:260:06:31:39.793 to 2025:260:06:33:32.543
2025-10-21 08:31:33,802 get_manvrs_perigee: Excluding Earth block from 2025:264:11:39:34.692 to 2025:264:11:51:26.042
2025-10-21 08:31:33,802 get_manvrs_perigee: Excluding Earth block from 2025:267:08:17:06.358 to 2025:267:08:24:58.883
2025-10-21 08:31:33,803 get_manvrs_perigee: Excluding Earth block from 2025:275:19:44:43.207 to 2025:275:19:47:43.607
2025-10-21 08:31:33,803 get_manvrs_perigee: Excluding Earth block from 2025:280:03:52:15.982 to 2025:280:03:59:16.232
2025-10-21 08:31:33,803 get_manvrs_perigee: Excluding Earth block from 2025:280:05:06:09.107 to 2025:280:05:12:57.057
2025-10-21 08:31:33,803 get_manvrs_perigee: Excluding Earth block from 2025:280:13:04:36.284 to 2025:280:13:14:36.934
2025-10-21 08:31:33,803 get_manvrs_perigee: Excluding Earth block from 2025:286:06:25:29.142 to 2025:286:06:30:30.492
2025-10-21 08:31:33,872 get_mon_dataset: Getting MON data from 2025:251:08:19:25.592 to 2025:251:08:40:56.067
2025-10-21 08:31:33,873 get_aca_images_cached: Getting ACA images from 2025:251:08:19:25.592 to 2025:251:08:40:56.067
2025-10-21 08:31:34,074 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2025-10-21 08:33:48,951 get_mon_dataset: Getting MON data from 2025:253:23:53:18.907 to 2025:254:00:25:41.282
2025-10-21 08:33:48,951 get_aca_images_cached: Getting ACA images from 2025:253:23:53:18.907 to 2025:254:00:25:41.282
2025-10-21 08:33:49,169 get_mon_dataset: Getting MON data from 2025:256:15:50:00.597 to 2025:256:15:51:19.522
2025-10-21 08:33:49,169 get_aca_images_cached: Getting ACA images from 2025:256:15:50:00.597 to 2025:256:15:51:19.522
2025-10-21 08:33:49,311 get_mon_dataset: Getting MON data from 2025:256:16:44:39.573 to 2025:256:16:45:25.698
2025-10-21 08:33:49,311 get_aca_images_cached: Getting ACA images from 2025:256:16:44:39.573 to 2025:256:16:45:25.698
2025-10-21 08:33:49,332 get_mon_dataset: Not enough images for slot 0 found 9)
2025-10-21 08:33:49,332 get_mon_dataset: Not enough images for slot 1 found 9)
2025-10-21 08:33:49,333 get_mon_dataset: Not enough images for slot 2 found 9)
2025-10-21 08:33:49,334 get_mon_dataset: Not enough images for slot 3 found 9)
2025-10-21 08:33:49,335 get_mon_dataset: Not enough images for slot 4 found 9)
2025-10-21 08:33:49,336 get_mon_dataset: Not enough images for slot 5 found 9)
2025-10-21 08:33:49,336 get_mon_dataset: Not enough images for slot 6 found 9)
2025-10-21 08:33:49,337 get_mon_dataset: Not enough images for slot 7 found 9)
2025-10-21 08:33:49,338 get_mon_dataset: Getting MON data from 2025:256:17:13:43.098 to 2025:256:17:55:55.873
2025-10-21 08:33:49,338 get_aca_images_cached: Getting ACA images from 2025:256:17:13:43.098 to 2025:256:17:55:55.873
2025-10-21 08:33:50,035 get_mon_dataset: Getting MON data from 2025:256:18:28:41.823 to 2025:256:19:05:55.298
2025-10-21 08:33:50,035 get_aca_images_cached: Getting ACA images from 2025:256:18:28:41.823 to 2025:256:19:05:55.298
2025-10-21 08:33:50,310 get_mon_dataset: Getting MON data from 2025:259:07:00:52.212 to 2025:259:07:30:56.213
2025-10-21 08:33:50,310 get_aca_images_cached: Getting ACA images from 2025:259:07:00:52.212 to 2025:259:07:30:56.213
2025-10-21 08:33:50,528 get_mon_dataset: Getting MON data from 2025:259:08:20:05.138 to 2025:259:08:45:55.963
2025-10-21 08:33:50,528 get_aca_images_cached: Getting ACA images from 2025:259:08:20:05.138 to 2025:259:08:45:55.963
2025-10-21 08:33:50,709 get_mon_dataset: Getting MON data from 2025:261:22:25:11.528 to 2025:261:22:55:55.503
2025-10-21 08:33:50,709 get_aca_images_cached: Getting ACA images from 2025:261:22:25:11.528 to 2025:261:22:55:55.503
2025-10-21 08:33:51,158 get_mon_dataset: Getting MON data from 2025:261:23:50:12.953 to 2025:262:00:15:55.578
2025-10-21 08:33:51,158 get_aca_images_cached: Getting ACA images from 2025:261:23:50:12.953 to 2025:262:00:15:55.578
2025-10-21 08:33:51,601 get_mon_dataset: Getting MON data from 2025:264:13:56:23.918 to 2025:264:14:25:56.143
2025-10-21 08:33:51,601 get_aca_images_cached: Getting ACA images from 2025:264:13:56:23.918 to 2025:264:14:25:56.143
2025-10-21 08:33:51,783 get_mon_dataset: Getting MON data from 2025:264:16:43:25.343 to 2025:264:17:05:55.268
2025-10-21 08:33:51,783 get_aca_images_cached: Getting ACA images from 2025:264:16:43:25.343 to 2025:264:17:05:55.268
2025-10-21 08:33:51,958 get_mon_dataset: Getting MON data from 2025:267:05:33:11.483 to 2025:267:05:55:55.758
2025-10-21 08:33:51,958 get_aca_images_cached: Getting ACA images from 2025:267:05:33:11.483 to 2025:267:05:55:55.758
2025-10-21 08:33:52,133 get_mon_dataset: Getting MON data from 2025:267:08:12:56.258 to 2025:267:08:17:06.358
2025-10-21 08:33:52,133 get_aca_images_cached: Getting ACA images from 2025:267:08:12:56.258 to 2025:267:08:17:06.358
2025-10-21 08:33:52,283 get_mon_dataset: Getting MON data from 2025:267:08:24:58.883 to 2025:267:08:35:55.908
2025-10-21 08:33:52,283 get_aca_images_cached: Getting ACA images from 2025:267:08:24:58.883 to 2025:267:08:35:55.908
2025-10-21 08:33:52,456 get_mon_dataset: Getting MON data from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-10-21 08:33:52,456 get_aca_images_cached: Getting ACA images from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-10-21 08:33:52,651 get_mon_dataset: Getting MON data from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-10-21 08:33:52,651 get_aca_images_cached: Getting ACA images from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-10-21 08:33:53,097 get_mon_dataset: Getting MON data from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-10-21 08:33:53,097 get_aca_images_cached: Getting ACA images from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-10-21 08:33:53,563 get_mon_dataset: Getting MON data from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-10-21 08:33:53,563 get_aca_images_cached: Getting ACA images from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-10-21 08:33:53,974 get_mon_dataset: Getting MON data from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-10-21 08:33:53,974 get_aca_images_cached: Getting ACA images from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-10-21 08:33:54,148 get_mon_dataset: Getting MON data from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-10-21 08:33:54,148 get_aca_images_cached: Getting ACA images from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-10-21 08:33:54,615 get_mon_dataset: Getting MON data from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-10-21 08:33:54,615 get_aca_images_cached: Getting ACA images from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-10-21 08:33:54,807 get_mon_dataset: Getting MON data from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-10-21 08:33:54,807 get_aca_images_cached: Getting ACA images from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-10-21 08:33:55,357 get_mon_dataset: Getting MON data from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-10-21 08:33:55,357 get_aca_images_cached: Getting ACA images from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-10-21 08:33:55,554 get_mon_dataset: Getting MON data from 2025:288:09:34:39.629 to 2025:288:09:55:55.754
2025-10-21 08:33:55,554 get_aca_images_cached: Getting ACA images from 2025:288:09:34:39.629 to 2025:288:09:55:55.754
2025-10-21 08:33:55,739 get_mon_dataset: Getting MON data from 2025:288:11:25:14.454 to 2025:288:11:55:55.354
2025-10-21 08:33:55,739 get_aca_images_cached: Getting ACA images from 2025:288:11:25:14.454 to 2025:288:11:55:55.354
2025-10-21 08:33:55,934 get_mon_dataset: Getting MON data from 2025:291:00:19:31.194 to 2025:291:00:55:56.494
2025-10-21 08:33:55,934 get_aca_images_cached: Getting ACA images from 2025:291:00:19:31.194 to 2025:291:00:55:56.494
2025-10-21 08:33:56,141 get_mon_dataset: Getting MON data from 2025:291:02:49:30.694 to 2025:291:03:25:55.994
2025-10-21 08:33:56,141 get_aca_images_cached: Getting ACA images from 2025:291:02:49:30.694 to 2025:291:03:25:55.994
2025-10-21 08:33:56,897 get_kalman_drops_nman: processing NMAN data
2025-10-21 08:33:56,921 get_kalman_drops_nman: Skipping NMAN from 2025:256:15:50:00.597 to 2025:256:15:51:19.522 due to insufficient monitor window data within 100 minutes of perigee
2025-10-21 08:33:56,939 get_kalman_drops_nman: Skipping NMAN from 2025:256:18:28:41.823 to 2025:256:19:05:55.298 due to insufficient monitor window data within 100 minutes of perigee
2025-10-21 08:33:57,009 get_kalman_drops_nman: Skipping NMAN from 2025:267:08:12:56.258 to 2025:267:08:17:06.358 due to insufficient monitor window data within 100 minutes of perigee
2025-10-21 08:33:57,014 get_kalman_drops_nman: Skipping NMAN from 2025:267:08:24:58.883 to 2025:267:08:35:55.908 due to insufficient monitor window data within 100 minutes of perigee
2025-10-21 07:33:57,448 _get_tlm: Getting telemetry for 2025:251:09:57:21.199
2025-10-21 07:33:57,724 obss: Getting observations from kadi commands for 2025/Sep-08
2025-10-21 07:33:57,739 _get_tlm: Getting telemetry for 2025:254:01:24:49.255
2025-10-21 07:33:57,999 obss: Getting observations from kadi commands for 2025/Sep-11
2025-10-21 07:33:58,013 _get_tlm: Getting telemetry for 2025:256:16:53:25.299
2025-10-21 07:33:58,251 obss: Getting observations from kadi commands for 2025/Sep-13
2025-10-21 07:33:58,261 _get_tlm: Getting telemetry for 2025:259:08:22:25.618
2025-10-21 07:33:58,515 obss: Getting observations from kadi commands for 2025/Sep-16
2025-10-21 07:33:58,528 _get_tlm: Getting telemetry for 2025:261:23:50:55.193
2025-10-21 07:33:58,772 obss: Getting observations from kadi commands for 2025/Sep-18
2025-10-21 07:33:58,784 _get_tlm: Getting telemetry for 2025:264:15:18:40.928
2025-10-21 07:33:59,033 obss: Getting observations from kadi commands for 2025/Sep-21
2025-10-21 07:33:59,046 _get_tlm: Getting telemetry for 2025:267:06:46:04.296
2025-10-21 07:33:59,285 obss: Getting observations from kadi commands for 2025/Sep-24
2025-10-21 07:33:59,298 _get_tlm: Getting telemetry for 2025:269:22:13:27.704
2025-10-21 07:33:59,548 obss: Getting observations from kadi commands for 2025/Sep-26
2025-10-21 07:33:59,561 _get_tlm: Getting telemetry for 2025:272:13:41:09.383
2025-10-21 07:33:59,804 obss: Getting observations from kadi commands for 2025/Sep-29
2025-10-21 07:33:59,820 _get_tlm: Getting telemetry for 2025:275:05:08:45.990
2025-10-21 07:34:00,084 obss: Getting observations from kadi commands for 2025/Oct-02
2025-10-21 07:34:00,098 _get_tlm: Getting telemetry for 2025:277:20:35:43.686
2025-10-21 07:34:00,342 obss: Getting observations from kadi commands for 2025/Oct-04
2025-10-21 07:34:00,359 _get_tlm: Getting telemetry for 2025:280:12:02:48.870
2025-10-21 07:34:00,629 obss: Getting observations from kadi commands for 2025/Oct-07
2025-10-21 07:34:00,644 _get_tlm: Getting telemetry for 2025:283:03:31:06.093
2025-10-21 07:34:00,904 obss: Getting observations from kadi commands for 2025/Oct-10
2025-10-21 07:34:00,919 _get_tlm: Getting telemetry for 2025:285:19:00:07.176
2025-10-21 07:34:01,261 obss: Getting observations from kadi commands for 2025/Oct-12
2025-10-21 07:34:01,276 _get_tlm: Getting telemetry for 2025:288:10:28:48.952
2025-10-21 07:34:01,594 obss: Getting observations from kadi commands for 2025/Oct-15
2025-10-21 07:34:01,608 _get_tlm: Getting telemetry for 2025:291:01:56:50.217
2025-10-21 07:34:01,913 obss: Getting observations from kadi commands for 2025/Oct-18
2025-10-21 07:34:01,924 _get_tlm: Getting telemetry for 2025:293:17:24:20.673
2025-10-21 07:34:02,163 get_kalman_drops_npnt: No telemetry for perigee 2025:293:17:24:20.673
2025-10-21 07:34:14,514 get_color_marker_for_perigee_plotly: Perigee 2025:251:09:57:21.199 color='rgb(229, 134, 6)' marker='circle'
2025-10-21 07:34:14,514 get_color_marker_for_perigee_plotly: Perigee 2025:254:01:24:49.255 color='rgb(93, 105, 177)' marker='square'
2025-10-21 07:34:14,514 get_color_marker_for_perigee_plotly: Perigee 2025:256:16:53:25.299 color='rgb(82, 188, 163)' marker='diamond'
2025-10-21 07:34:14,514 get_color_marker_for_perigee_plotly: Perigee 2025:259:08:22:25.618 color='rgb(153, 201, 69)' marker='triangle-up'
2025-10-21 07:34:14,515 get_color_marker_for_perigee_plotly: Perigee 2025:261:23:50:55.193 color='rgb(204, 97, 176)' marker='triangle-down'
2025-10-21 07:34:14,515 get_color_marker_for_perigee_plotly: Perigee 2025:264:15:18:40.928 color='rgb(36, 121, 108)' marker='triangle-left'
2025-10-21 07:34:14,515 get_color_marker_for_perigee_plotly: Perigee 2025:267:06:46:04.296 color='rgb(218, 165, 27)' marker='triangle-right'
2025-10-21 07:34:14,515 get_color_marker_for_perigee_plotly: Perigee 2025:269:22:13:27.704 color='rgb(47, 138, 196)' marker='circle'
2025-10-21 07:34:14,515 get_color_marker_for_perigee_plotly: Perigee 2025:272:13:41:09.383 color='rgb(118, 78, 159)' marker='square'
2025-10-21 07:34:14,516 get_color_marker_for_perigee_plotly: Perigee 2025:275:05:08:45.990 color='rgb(237, 100, 90)' marker='diamond'
2025-10-21 07:34:14,516 get_color_marker_for_perigee_plotly: Perigee 2025:277:20:35:43.686 color='rgb(165, 170, 153)' marker='triangle-up'
2025-10-21 07:34:14,516 get_color_marker_for_perigee_plotly: Perigee 2025:280:12:02:48.870 color='rgb(229, 134, 6)' marker='triangle-down'
2025-10-21 07:34:14,516 get_color_marker_for_perigee_plotly: Perigee 2025:283:03:31:06.093 color='rgb(93, 105, 177)' marker='triangle-left'
2025-10-21 07:34:14,516 get_color_marker_for_perigee_plotly: Perigee 2025:285:19:00:07.176 color='rgb(82, 188, 163)' marker='triangle-right'
2025-10-21 07:34:14,517 get_color_marker_for_perigee_plotly: Perigee 2025:288:10:28:48.952 color='rgb(153, 201, 69)' marker='circle'
2025-10-21 07:34:14,517 get_color_marker_for_perigee_plotly: Perigee 2025:291:01:56:50.217 color='rgb(204, 97, 176)' marker='square'
2025-10-21 07:34:14,517 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2025-10-21 07:34:14,564 plot_mon_win_and_aokalstr_composite_plotly: Skipping prediction for 2025:293:17:24:20.673 because there is no observed data
2025-10-21 07:34:14,996 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2025-10-21 08:34:17,372 main: Overriding starting time with the time of latest low-kalman event
2025-10-21 08:34:17,372 get_lowkals_new: Getting telemetry between 2025:291:11:26:47.181 and 2025:294:12:34:17.365
2025-10-21 08:34:17,658 get_lowkals_new: Finding intervals of low kalman stars
2025-10-21 08:34:17,685 get_lowkals_new: Last telemetry date: 2025:292:18:35:17.584
2025-10-21 08:34:17,689 main: Updating events file /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2025-10-21 08:34:17,855 make_web_page: Writing HTML to /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/index.html
2025:291:11:26:47.181 2025:294:12:34:17.365