Prev
Index
Next
kalman_watch3: Wed Oct 15 08:34:40 2025
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
OK
|
0.09 | 1.0 |
Wed Oct 15 08:34:40 2025 |
No errors
File contents:
2025-10-15 08:31:19,071 log_run_info: ******************************************
2025-10-15 08:31:19,071 log_run_info: Running: /proj/sot/ska3/aca/lib/python3.12/site-packages/kalman_watch/kalman_perigee_mon.py
2025-10-15 08:31:19,071 log_run_info: Version: 0.6.1
2025-10-15 08:31:19,071 log_run_info: Time: Wed Oct 15 08:31:19 2025
2025-10-15 08:31:19,071 log_run_info: User: aca
2025-10-15 08:31:19,071 log_run_info: Machine: kady.cfa.harvard.edu
2025-10-15 08:31:19,071 log_run_info: Processing args:
2025-10-15 08:31:19,071 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca/www/ASPECT/kalman_watch3'),
2025-10-15 08:31:19,071 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2025-10-15 08:31:19,071 log_run_info: 'lookback': 14,
2025-10-15 08:31:19,071 log_run_info: 'make_html': True,
2025-10-15 08:31:19,071 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca/data/stk/radiation_data.fits'),
2025-10-15 08:31:19,071 log_run_info: 'stop': None}
2025-10-15 08:31:19,071 log_run_info: ******************************************
2025-10-15 08:31:19,073 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2025-10-15 08:31:19,091 get_evts_perigee: Getting perigee events between 2025:274:12:31:19.072 and 2025:288:12:31:19.072
2025-10-15 08:31:22,250 _get_tlm: Getting telemetry for 2025:288:10:28:48.952
2025-10-15 08:31:23,187 get_evts_perigee: No TLM found for perigee event at 2025:288:10:28:48.952, skipping
2025-10-15 08:31:23,187 get_evts_perigee: Found 0 new perigee event(s)
2025-10-15 08:31:23,187 main: No new perigee events, exiting
2025-10-15 08:31:32,668 get_manvrs_perigee: Getting maneuvers from 2025:243:12:31:32.667 to 2025:287:12:31:32.668
2025-10-15 08:31:37,695 get_manvrs_perigee: Getting intervals of Earth blocks from 2025:243:12:31:32.667 to 2025:287:12:31:32.668
2025-10-15 08:31:45,173 get_manvrs_perigee: Excluding Earth block from 2025:244:20:16:31.755 to 2025:244:20:18:05.030
2025-10-15 08:31:45,173 get_manvrs_perigee: Excluding Earth block from 2025:246:02:19:06.687 to 2025:246:03:04:31.137
2025-10-15 08:31:45,173 get_manvrs_perigee: Excluding Earth block from 2025:253:12:44:36.305 to 2025:253:12:48:27.955
2025-10-15 08:31:45,173 get_manvrs_perigee: Excluding Earth block from 2025:255:00:04:27.538 to 2025:255:00:09:17.613
2025-10-15 08:31:45,173 get_manvrs_perigee: Excluding Earth block from 2025:255:04:14:31.489 to 2025:255:04:17:03.189
2025-10-15 08:31:45,173 get_manvrs_perigee: Excluding Earth block from 2025:256:15:51:19.522 to 2025:256:16:44:39.573
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:260:06:31:39.793 to 2025:260:06:33:32.543
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:264:11:39:34.692 to 2025:264:11:51:26.042
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:267:08:17:06.358 to 2025:267:08:24:58.883
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:275:19:44:43.207 to 2025:275:19:47:43.607
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:280:03:52:15.982 to 2025:280:03:59:16.232
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:280:05:06:09.107 to 2025:280:05:12:57.057
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:280:13:04:36.284 to 2025:280:13:14:36.934
2025-10-15 08:31:45,174 get_manvrs_perigee: Excluding Earth block from 2025:286:06:25:29.142 to 2025:286:06:30:30.492
2025-10-15 08:31:45,243 get_mon_dataset: Getting MON data from 2025:246:01:22:07.287 to 2025:246:01:55:55.762
2025-10-15 08:31:45,243 get_aca_images_cached: Getting ACA images from 2025:246:01:22:07.287 to 2025:246:01:55:55.762
2025-10-15 08:31:45,473 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2025-10-15 08:34:01,211 get_mon_dataset: Getting MON data from 2025:246:02:15:40.662 to 2025:246:02:19:06.687
2025-10-15 08:34:01,211 get_aca_images_cached: Getting ACA images from 2025:246:02:15:40.662 to 2025:246:02:19:06.687
2025-10-15 08:34:01,405 get_mon_dataset: Getting MON data from 2025:246:03:04:31.137 to 2025:246:03:05:46.987
2025-10-15 08:34:01,405 get_aca_images_cached: Getting ACA images from 2025:246:03:04:31.137 to 2025:246:03:05:46.987
2025-10-15 08:34:01,663 get_mon_dataset: Getting MON data from 2025:246:03:25:31.887 to 2025:246:03:56:02.537
2025-10-15 08:34:01,663 get_aca_images_cached: Getting ACA images from 2025:246:03:25:31.887 to 2025:246:03:56:02.537
2025-10-15 08:34:01,868 get_mon_dataset: Getting MON data from 2025:248:18:55:26.377 to 2025:248:19:25:56.003
2025-10-15 08:34:01,868 get_aca_images_cached: Getting ACA images from 2025:248:18:55:26.377 to 2025:248:19:25:56.003
2025-10-15 08:34:02,065 get_mon_dataset: Getting MON data from 2025:251:08:19:25.592 to 2025:251:08:40:56.067
2025-10-15 08:34:02,065 get_aca_images_cached: Getting ACA images from 2025:251:08:19:25.592 to 2025:251:08:40:56.067
2025-10-15 08:34:02,261 get_mon_dataset: Getting MON data from 2025:253:23:53:18.907 to 2025:254:00:25:41.282
2025-10-15 08:34:02,261 get_aca_images_cached: Getting ACA images from 2025:253:23:53:18.907 to 2025:254:00:25:41.282
2025-10-15 08:34:02,465 get_mon_dataset: Getting MON data from 2025:256:15:50:00.597 to 2025:256:15:51:19.522
2025-10-15 08:34:02,465 get_aca_images_cached: Getting ACA images from 2025:256:15:50:00.597 to 2025:256:15:51:19.522
2025-10-15 08:34:02,631 get_mon_dataset: Getting MON data from 2025:256:16:44:39.573 to 2025:256:16:45:25.698
2025-10-15 08:34:02,631 get_aca_images_cached: Getting ACA images from 2025:256:16:44:39.573 to 2025:256:16:45:25.698
2025-10-15 08:34:02,668 get_mon_dataset: Not enough images for slot 0 found 9)
2025-10-15 08:34:02,669 get_mon_dataset: Not enough images for slot 1 found 9)
2025-10-15 08:34:02,670 get_mon_dataset: Not enough images for slot 2 found 9)
2025-10-15 08:34:02,671 get_mon_dataset: Not enough images for slot 3 found 9)
2025-10-15 08:34:02,672 get_mon_dataset: Not enough images for slot 4 found 9)
2025-10-15 08:34:02,673 get_mon_dataset: Not enough images for slot 5 found 9)
2025-10-15 08:34:02,674 get_mon_dataset: Not enough images for slot 6 found 9)
2025-10-15 08:34:02,674 get_mon_dataset: Not enough images for slot 7 found 9)
2025-10-15 08:34:02,675 get_mon_dataset: Getting MON data from 2025:256:17:13:43.098 to 2025:256:17:55:55.873
2025-10-15 08:34:02,675 get_aca_images_cached: Getting ACA images from 2025:256:17:13:43.098 to 2025:256:17:55:55.873
2025-10-15 08:34:03,433 get_mon_dataset: Getting MON data from 2025:256:18:28:41.823 to 2025:256:19:05:55.298
2025-10-15 08:34:03,433 get_aca_images_cached: Getting ACA images from 2025:256:18:28:41.823 to 2025:256:19:05:55.298
2025-10-15 08:34:03,653 get_mon_dataset: Getting MON data from 2025:259:07:00:52.212 to 2025:259:07:30:56.213
2025-10-15 08:34:03,653 get_aca_images_cached: Getting ACA images from 2025:259:07:00:52.212 to 2025:259:07:30:56.213
2025-10-15 08:34:03,865 get_mon_dataset: Getting MON data from 2025:259:08:20:05.138 to 2025:259:08:45:55.963
2025-10-15 08:34:03,865 get_aca_images_cached: Getting ACA images from 2025:259:08:20:05.138 to 2025:259:08:45:55.963
2025-10-15 08:34:04,063 get_mon_dataset: Getting MON data from 2025:261:22:25:11.528 to 2025:261:22:55:55.503
2025-10-15 08:34:04,064 get_aca_images_cached: Getting ACA images from 2025:261:22:25:11.528 to 2025:261:22:55:55.503
2025-10-15 08:34:04,280 get_mon_dataset: Getting MON data from 2025:261:23:50:12.953 to 2025:262:00:15:55.578
2025-10-15 08:34:04,280 get_aca_images_cached: Getting ACA images from 2025:261:23:50:12.953 to 2025:262:00:15:55.578
2025-10-15 08:34:04,479 get_mon_dataset: Getting MON data from 2025:264:13:56:23.918 to 2025:264:14:25:56.143
2025-10-15 08:34:04,480 get_aca_images_cached: Getting ACA images from 2025:264:13:56:23.918 to 2025:264:14:25:56.143
2025-10-15 08:34:04,699 get_mon_dataset: Getting MON data from 2025:264:16:43:25.343 to 2025:264:17:05:55.268
2025-10-15 08:34:04,699 get_aca_images_cached: Getting ACA images from 2025:264:16:43:25.343 to 2025:264:17:05:55.268
2025-10-15 08:34:04,901 get_mon_dataset: Getting MON data from 2025:267:05:33:11.483 to 2025:267:05:55:55.758
2025-10-15 08:34:04,901 get_aca_images_cached: Getting ACA images from 2025:267:05:33:11.483 to 2025:267:05:55:55.758
2025-10-15 08:34:05,118 get_mon_dataset: Getting MON data from 2025:267:08:12:56.258 to 2025:267:08:17:06.358
2025-10-15 08:34:05,118 get_aca_images_cached: Getting ACA images from 2025:267:08:12:56.258 to 2025:267:08:17:06.358
2025-10-15 08:34:05,321 get_mon_dataset: Getting MON data from 2025:267:08:24:58.883 to 2025:267:08:35:55.908
2025-10-15 08:34:05,321 get_aca_images_cached: Getting ACA images from 2025:267:08:24:58.883 to 2025:267:08:35:55.908
2025-10-15 08:34:05,533 get_mon_dataset: Getting MON data from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-10-15 08:34:05,533 get_aca_images_cached: Getting ACA images from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-10-15 08:34:05,836 get_mon_dataset: Getting MON data from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-10-15 08:34:05,836 get_aca_images_cached: Getting ACA images from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-10-15 08:34:06,067 get_mon_dataset: Getting MON data from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-10-15 08:34:06,067 get_aca_images_cached: Getting ACA images from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-10-15 08:34:06,279 get_mon_dataset: Getting MON data from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-10-15 08:34:06,279 get_aca_images_cached: Getting ACA images from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-10-15 08:34:06,711 get_mon_dataset: Getting MON data from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-10-15 08:34:06,711 get_aca_images_cached: Getting ACA images from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-10-15 08:34:06,905 get_mon_dataset: Getting MON data from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-10-15 08:34:06,905 get_aca_images_cached: Getting ACA images from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-10-15 08:34:07,108 get_mon_dataset: Getting MON data from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-10-15 08:34:07,108 get_aca_images_cached: Getting ACA images from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-10-15 08:34:07,681 get_mon_dataset: Getting MON data from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-10-15 08:34:07,681 get_aca_images_cached: Getting ACA images from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-10-15 08:34:08,096 get_mon_dataset: Getting MON data from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-10-15 08:34:08,097 get_aca_images_cached: Getting ACA images from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-10-15 08:34:08,334 get_kalman_drops_nman: processing NMAN data
2025-10-15 08:34:08,352 get_kalman_drops_nman: Skipping NMAN from 2025:246:02:15:40.662 to 2025:246:02:19:06.687 due to insufficient monitor window data within 100 minutes of perigee
2025-10-15 08:34:08,356 get_kalman_drops_nman: Skipping NMAN from 2025:246:03:04:31.137 to 2025:246:03:05:46.987 due to insufficient monitor window data within 100 minutes of perigee
2025-10-15 08:34:08,400 get_kalman_drops_nman: Skipping NMAN from 2025:256:15:50:00.597 to 2025:256:15:51:19.522 due to insufficient monitor window data within 100 minutes of perigee
2025-10-15 08:34:08,418 get_kalman_drops_nman: Skipping NMAN from 2025:256:18:28:41.823 to 2025:256:19:05:55.298 due to insufficient monitor window data within 100 minutes of perigee
2025-10-15 08:34:08,487 get_kalman_drops_nman: Skipping NMAN from 2025:267:08:12:56.258 to 2025:267:08:17:06.358 due to insufficient monitor window data within 100 minutes of perigee
2025-10-15 08:34:08,493 get_kalman_drops_nman: Skipping NMAN from 2025:267:08:24:58.883 to 2025:267:08:35:55.908 due to insufficient monitor window data within 100 minutes of perigee
2025-10-15 07:34:08,901 _get_tlm: Getting telemetry for 2025:243:11:35:22.122
2025-10-15 07:34:09,946 obss: Getting observations from kadi commands for 2025/Aug-31
2025-10-15 07:34:09,963 _get_tlm: Getting telemetry for 2025:246:03:03:07.322
2025-10-15 07:34:10,315 obss: Getting observations from kadi commands for 2025/Sep-03
2025-10-15 07:34:10,325 _get_tlm: Getting telemetry for 2025:248:18:30:31.502
2025-10-15 07:34:10,686 obss: Getting observations from kadi commands for 2025/Sep-05
2025-10-15 07:34:10,700 _get_tlm: Getting telemetry for 2025:251:09:57:21.199
2025-10-15 07:34:11,009 obss: Getting observations from kadi commands for 2025/Sep-08
2025-10-15 07:34:11,024 _get_tlm: Getting telemetry for 2025:254:01:24:49.255
2025-10-15 07:34:11,322 obss: Getting observations from kadi commands for 2025/Sep-11
2025-10-15 07:34:11,336 _get_tlm: Getting telemetry for 2025:256:16:53:25.299
2025-10-15 07:34:11,768 obss: Getting observations from kadi commands for 2025/Sep-13
2025-10-15 07:34:11,779 _get_tlm: Getting telemetry for 2025:259:08:22:25.618
2025-10-15 07:34:12,104 obss: Getting observations from kadi commands for 2025/Sep-16
2025-10-15 07:34:12,117 _get_tlm: Getting telemetry for 2025:261:23:50:55.193
2025-10-15 07:34:12,443 obss: Getting observations from kadi commands for 2025/Sep-18
2025-10-15 07:34:12,456 _get_tlm: Getting telemetry for 2025:264:15:18:40.928
2025-10-15 07:34:12,783 obss: Getting observations from kadi commands for 2025/Sep-21
2025-10-15 07:34:12,796 _get_tlm: Getting telemetry for 2025:267:06:46:04.296
2025-10-15 07:34:13,611 obss: Getting observations from kadi commands for 2025/Sep-24
2025-10-15 07:34:13,625 _get_tlm: Getting telemetry for 2025:269:22:13:27.704
2025-10-15 07:34:13,947 obss: Getting observations from kadi commands for 2025/Sep-26
2025-10-15 07:34:13,959 _get_tlm: Getting telemetry for 2025:272:13:41:09.383
2025-10-15 07:34:14,291 obss: Getting observations from kadi commands for 2025/Sep-29
2025-10-15 07:34:14,308 _get_tlm: Getting telemetry for 2025:275:05:08:45.990
2025-10-15 07:34:14,644 obss: Getting observations from kadi commands for 2025/Oct-02
2025-10-15 07:34:14,658 _get_tlm: Getting telemetry for 2025:277:20:35:43.686
2025-10-15 07:34:14,957 obss: Getting observations from kadi commands for 2025/Oct-04
2025-10-15 07:34:14,975 _get_tlm: Getting telemetry for 2025:280:12:02:48.870
2025-10-15 07:34:15,246 obss: Getting observations from kadi commands for 2025/Oct-07
2025-10-15 07:34:15,261 _get_tlm: Getting telemetry for 2025:283:03:31:06.093
2025-10-15 07:34:15,508 obss: Getting observations from kadi commands for 2025/Oct-10
2025-10-15 07:34:15,521 _get_tlm: Getting telemetry for 2025:285:19:00:07.176
2025-10-15 07:34:15,755 obss: Getting observations from kadi commands for 2025/Oct-12
2025-10-15 07:34:35,262 get_color_marker_for_perigee_plotly: Perigee 2025:243:11:35:22.122 color='rgb(229, 134, 6)' marker='circle'
2025-10-15 07:34:35,262 get_color_marker_for_perigee_plotly: Perigee 2025:246:03:03:07.322 color='rgb(93, 105, 177)' marker='square'
2025-10-15 07:34:35,263 get_color_marker_for_perigee_plotly: Perigee 2025:248:18:30:31.502 color='rgb(82, 188, 163)' marker='diamond'
2025-10-15 07:34:35,263 get_color_marker_for_perigee_plotly: Perigee 2025:251:09:57:21.199 color='rgb(153, 201, 69)' marker='triangle-up'
2025-10-15 07:34:35,263 get_color_marker_for_perigee_plotly: Perigee 2025:254:01:24:49.255 color='rgb(204, 97, 176)' marker='triangle-down'
2025-10-15 07:34:35,263 get_color_marker_for_perigee_plotly: Perigee 2025:256:16:53:25.299 color='rgb(36, 121, 108)' marker='triangle-left'
2025-10-15 07:34:35,263 get_color_marker_for_perigee_plotly: Perigee 2025:259:08:22:25.618 color='rgb(218, 165, 27)' marker='triangle-right'
2025-10-15 07:34:35,264 get_color_marker_for_perigee_plotly: Perigee 2025:261:23:50:55.193 color='rgb(47, 138, 196)' marker='circle'
2025-10-15 07:34:35,264 get_color_marker_for_perigee_plotly: Perigee 2025:264:15:18:40.928 color='rgb(118, 78, 159)' marker='square'
2025-10-15 07:34:35,264 get_color_marker_for_perigee_plotly: Perigee 2025:267:06:46:04.296 color='rgb(237, 100, 90)' marker='diamond'
2025-10-15 07:34:35,264 get_color_marker_for_perigee_plotly: Perigee 2025:269:22:13:27.704 color='rgb(165, 170, 153)' marker='triangle-up'
2025-10-15 07:34:35,264 get_color_marker_for_perigee_plotly: Perigee 2025:272:13:41:09.383 color='rgb(229, 134, 6)' marker='triangle-down'
2025-10-15 07:34:35,265 get_color_marker_for_perigee_plotly: Perigee 2025:275:05:08:45.990 color='rgb(93, 105, 177)' marker='triangle-left'
2025-10-15 07:34:35,265 get_color_marker_for_perigee_plotly: Perigee 2025:277:20:35:43.686 color='rgb(82, 188, 163)' marker='triangle-right'
2025-10-15 07:34:35,265 get_color_marker_for_perigee_plotly: Perigee 2025:280:12:02:48.870 color='rgb(153, 201, 69)' marker='circle'
2025-10-15 07:34:35,265 get_color_marker_for_perigee_plotly: Perigee 2025:283:03:31:06.093 color='rgb(204, 97, 176)' marker='square'
2025-10-15 07:34:35,265 get_color_marker_for_perigee_plotly: Perigee 2025:285:19:00:07.176 color='rgb(36, 121, 108)' marker='diamond'
2025-10-15 07:34:35,266 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2025-10-15 07:34:37,069 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2025-10-15 08:34:39,549 main: Overriding starting time with the time of latest low-kalman event
2025-10-15 08:34:39,550 get_lowkals_new: Getting telemetry between 2025:287:02:54:52.753 and 2025:288:12:34:39.540
2025-10-15 08:34:39,841 get_lowkals_new: Finding intervals of low kalman stars
2025-10-15 08:34:39,855 get_lowkals_new: Last telemetry date: 2025:287:18:58:39.159
2025-10-15 08:34:39,859 main: Updating events file /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2025-10-15 08:34:40,347 make_web_page: Writing HTML to /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/index.html
2025:287:02:54:52.753 2025:288:12:34:39.540