Prev
Index
Next
kalman_watch3: Thu Oct 1 08:34:41 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
OK
|
0.09 | 1.0 |
Thu Oct 1 08:34:41 2026 |
No errors
File contents:
2026-10-01 08:31:23,398 log_run_info: ******************************************
2026-10-01 08:31:23,398 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-10-01 08:31:23,398 log_run_info: Version: 0.6.2
2026-10-01 08:31:23,398 log_run_info: Time: Thu Oct 1 08:31:23 2026
2026-10-01 08:31:23,398 log_run_info: User: aca
2026-10-01 08:31:23,398 log_run_info: Machine: kady.cfa.harvard.edu
2026-10-01 08:31:23,398 log_run_info: Processing args:
2026-10-01 08:31:23,398 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-10-01 08:31:23,398 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-10-01 08:31:23,398 log_run_info: 'lookback': 14,
2026-10-01 08:31:23,398 log_run_info: 'make_html': True,
2026-10-01 08:31:23,398 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-10-01 08:31:23,398 log_run_info: 'stop': None}
2026-10-01 08:31:23,398 log_run_info: ******************************************
2026-10-01 08:31:23,402 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-10-01 08:31:23,443 get_evts_perigee: Getting perigee events between 2026:260:12:31:23.399 and 2026:274:12:31:23.399
2026-10-01 08:31:27,324 get_evts_perigee: Found 0 new perigee event(s)
2026-10-01 08:31:27,324 main: No new perigee events, exiting
2026-10-01 08:31:38,441 get_manvrs_perigee: Getting maneuvers from 2026:229:12:31:38.440 to 2026:273:12:31:38.441
2026-10-01 08:31:45,773 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:229:12:31:38.440 to 2026:273:12:31:38.441
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:238:09:06:46.461 to 2026:238:09:10:40.161
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:238:13:36:24.037 to 2026:238:13:40:24.912
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:248:20:23:48.471 to 2026:248:20:30:36.421
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:248:22:19:53.347 to 2026:248:22:26:51.547
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:249:02:39:53.848 to 2026:249:02:45:04.423
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:251:22:20:48.664 to 2026:251:22:26:46.389
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:253:04:33:07.846 to 2026:253:04:38:51.221
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:255:05:16:10.483 to 2026:255:05:21:27.208
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:255:10:00:19.309 to 2026:255:10:04:37.609
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:256:17:18:38.067 to 2026:256:17:28:21.292
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:257:05:23:07.295 to 2026:257:05:28:30.170
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:257:08:50:52.320 to 2026:257:08:56:38.770
2026-10-01 08:31:51,889 get_manvrs_perigee: Excluding Earth block from 2026:257:12:31:03.546 to 2026:257:12:36:15.146
2026-10-01 08:31:51,890 get_manvrs_perigee: Excluding Earth block from 2026:257:16:02:34.072 to 2026:257:16:06:46.222
2026-10-01 08:31:51,890 get_manvrs_perigee: Excluding Earth block from 2026:261:15:43:55.070 to 2026:261:15:50:52.245
2026-10-01 08:31:51,890 get_manvrs_perigee: Excluding Earth block from 2026:266:23:05:14.526 to 2026:266:23:06:31.401
2026-10-01 08:31:51,890 get_manvrs_perigee: Excluding Earth block from 2026:267:18:43:07.256 to 2026:267:18:48:02.456
2026-10-01 08:31:51,890 get_manvrs_perigee: Excluding Earth block from 2026:269:12:43:47.041 to 2026:269:12:49:11.966
2026-10-01 08:31:51,890 get_manvrs_perigee: Excluding Earth block from 2026:273:03:17:01.937 to 2026:273:03:22:25.837
2026-10-01 08:31:51,890 get_manvrs_perigee: Excluding Earth block from 2026:273:10:59:32.788 to 2026:273:11:01:26.563
2026-10-01 08:31:51,946 get_mon_dataset: Getting MON data from 2026:230:03:17:08.213 to 2026:230:03:55:55.988
2026-10-01 08:31:51,946 get_aca_images_cached: Getting ACA images from 2026:230:03:17:08.213 to 2026:230:03:55:55.988
2026-10-01 08:31:52,505 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-10-01 08:34:17,431 get_mon_dataset: Getting MON data from 2026:232:18:45:59.154 to 2026:232:19:25:55.604
2026-10-01 08:34:17,431 get_aca_images_cached: Getting ACA images from 2026:232:18:45:59.154 to 2026:232:19:25:55.604
2026-10-01 08:34:17,660 get_mon_dataset: Getting MON data from 2026:235:10:26:53.744 to 2026:235:10:55:55.219
2026-10-01 08:34:17,660 get_aca_images_cached: Getting ACA images from 2026:235:10:26:53.744 to 2026:235:10:55:55.219
2026-10-01 08:34:17,857 get_mon_dataset: Getting MON data from 2026:235:11:34:22.494 to 2026:235:12:05:55.669
2026-10-01 08:34:17,857 get_aca_images_cached: Getting ACA images from 2026:235:11:34:22.494 to 2026:235:12:05:55.669
2026-10-01 08:34:18,057 get_mon_dataset: Getting MON data from 2026:238:01:21:28.534 to 2026:238:01:55:55.959
2026-10-01 08:34:18,057 get_aca_images_cached: Getting ACA images from 2026:238:01:21:28.534 to 2026:238:01:55:55.959
2026-10-01 08:34:18,263 get_mon_dataset: Getting MON data from 2026:240:16:42:39.249 to 2026:240:17:15:55.949
2026-10-01 08:34:18,263 get_aca_images_cached: Getting ACA images from 2026:240:16:42:39.249 to 2026:240:17:15:55.949
2026-10-01 08:34:18,464 get_mon_dataset: Getting MON data from 2026:240:19:09:09.650 to 2026:240:19:16:20.150
2026-10-01 08:34:18,464 get_aca_images_cached: Getting ACA images from 2026:240:19:09:09.650 to 2026:240:19:16:20.150
2026-10-01 08:34:18,507 get_mon_dataset: Not enough images for slot 0 found 0)
2026-10-01 08:34:18,509 get_mon_dataset: Not enough images for slot 1 found 0)
2026-10-01 08:34:18,510 get_mon_dataset: Not enough images for slot 2 found 0)
2026-10-01 08:34:18,511 get_mon_dataset: Not enough images for slot 3 found 0)
2026-10-01 08:34:18,512 get_mon_dataset: Not enough images for slot 4 found 0)
2026-10-01 08:34:18,513 get_mon_dataset: Not enough images for slot 5 found 0)
2026-10-01 08:34:18,514 get_mon_dataset: Not enough images for slot 6 found 0)
2026-10-01 08:34:18,515 get_mon_dataset: Not enough images for slot 7 found 0)
2026-10-01 08:34:18,516 get_mon_dataset: Getting MON data from 2026:243:08:52:32.240 to 2026:243:09:25:56.115
2026-10-01 08:34:18,516 get_aca_images_cached: Getting ACA images from 2026:243:08:52:32.240 to 2026:243:09:25:56.115
2026-10-01 08:34:18,716 get_mon_dataset: Getting MON data from 2026:243:10:51:46.740 to 2026:243:11:25:55.715
2026-10-01 08:34:18,716 get_aca_images_cached: Getting ACA images from 2026:243:10:51:46.740 to 2026:243:11:25:55.715
2026-10-01 08:34:19,156 get_mon_dataset: Getting MON data from 2026:246:00:22:32.880 to 2026:246:00:55:55.730
2026-10-01 08:34:19,157 get_aca_images_cached: Getting ACA images from 2026:246:00:22:32.880 to 2026:246:00:55:55.730
2026-10-01 08:34:19,587 get_mon_dataset: Getting MON data from 2026:246:02:36:02.230 to 2026:246:03:10:56.306
2026-10-01 08:34:19,587 get_aca_images_cached: Getting ACA images from 2026:246:02:36:02.230 to 2026:246:03:10:56.306
2026-10-01 08:34:19,805 get_mon_dataset: Getting MON data from 2026:248:15:52:32.495 to 2026:248:16:25:56.370
2026-10-01 08:34:19,805 get_aca_images_cached: Getting ACA images from 2026:248:15:52:32.495 to 2026:248:16:25:56.370
2026-10-01 08:34:20,058 get_mon_dataset: Getting MON data from 2026:248:17:35:27.096 to 2026:248:18:10:56.021
2026-10-01 08:34:20,058 get_aca_images_cached: Getting ACA images from 2026:248:17:35:27.096 to 2026:248:18:10:56.021
2026-10-01 08:34:20,323 get_mon_dataset: Getting MON data from 2026:254:00:29:09.126 to 2026:254:00:36:20.651
2026-10-01 08:34:20,323 get_aca_images_cached: Getting ACA images from 2026:254:00:29:09.126 to 2026:254:00:36:20.651
2026-10-01 08:34:20,351 get_mon_dataset: Not enough images for slot 0 found 0)
2026-10-01 08:34:20,352 get_mon_dataset: Not enough images for slot 1 found 0)
2026-10-01 08:34:20,353 get_mon_dataset: Not enough images for slot 2 found 0)
2026-10-01 08:34:20,355 get_mon_dataset: Not enough images for slot 3 found 0)
2026-10-01 08:34:20,356 get_mon_dataset: Not enough images for slot 4 found 0)
2026-10-01 08:34:20,357 get_mon_dataset: Not enough images for slot 5 found 0)
2026-10-01 08:34:20,358 get_mon_dataset: Not enough images for slot 6 found 0)
2026-10-01 08:34:20,359 get_mon_dataset: Not enough images for slot 7 found 0)
2026-10-01 08:34:20,360 get_mon_dataset: Getting MON data from 2026:256:16:59:21.867 to 2026:256:17:18:38.067
2026-10-01 08:34:20,360 get_aca_images_cached: Getting ACA images from 2026:256:16:59:21.867 to 2026:256:17:18:38.067
2026-10-01 08:34:20,576 get_mon_dataset: Getting MON data from 2026:259:05:51:56.106 to 2026:259:06:25:55.856
2026-10-01 08:34:20,576 get_aca_images_cached: Getting ACA images from 2026:259:05:51:56.106 to 2026:259:06:25:55.856
2026-10-01 08:34:20,787 get_mon_dataset: Getting MON data from 2026:261:21:00:42.671 to 2026:261:21:40:55.522
2026-10-01 08:34:20,787 get_aca_images_cached: Getting ACA images from 2026:261:21:00:42.671 to 2026:261:21:40:55.522
2026-10-01 08:34:21,025 get_mon_dataset: Getting MON data from 2026:261:22:34:32.997 to 2026:261:23:25:56.197
2026-10-01 08:34:21,025 get_aca_images_cached: Getting ACA images from 2026:261:22:34:32.997 to 2026:261:23:25:56.197
2026-10-01 08:34:21,307 get_mon_dataset: Getting MON data from 2026:261:23:53:10.047 to 2026:262:00:00:21.572
2026-10-01 08:34:21,307 get_aca_images_cached: Getting ACA images from 2026:261:23:53:10.047 to 2026:262:00:00:21.572
2026-10-01 08:34:21,335 get_mon_dataset: Not enough images for slot 0 found 0)
2026-10-01 08:34:21,336 get_mon_dataset: Not enough images for slot 1 found 0)
2026-10-01 08:34:21,337 get_mon_dataset: Not enough images for slot 2 found 0)
2026-10-01 08:34:21,338 get_mon_dataset: Not enough images for slot 3 found 0)
2026-10-01 08:34:21,339 get_mon_dataset: Not enough images for slot 4 found 0)
2026-10-01 08:34:21,340 get_mon_dataset: Not enough images for slot 5 found 0)
2026-10-01 08:34:21,341 get_mon_dataset: Not enough images for slot 6 found 0)
2026-10-01 08:34:21,342 get_mon_dataset: Not enough images for slot 7 found 0)
2026-10-01 08:34:21,343 get_mon_dataset: Getting MON data from 2026:269:20:34:09.393 to 2026:269:20:41:19.893
2026-10-01 08:34:21,343 get_aca_images_cached: Getting ACA images from 2026:269:20:34:09.393 to 2026:269:20:41:19.893
2026-10-01 08:34:21,370 get_mon_dataset: Not enough images for slot 0 found 0)
2026-10-01 08:34:21,371 get_mon_dataset: Not enough images for slot 1 found 0)
2026-10-01 08:34:21,372 get_mon_dataset: Not enough images for slot 2 found 0)
2026-10-01 08:34:21,373 get_mon_dataset: Not enough images for slot 3 found 0)
2026-10-01 08:34:21,374 get_mon_dataset: Not enough images for slot 4 found 0)
2026-10-01 08:34:21,376 get_mon_dataset: Not enough images for slot 5 found 0)
2026-10-01 08:34:21,377 get_mon_dataset: Not enough images for slot 6 found 0)
2026-10-01 08:34:21,378 get_mon_dataset: Not enough images for slot 7 found 0)
2026-10-01 08:34:21,378 get_mon_dataset: Getting MON data from 2026:272:10:38:17.357 to 2026:272:11:07:55.733
2026-10-01 08:34:21,379 get_aca_images_cached: Getting ACA images from 2026:272:10:38:17.357 to 2026:272:11:07:55.733
2026-10-01 08:34:21,590 get_kalman_drops_nman: processing NMAN data
2026-10-01 07:34:22,416 _get_tlm: Getting telemetry for 2026:230:04:47:40.149
2026-10-01 07:34:23,065 obss: Getting observations from kadi commands for 2026/Aug-18
2026-10-01 07:34:23,079 _get_tlm: Getting telemetry for 2026:232:20:15:17.080
2026-10-01 07:34:23,455 obss: Getting observations from kadi commands for 2026/Aug-20
2026-10-01 07:34:23,468 _get_tlm: Getting telemetry for 2026:235:11:43:07.898
2026-10-01 07:34:23,791 obss: Getting observations from kadi commands for 2026/Aug-23
2026-10-01 07:34:23,803 _get_tlm: Getting telemetry for 2026:238:03:10:47.135
2026-10-01 07:34:24,096 obss: Getting observations from kadi commands for 2026/Aug-26
2026-10-01 07:34:24,111 _get_tlm: Getting telemetry for 2026:240:18:38:11.096
2026-10-01 07:34:24,382 obss: Getting observations from kadi commands for 2026/Aug-28
2026-10-01 07:34:24,396 _get_tlm: Getting telemetry for 2026:243:10:05:52.240
2026-10-01 07:34:24,694 obss: Getting observations from kadi commands for 2026/Aug-31
2026-10-01 07:34:24,706 _get_tlm: Getting telemetry for 2026:246:01:34:19.196
2026-10-01 07:34:24,978 obss: Getting observations from kadi commands for 2026/Sep-03
2026-10-01 07:34:24,990 _get_tlm: Getting telemetry for 2026:248:17:03:08.998
2026-10-01 07:34:25,307 obss: Getting observations from kadi commands for 2026/Sep-05
2026-10-01 07:34:25,318 _get_tlm: Getting telemetry for 2026:251:08:31:35.746
2026-10-01 07:34:25,862 obss: Getting observations from kadi commands for 2026/Sep-08
2026-10-01 07:34:25,878 _get_tlm: Getting telemetry for 2026:253:23:59:10.580
2026-10-01 07:34:26,166 obss: Getting observations from kadi commands for 2026/Sep-10
2026-10-01 07:34:26,181 _get_tlm: Getting telemetry for 2026:256:15:26:22.035
2026-10-01 07:34:26,454 obss: Getting observations from kadi commands for 2026/Sep-13
2026-10-01 07:34:26,470 _get_tlm: Getting telemetry for 2026:259:06:53:48.693
2026-10-01 07:34:26,745 obss: Getting observations from kadi commands for 2026/Sep-16
2026-10-01 07:34:26,759 _get_tlm: Getting telemetry for 2026:261:22:21:32.508
2026-10-01 07:34:27,032 obss: Getting observations from kadi commands for 2026/Sep-18
2026-10-01 07:34:27,042 _get_tlm: Getting telemetry for 2026:264:13:49:17.940
2026-10-01 07:34:27,394 obss: Getting observations from kadi commands for 2026/Sep-21
2026-10-01 07:34:27,410 _get_tlm: Getting telemetry for 2026:267:05:16:43.498
2026-10-01 07:34:27,743 obss: Getting observations from kadi commands for 2026/Sep-24
2026-10-01 07:34:27,759 _get_tlm: Getting telemetry for 2026:269:20:44:14.691
2026-10-01 07:34:28,018 obss: Getting observations from kadi commands for 2026/Sep-26
2026-10-01 07:34:28,034 _get_tlm: Getting telemetry for 2026:272:12:12:25.197
2026-10-01 07:34:28,302 obss: Getting observations from kadi commands for 2026/Sep-29
2026-10-01 07:34:36,236 get_color_marker_for_perigee_plotly: Perigee 2026:230:04:47:40.149 color='rgb(229, 134, 6)' marker='circle'
2026-10-01 07:34:36,236 get_color_marker_for_perigee_plotly: Perigee 2026:232:20:15:17.080 color='rgb(93, 105, 177)' marker='square'
2026-10-01 07:34:36,237 get_color_marker_for_perigee_plotly: Perigee 2026:235:11:43:07.898 color='rgb(82, 188, 163)' marker='diamond'
2026-10-01 07:34:36,237 get_color_marker_for_perigee_plotly: Perigee 2026:238:03:10:47.135 color='rgb(153, 201, 69)' marker='triangle-up'
2026-10-01 07:34:36,237 get_color_marker_for_perigee_plotly: Perigee 2026:240:18:38:11.096 color='rgb(204, 97, 176)' marker='triangle-down'
2026-10-01 07:34:36,237 get_color_marker_for_perigee_plotly: Perigee 2026:243:10:05:52.240 color='rgb(36, 121, 108)' marker='triangle-left'
2026-10-01 07:34:36,237 get_color_marker_for_perigee_plotly: Perigee 2026:246:01:34:19.196 color='rgb(218, 165, 27)' marker='triangle-right'
2026-10-01 07:34:36,238 get_color_marker_for_perigee_plotly: Perigee 2026:248:17:03:08.998 color='rgb(47, 138, 196)' marker='circle'
2026-10-01 07:34:36,238 get_color_marker_for_perigee_plotly: Perigee 2026:251:08:31:35.746 color='rgb(118, 78, 159)' marker='square'
2026-10-01 07:34:36,238 get_color_marker_for_perigee_plotly: Perigee 2026:253:23:59:10.580 color='rgb(237, 100, 90)' marker='diamond'
2026-10-01 07:34:36,238 get_color_marker_for_perigee_plotly: Perigee 2026:256:15:26:22.035 color='rgb(165, 170, 153)' marker='triangle-up'
2026-10-01 07:34:36,238 get_color_marker_for_perigee_plotly: Perigee 2026:259:06:53:48.693 color='rgb(229, 134, 6)' marker='triangle-down'
2026-10-01 07:34:36,239 get_color_marker_for_perigee_plotly: Perigee 2026:261:22:21:32.508 color='rgb(93, 105, 177)' marker='triangle-left'
2026-10-01 07:34:36,239 get_color_marker_for_perigee_plotly: Perigee 2026:264:13:49:17.940 color='rgb(82, 188, 163)' marker='triangle-right'
2026-10-01 07:34:36,239 get_color_marker_for_perigee_plotly: Perigee 2026:267:05:16:43.498 color='rgb(153, 201, 69)' marker='circle'
2026-10-01 07:34:36,239 get_color_marker_for_perigee_plotly: Perigee 2026:269:20:44:14.691 color='rgb(204, 97, 176)' marker='square'
2026-10-01 07:34:36,239 get_color_marker_for_perigee_plotly: Perigee 2026:272:12:12:25.197 color='rgb(36, 121, 108)' marker='diamond'
2026-10-01 07:34:36,240 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-10-01 07:34:36,851 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-10-01 08:34:40,559 main: Overriding starting time with the time of latest low-kalman event
2026-10-01 08:34:40,559 get_lowkals_new: Getting telemetry between 2026:273:01:57:18.768 and 2026:274:12:34:40.551
2026-10-01 08:34:40,950 get_lowkals_new: Finding intervals of low kalman stars
2026-10-01 08:34:40,974 get_lowkals_new: Last telemetry date: 2026:274:03:20:19.574
2026-10-01 08:34:40,977 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-10-01 08:34:41,392 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:273:01:57:18.768 2026:274:12:34:40.551