Prev   Index   Next

kalman_watch3: Wed Jan 7 08:34:36 2026

File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log

Task Status AgeMaxAge Last Date
kalman_watch3 OK 0.091.0 Wed Jan 7 08:34:36 2026

No errors

File contents:

2026-01-07 08:31:20,405 log_run_info: ******************************************
2026-01-07 08:31:20,405 log_run_info: Running: /proj/sot/ska3/aca/lib/python3.12/site-packages/kalman_watch/kalman_perigee_mon.py
2026-01-07 08:31:20,405 log_run_info: Version: 0.6.1
2026-01-07 08:31:20,405 log_run_info: Time: Wed Jan 7 08:31:20 2026
2026-01-07 08:31:20,405 log_run_info: User: aca
2026-01-07 08:31:20,405 log_run_info: Machine: kady.cfa.harvard.edu
2026-01-07 08:31:20,405 log_run_info: Processing args:
2026-01-07 08:31:20,405 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca/www/ASPECT/kalman_watch3'),
2026-01-07 08:31:20,405 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-01-07 08:31:20,405 log_run_info: 'lookback': 14,
2026-01-07 08:31:20,405 log_run_info: 'make_html': True,
2026-01-07 08:31:20,405 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca/data/stk/radiation_data.fits'),
2026-01-07 08:31:20,405 log_run_info: 'stop': None}
2026-01-07 08:31:20,405 log_run_info: ******************************************
2026-01-07 08:31:20,407 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-01-07 08:31:20,437 get_evts_perigee: Getting perigee events between 2025:358:13:31:20.406 and 2026:007:13:31:20.406
2026-01-07 08:31:23,469 get_evts_perigee: Found 0 new perigee event(s)
2026-01-07 08:31:23,469 main: No new perigee events, exiting
2026-01-07 08:31:27,089 get_manvrs_perigee: Getting maneuvers from 2025:327:13:31:27.088 to 2026:006:13:31:27.089
2026-01-07 08:31:30,716 get_manvrs_perigee: Getting intervals of Earth blocks from 2025:327:13:31:27.088 to 2026:006:13:31:27.089
2026-01-07 08:31:41,723 get_manvrs_perigee: Excluding Earth block from 2025:344:00:08:52.722 to 2025:344:00:23:55.747
2026-01-07 08:31:41,724 get_manvrs_perigee: Excluding Earth block from 2025:344:09:40:53.824 to 2025:344:09:44:59.824
2026-01-07 08:31:41,724 get_manvrs_perigee: Excluding Earth block from 2025:344:15:54:32.625 to 2025:344:16:00:32.400
2026-01-07 08:31:41,724 get_manvrs_perigee: Excluding Earth block from 2025:346:14:41:00.661 to 2025:346:15:25:31.812
2026-01-07 08:31:41,724 get_manvrs_perigee: Excluding Earth block from 2025:349:01:28:47.275 to 2025:349:01:31:53.826
2026-01-07 08:31:41,724 get_manvrs_perigee: Excluding Earth block from 2025:353:08:48:24.925 to 2025:353:08:54:59.550
2026-01-07 08:31:41,724 get_manvrs_perigee: Excluding Earth block from 2025:362:04:28:15.101 to 2025:362:04:32:46.726
2026-01-07 08:31:41,797 get_mon_dataset: Getting MON data from 2025:328:01:17:53.555 to 2025:328:01:55:55.206
2026-01-07 08:31:41,797 get_aca_images_cached: Getting ACA images from 2025:328:01:17:53.555 to 2025:328:01:55:55.206
2026-01-07 08:31:42,048 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-01-07 08:33:57,998 get_mon_dataset: Getting MON data from 2025:328:03:18:12.631 to 2025:328:03:55:55.831
2026-01-07 08:33:57,998 get_aca_images_cached: Getting ACA images from 2025:328:03:18:12.631 to 2025:328:03:55:55.831
2026-01-07 08:33:58,251 get_mon_dataset: Getting MON data from 2025:330:16:55:27.246 to 2025:330:17:15:56.221
2026-01-07 08:33:58,251 get_aca_images_cached: Getting ACA images from 2025:330:16:55:27.246 to 2025:330:17:15:56.221
2026-01-07 08:33:58,670 get_mon_dataset: Getting MON data from 2025:330:18:19:08.721 to 2025:330:18:26:20.246
2026-01-07 08:33:58,670 get_aca_images_cached: Getting ACA images from 2025:330:18:19:08.721 to 2025:330:18:26:20.246
2026-01-07 08:33:58,711 get_mon_dataset: Not enough images for slot 0 found 0)
2026-01-07 08:33:58,712 get_mon_dataset: Not enough images for slot 1 found 0)
2026-01-07 08:33:58,713 get_mon_dataset: Not enough images for slot 2 found 0)
2026-01-07 08:33:58,714 get_mon_dataset: Not enough images for slot 3 found 0)
2026-01-07 08:33:58,715 get_mon_dataset: Not enough images for slot 4 found 0)
2026-01-07 08:33:58,716 get_mon_dataset: Not enough images for slot 5 found 0)
2026-01-07 08:33:58,717 get_mon_dataset: Not enough images for slot 6 found 0)
2026-01-07 08:33:58,718 get_mon_dataset: Not enough images for slot 7 found 0)
2026-01-07 08:33:58,719 get_mon_dataset: Getting MON data from 2025:333:09:31:50.011 to 2025:333:10:09:39.361
2026-01-07 08:33:58,719 get_aca_images_cached: Getting ACA images from 2025:333:09:31:50.011 to 2025:333:10:09:39.361
2026-01-07 08:33:59,170 get_mon_dataset: Getting MON data from 2025:333:10:30:23.711 to 2025:333:11:17:01.961
2026-01-07 08:33:59,170 get_aca_images_cached: Getting ACA images from 2025:333:10:30:23.711 to 2025:333:11:17:01.961
2026-01-07 08:33:59,387 get_mon_dataset: Getting MON data from 2025:336:00:06:58.351 to 2025:336:00:31:55.876
2026-01-07 08:33:59,387 get_aca_images_cached: Getting ACA images from 2025:336:00:06:58.351 to 2025:336:00:31:55.876
2026-01-07 08:33:59,591 get_mon_dataset: Getting MON data from 2025:338:14:10:23.266 to 2025:338:14:50:55.591
2026-01-07 08:33:59,591 get_aca_images_cached: Getting ACA images from 2025:338:14:10:23.266 to 2025:338:14:50:55.591
2026-01-07 08:33:59,804 get_mon_dataset: Getting MON data from 2025:338:16:06:10.716 to 2025:338:16:25:55.616
2026-01-07 08:33:59,804 get_aca_images_cached: Getting ACA images from 2025:338:16:06:10.716 to 2025:338:16:25:55.616
2026-01-07 08:34:00,043 get_mon_dataset: Getting MON data from 2025:338:16:46:39.966 to 2025:338:17:06:47.416
2026-01-07 08:34:00,043 get_aca_images_cached: Getting ACA images from 2025:338:16:46:39.966 to 2025:338:17:06:47.416
2026-01-07 08:34:00,250 get_mon_dataset: Getting MON data from 2025:341:09:04:08.057 to 2025:341:09:53:55.932
2026-01-07 08:34:00,250 get_aca_images_cached: Getting ACA images from 2025:341:09:04:08.057 to 2025:341:09:53:55.932
2026-01-07 08:34:00,741 get_mon_dataset: Getting MON data from 2025:343:21:19:39.071 to 2025:343:21:55:56.171
2026-01-07 08:34:00,741 get_aca_images_cached: Getting ACA images from 2025:343:21:19:39.071 to 2025:343:21:55:56.171
2026-01-07 08:34:00,964 get_mon_dataset: Getting MON data from 2025:344:00:07:40.972 to 2025:344:00:08:52.722
2026-01-07 08:34:00,964 get_aca_images_cached: Getting ACA images from 2025:344:00:07:40.972 to 2025:344:00:08:52.722
2026-01-07 08:34:01,122 get_mon_dataset: Getting MON data from 2025:344:00:23:55.747 to 2025:344:00:45:55.947
2026-01-07 08:34:01,122 get_aca_images_cached: Getting ACA images from 2025:344:00:23:55.747 to 2025:344:00:45:55.947
2026-01-07 08:34:01,313 get_mon_dataset: Getting MON data from 2025:346:14:34:59.861 to 2025:346:14:41:00.661
2026-01-07 08:34:01,313 get_aca_images_cached: Getting ACA images from 2025:346:14:34:59.861 to 2025:346:14:41:00.661
2026-01-07 08:34:01,530 get_mon_dataset: Getting MON data from 2025:346:15:25:31.812 to 2025:346:15:26:55.862
2026-01-07 08:34:01,530 get_aca_images_cached: Getting ACA images from 2025:346:15:25:31.812 to 2025:346:15:26:55.862
2026-01-07 08:34:01,683 get_mon_dataset: Getting MON data from 2025:349:05:30:31.026 to 2025:349:05:55:56.227
2026-01-07 08:34:01,683 get_aca_images_cached: Getting ACA images from 2025:349:05:30:31.026 to 2025:349:05:55:56.227
2026-01-07 08:34:01,889 get_mon_dataset: Getting MON data from 2025:349:07:11:01.102 to 2025:349:07:25:55.927
2026-01-07 08:34:01,889 get_aca_images_cached: Getting ACA images from 2025:349:07:11:01.102 to 2025:349:07:25:55.927
2026-01-07 08:34:02,075 get_mon_dataset: Getting MON data from 2025:349:07:45:40.827 to 2025:349:08:20:15.427
2026-01-07 08:34:02,075 get_aca_images_cached: Getting ACA images from 2025:349:07:45:40.827 to 2025:349:08:20:15.427
2026-01-07 08:34:02,515 get_mon_dataset: Getting MON data from 2025:351:19:50:00.466 to 2025:351:20:30:10.241
2026-01-07 08:34:02,516 get_aca_images_cached: Getting ACA images from 2025:351:19:50:00.466 to 2025:351:20:30:10.241
2026-01-07 08:34:03,027 get_mon_dataset: Getting MON data from 2025:351:20:49:55.142 to 2025:351:21:27:25.017
2026-01-07 08:34:03,027 get_aca_images_cached: Getting ACA images from 2025:351:20:49:55.142 to 2025:351:21:27:25.017
2026-01-07 08:34:03,370 get_mon_dataset: Getting MON data from 2025:351:21:47:10.942 to 2025:351:22:23:30.092
2026-01-07 08:34:03,370 get_aca_images_cached: Getting ACA images from 2025:351:21:47:10.942 to 2025:351:22:23:30.092
2026-01-07 08:34:03,821 get_mon_dataset: Getting MON data from 2025:351:23:17:35.242 to 2025:351:23:50:38.617
2026-01-07 08:34:03,821 get_aca_images_cached: Getting ACA images from 2025:351:23:17:35.242 to 2025:351:23:50:38.617
2026-01-07 08:34:04,069 get_mon_dataset: Getting MON data from 2025:354:11:29:32.031 to 2025:354:11:55:55.657
2026-01-07 08:34:04,069 get_aca_images_cached: Getting ACA images from 2025:354:11:29:32.031 to 2025:354:11:55:55.657
2026-01-07 08:34:04,272 get_mon_dataset: Getting MON data from 2025:354:12:39:08.907 to 2025:354:12:46:20.432
2026-01-07 08:34:04,272 get_aca_images_cached: Getting ACA images from 2025:354:12:39:08.907 to 2025:354:12:46:20.432
2026-01-07 08:34:04,332 get_mon_dataset: Not enough images for slot 0 found 0)
2026-01-07 08:34:04,333 get_mon_dataset: Not enough images for slot 1 found 0)
2026-01-07 08:34:04,334 get_mon_dataset: Not enough images for slot 2 found 0)
2026-01-07 08:34:04,335 get_mon_dataset: Not enough images for slot 3 found 0)
2026-01-07 08:34:04,336 get_mon_dataset: Not enough images for slot 4 found 0)
2026-01-07 08:34:04,337 get_mon_dataset: Not enough images for slot 5 found 0)
2026-01-07 08:34:04,338 get_mon_dataset: Not enough images for slot 6 found 0)
2026-01-07 08:34:04,339 get_mon_dataset: Not enough images for slot 7 found 0)
2026-01-07 08:34:04,340 get_mon_dataset: Getting MON data from 2025:354:14:30:56.507 to 2025:354:14:55:56.082
2026-01-07 08:34:04,340 get_aca_images_cached: Getting ACA images from 2025:354:14:30:56.507 to 2025:354:14:55:56.082
2026-01-07 08:34:04,558 get_mon_dataset: Getting MON data from 2025:357:02:34:27.972 to 2025:357:03:10:56.347
2026-01-07 08:34:04,559 get_aca_images_cached: Getting ACA images from 2025:357:02:34:27.972 to 2025:357:03:10:56.347
2026-01-07 08:34:04,938 get_mon_dataset: Getting MON data from 2025:359:19:20:45.237 to 2025:359:19:55:55.712
2026-01-07 08:34:04,938 get_aca_images_cached: Getting ACA images from 2025:359:19:20:45.237 to 2025:359:19:55:55.712
2026-01-07 08:34:05,169 get_mon_dataset: Getting MON data from 2025:359:20:33:20.462 to 2025:359:20:50:56.212
2026-01-07 08:34:05,169 get_aca_images_cached: Getting ACA images from 2025:359:20:33:20.462 to 2025:359:20:50:56.212
2026-01-07 08:34:05,374 get_mon_dataset: Getting MON data from 2025:362:10:44:13.302 to 2025:362:11:20:56.027
2026-01-07 08:34:05,375 get_aca_images_cached: Getting ACA images from 2025:362:10:44:13.302 to 2025:362:11:20:56.027
2026-01-07 08:34:05,638 get_mon_dataset: Getting MON data from 2025:365:02:52:55.567 to 2025:365:03:15:56.242
2026-01-07 08:34:05,638 get_aca_images_cached: Getting ACA images from 2025:365:02:52:55.567 to 2025:365:03:15:56.242
2026-01-07 08:34:05,851 get_mon_dataset: Getting MON data from 2025:365:04:10:00.368 to 2025:365:04:46:42.068
2026-01-07 08:34:05,851 get_aca_images_cached: Getting ACA images from 2025:365:04:10:00.368 to 2025:365:04:46:42.068
2026-01-07 08:34:06,091 get_mon_dataset: Getting MON data from 2026:002:16:26:12.382 to 2026:002:17:02:35.632
2026-01-07 08:34:06,091 get_aca_images_cached: Getting ACA images from 2026:002:16:26:12.382 to 2026:002:17:02:35.632
2026-01-07 08:34:06,747 get_mon_dataset: Getting MON data from 2026:002:20:09:44.508 to 2026:002:20:45:56.483
2026-01-07 08:34:06,747 get_aca_images_cached: Getting ACA images from 2026:002:20:09:44.508 to 2026:002:20:45:56.483
2026-01-07 08:34:07,084 get_mon_dataset: Getting MON data from 2026:005:11:40:25.123 to 2026:005:12:10:55.773
2026-01-07 08:34:07,084 get_aca_images_cached: Getting ACA images from 2026:005:11:40:25.123 to 2026:005:12:10:55.773
2026-01-07 08:34:07,568 get_kalman_drops_nman: processing NMAN data
2026-01-07 08:34:07,678 get_kalman_drops_nman: Skipping NMAN from 2025:344:00:07:40.972 to 2025:344:00:08:52.722 due to insufficient monitor window data within 100 minutes of perigee
2026-01-07 08:34:07,698 get_kalman_drops_nman: Skipping NMAN from 2025:346:15:25:31.812 to 2025:346:15:26:55.862 due to insufficient monitor window data within 100 minutes of perigee
2026-01-07 08:34:07,848 get_kalman_drops_nman: Skipping NMAN from 2026:002:20:09:44.508 to 2026:002:20:45:56.483 due to insufficient monitor window data within 100 minutes of perigee
2026-01-07 08:34:07,854 get_kalman_drops_nman: Skipping NMAN from 2026:005:11:40:25.123 to 2026:005:12:10:55.773 due to insufficient monitor window data within 100 minutes of perigee
2026-01-07 07:34:08,932 _get_tlm: Getting telemetry for 2025:328:02:28:32.306
2026-01-07 07:34:09,686 obss: Getting observations from kadi commands for 2025/Nov-24
2026-01-07 07:34:09,699 _get_tlm: Getting telemetry for 2025:330:17:56:29.380
2026-01-07 07:34:10,045 obss: Getting observations from kadi commands for 2025/Nov-26
2026-01-07 07:34:10,060 _get_tlm: Getting telemetry for 2025:333:09:24:03.648
2026-01-07 07:34:10,496 obss: Getting observations from kadi commands for 2025/Nov-29
2026-01-07 07:34:10,508 _get_tlm: Getting telemetry for 2025:336:00:52:01.258
2026-01-07 07:34:10,859 obss: Getting observations from kadi commands for 2025/Dec-02
2026-01-07 07:34:10,874 _get_tlm: Getting telemetry for 2025:338:16:21:06.843
2026-01-07 07:34:11,181 obss: Getting observations from kadi commands for 2025/Dec-04
2026-01-07 07:34:11,195 _get_tlm: Getting telemetry for 2025:341:07:50:39.394
2026-01-07 07:34:11,524 obss: Getting observations from kadi commands for 2025/Dec-07
2026-01-07 07:34:11,540 _get_tlm: Getting telemetry for 2025:343:23:19:33.445
2026-01-07 07:34:11,998 obss: Getting observations from kadi commands for 2025/Dec-09
2026-01-07 07:34:12,011 _get_tlm: Getting telemetry for 2025:346:14:47:45.244
2026-01-07 07:34:12,399 obss: Getting observations from kadi commands for 2025/Dec-12
2026-01-07 07:34:12,413 _get_tlm: Getting telemetry for 2025:349:06:15:38.069
2026-01-07 07:34:12,758 obss: Getting observations from kadi commands for 2025/Dec-15
2026-01-07 07:34:12,771 _get_tlm: Getting telemetry for 2025:351:21:43:40.371
2026-01-07 07:34:13,067 obss: Getting observations from kadi commands for 2025/Dec-17
2026-01-07 07:34:13,077 _get_tlm: Getting telemetry for 2025:354:13:12:00.568
2026-01-07 07:34:13,387 obss: Getting observations from kadi commands for 2025/Dec-20
2026-01-07 07:34:13,400 _get_tlm: Getting telemetry for 2025:357:04:40:11.745
2026-01-07 07:34:13,688 obss: Getting observations from kadi commands for 2025/Dec-23
2026-01-07 07:34:13,704 _get_tlm: Getting telemetry for 2025:359:20:07:55.370
2026-01-07 07:34:13,960 obss: Getting observations from kadi commands for 2025/Dec-25
2026-01-07 07:34:13,972 _get_tlm: Getting telemetry for 2025:362:11:35:46.338
2026-01-07 07:34:14,208 obss: Getting observations from kadi commands for 2025/Dec-28
2026-01-07 07:34:14,222 _get_tlm: Getting telemetry for 2025:365:03:04:26.724
2026-01-07 07:34:14,576 obss: Getting observations from kadi commands for 2025/Dec-31
2026-01-07 07:34:14,589 _get_tlm: Getting telemetry for 2026:002:18:33:56.123
2026-01-07 07:34:14,874 obss: Getting observations from kadi commands for 2026/Jan-02
2026-01-07 07:34:14,890 _get_tlm: Getting telemetry for 2026:005:10:03:05.934
2026-01-07 07:34:15,154 obss: Getting observations from kadi commands for 2026/Jan-05
2026-01-07 07:34:31,709 get_color_marker_for_perigee_plotly: Perigee 2025:328:02:28:32.306 color='rgb(229, 134, 6)' marker='circle'
2026-01-07 07:34:31,709 get_color_marker_for_perigee_plotly: Perigee 2025:330:17:56:29.380 color='rgb(93, 105, 177)' marker='square'
2026-01-07 07:34:31,709 get_color_marker_for_perigee_plotly: Perigee 2025:333:09:24:03.648 color='rgb(82, 188, 163)' marker='diamond'
2026-01-07 07:34:31,709 get_color_marker_for_perigee_plotly: Perigee 2025:336:00:52:01.258 color='rgb(153, 201, 69)' marker='triangle-up'
2026-01-07 07:34:31,710 get_color_marker_for_perigee_plotly: Perigee 2025:338:16:21:06.843 color='rgb(204, 97, 176)' marker='triangle-down'
2026-01-07 07:34:31,710 get_color_marker_for_perigee_plotly: Perigee 2025:341:07:50:39.394 color='rgb(36, 121, 108)' marker='triangle-left'
2026-01-07 07:34:31,710 get_color_marker_for_perigee_plotly: Perigee 2025:343:23:19:33.445 color='rgb(218, 165, 27)' marker='triangle-right'
2026-01-07 07:34:31,710 get_color_marker_for_perigee_plotly: Perigee 2025:346:14:47:45.244 color='rgb(47, 138, 196)' marker='circle'
2026-01-07 07:34:31,710 get_color_marker_for_perigee_plotly: Perigee 2025:349:06:15:38.069 color='rgb(118, 78, 159)' marker='square'
2026-01-07 07:34:31,711 get_color_marker_for_perigee_plotly: Perigee 2025:351:21:43:40.371 color='rgb(237, 100, 90)' marker='diamond'
2026-01-07 07:34:31,711 get_color_marker_for_perigee_plotly: Perigee 2025:354:13:12:00.568 color='rgb(165, 170, 153)' marker='triangle-up'
2026-01-07 07:34:31,711 get_color_marker_for_perigee_plotly: Perigee 2025:357:04:40:11.745 color='rgb(229, 134, 6)' marker='triangle-down'
2026-01-07 07:34:31,711 get_color_marker_for_perigee_plotly: Perigee 2025:359:20:07:55.370 color='rgb(93, 105, 177)' marker='triangle-left'
2026-01-07 07:34:31,711 get_color_marker_for_perigee_plotly: Perigee 2025:362:11:35:46.338 color='rgb(82, 188, 163)' marker='triangle-right'
2026-01-07 07:34:31,712 get_color_marker_for_perigee_plotly: Perigee 2025:365:03:04:26.724 color='rgb(153, 201, 69)' marker='circle'
2026-01-07 07:34:31,712 get_color_marker_for_perigee_plotly: Perigee 2026:002:18:33:56.123 color='rgb(204, 97, 176)' marker='square'
2026-01-07 07:34:31,712 get_color_marker_for_perigee_plotly: Perigee 2026:005:10:03:05.934 color='rgb(36, 121, 108)' marker='diamond'
2026-01-07 07:34:31,712 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-01-07 07:34:32,518 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-01-07 08:34:35,332 main: Overriding starting time with the time of latest low-kalman event
2026-01-07 08:34:35,332 get_lowkals_new: Getting telemetry between 2026:006:02:56:22.033 and 2026:007:13:34:35.327
2026-01-07 08:34:35,613 get_lowkals_new: Finding intervals of low kalman stars
2026-01-07 08:34:35,631 get_lowkals_new: Last telemetry date: 2026:006:22:52:28.439
2026-01-07 08:34:35,635 main: Updating events file /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-01-07 08:34:35,988 make_web_page: Writing HTML to /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/index.html
2026:006:02:56:22.033 2026:007:13:34:35.327