Prev
Index
Next
kalman_watch3: Tue Nov 3 08:37:46 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Tue Nov 3 08:37:46 2026 |
Errors:
- Line 268: 2026-11-03 08:37:45,041 get_lowkals_new: WARNING: Fewer than two kalman stars at 2026:306:18:10:20.875 for 31.8 secs
File contents:
2026-11-03 08:31:32,061 log_run_info: ******************************************
2026-11-03 08:31:32,061 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-11-03 08:31:32,061 log_run_info: Version: 0.6.2
2026-11-03 08:31:32,061 log_run_info: Time: Tue Nov 3 08:31:32 2026
2026-11-03 08:31:32,061 log_run_info: User: aca
2026-11-03 08:31:32,061 log_run_info: Machine: kady.cfa.harvard.edu
2026-11-03 08:31:32,061 log_run_info: Processing args:
2026-11-03 08:31:32,061 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-11-03 08:31:32,061 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-11-03 08:31:32,061 log_run_info: 'lookback': 14,
2026-11-03 08:31:32,061 log_run_info: 'make_html': True,
2026-11-03 08:31:32,061 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-11-03 08:31:32,061 log_run_info: 'stop': None}
2026-11-03 08:31:32,061 log_run_info: ******************************************
2026-11-03 08:31:32,065 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-11-03 08:31:32,097 get_evts_perigee: Getting perigee events between 2026:293:13:31:32.062 and 2026:307:13:31:32.062
2026-11-03 08:31:33,798 _get_tlm: Getting telemetry for 2026:306:21:17:19.377
2026-11-03 08:31:34,338 get_evts_perigee: Found 1 new perigee event(s)
2026-11-03 08:31:34,340 obss: Getting observations from kadi commands for 2026/Nov-02
2026-11-03 08:31:36,831 write_data: Writing perigee data to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-02/data.npz
2026-11-03 08:31:36,838 write_info: Writing info to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-02/info.json
2026-11-03 08:31:36,849 main: Writing perigee data /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-11-03 08:31:36,958 send_mail: Sent mail to ['aca_alert@cfa.harvard.edu']
2026-11-03 08:31:36,959 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-02/data.npz
2026-11-03 08:31:49,822 get_manvrs_perigee: Getting maneuvers from 2026:306:15:43:59.377 to 2026:307:02:28:58.410
2026-11-03 08:31:49,838 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:306:15:43:59.377 to 2026:307:02:28:58.410
2026-11-03 08:31:49,995 get_manvrs_perigee: Excluding Earth block from 2026:306:20:58:25.856 to 2026:306:21:52:39.207
2026-11-03 08:31:49,998 get_mon_dataset: Getting MON data from 2026:306:19:07:02.856 to 2026:306:19:40:55.431
2026-11-03 08:31:49,998 get_aca_images_cached: Getting ACA images from 2026:306:19:07:02.856 to 2026:306:19:40:55.431
2026-11-03 08:31:56,671 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-11-03 08:34:19,744 get_mon_dataset: Getting MON data from 2026:306:20:58:00.231 to 2026:306:20:58:25.856
2026-11-03 08:34:19,744 get_aca_images_cached: Getting ACA images from 2026:306:20:58:00.231 to 2026:306:20:58:25.856
2026-11-03 08:34:19,954 get_mon_dataset: Not enough images for slot 0 found 3)
2026-11-03 08:34:19,955 get_mon_dataset: Not enough images for slot 1 found 3)
2026-11-03 08:34:19,956 get_mon_dataset: Not enough images for slot 2 found 3)
2026-11-03 08:34:19,958 get_mon_dataset: Not enough images for slot 3 found 3)
2026-11-03 08:34:19,959 get_mon_dataset: Not enough images for slot 4 found 3)
2026-11-03 08:34:19,960 get_mon_dataset: Not enough images for slot 5 found 3)
2026-11-03 08:34:19,961 get_mon_dataset: Not enough images for slot 6 found 3)
2026-11-03 08:34:19,962 get_mon_dataset: Not enough images for slot 7 found 3)
2026-11-03 08:34:19,962 get_mon_dataset: Getting MON data from 2026:306:21:52:39.207 to 2026:306:21:53:05.857
2026-11-03 08:34:19,963 get_aca_images_cached: Getting ACA images from 2026:306:21:52:39.207 to 2026:306:21:53:05.857
2026-11-03 08:34:20,176 get_mon_dataset: Not enough images for slot 0 found 4)
2026-11-03 08:34:20,177 get_mon_dataset: Not enough images for slot 1 found 4)
2026-11-03 08:34:20,178 get_mon_dataset: Not enough images for slot 2 found 4)
2026-11-03 08:34:20,179 get_mon_dataset: Not enough images for slot 3 found 4)
2026-11-03 08:34:20,180 get_mon_dataset: Not enough images for slot 4 found 4)
2026-11-03 08:34:20,181 get_mon_dataset: Not enough images for slot 5 found 4)
2026-11-03 08:34:20,182 get_mon_dataset: Not enough images for slot 6 found 4)
2026-11-03 08:34:20,183 get_mon_dataset: Not enough images for slot 7 found 4)
2026-11-03 08:34:20,183 get_kalman_drops_nman: processing NMAN data
2026-11-03 08:34:20,188 get_kalman_drops_nman: Skipping NMAN from 2026:306:19:07:02.856 to 2026:306:19:40:55.431 due to insufficient monitor window data within 100 minutes of perigee
2026-11-03 08:34:20,189 _get_tlm: Getting telemetry for 2026:306:21:17:19.377
2026-11-03 08:34:20,792 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-02/index.html
2026-11-03 08:34:20,798 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-31/data.npz
2026-11-03 08:34:20,865 get_manvrs_perigee: Getting maneuvers from 2026:304:00:15:45.932 to 2026:304:09:37:13.435
2026-11-03 08:34:20,897 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:304:00:15:45.932 to 2026:304:09:37:13.435
2026-11-03 08:34:21,051 get_mon_dataset: Getting MON data from 2026:304:05:31:25.616 to 2026:304:06:10:56.441
2026-11-03 08:34:21,051 get_aca_images_cached: Getting ACA images from 2026:304:05:31:25.616 to 2026:304:06:10:56.441
2026-11-03 08:34:21,294 get_kalman_drops_nman: processing NMAN data
2026-11-03 08:34:21,307 _get_tlm: Getting telemetry for 2026:304:05:49:05.932
2026-11-03 08:34:21,660 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-31/index.html
2026-11-03 08:34:21,665 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-28/data.npz
2026-11-03 08:34:21,731 get_manvrs_perigee: Getting maneuvers from 2026:301:08:46:52.626 to 2026:301:19:32:40.847
2026-11-03 08:34:21,763 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:301:08:46:52.626 to 2026:301:19:32:40.847
2026-11-03 08:34:21,943 get_mon_dataset: Getting MON data from 2026:301:12:45:22.701 to 2026:301:13:15:55.401
2026-11-03 08:34:21,943 get_aca_images_cached: Getting ACA images from 2026:301:12:45:22.701 to 2026:301:13:15:55.401
2026-11-03 08:34:22,156 get_mon_dataset: Getting MON data from 2026:301:14:10:00.551 to 2026:301:14:37:12.351
2026-11-03 08:34:22,156 get_aca_images_cached: Getting ACA images from 2026:301:14:10:00.551 to 2026:301:14:37:12.351
2026-11-03 08:34:22,360 get_mon_dataset: Getting MON data from 2026:301:14:57:56.701 to 2026:301:15:24:39.801
2026-11-03 08:34:22,360 get_aca_images_cached: Getting ACA images from 2026:301:14:57:56.701 to 2026:301:15:24:39.801
2026-11-03 08:34:22,557 get_mon_dataset: Getting MON data from 2026:301:15:45:24.151 to 2026:301:16:15:02.526
2026-11-03 08:34:22,557 get_aca_images_cached: Getting ACA images from 2026:301:15:45:24.151 to 2026:301:16:15:02.526
2026-11-03 08:34:22,761 get_kalman_drops_nman: processing NMAN data
2026-11-03 08:34:22,799 _get_tlm: Getting telemetry for 2026:301:14:20:12.626
2026-11-03 08:34:23,393 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-28/index.html
2026-11-03 08:34:23,398 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-25/data.npz
2026-11-03 08:34:23,461 get_manvrs_perigee: Getting maneuvers from 2026:298:17:18:01.297 to 2026:299:03:46:15.681
2026-11-03 08:34:23,494 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:298:17:18:01.297 to 2026:299:03:46:15.681
2026-11-03 08:34:23,727 get_mon_dataset: Getting MON data from 2026:298:21:01:08.235 to 2026:298:21:28:55.910
2026-11-03 08:34:23,727 get_aca_images_cached: Getting ACA images from 2026:298:21:01:08.235 to 2026:298:21:28:55.910
2026-11-03 08:34:23,957 get_mon_dataset: Getting MON data from 2026:298:23:33:45.586 to 2026:298:23:55:56.036
2026-11-03 08:34:23,957 get_aca_images_cached: Getting ACA images from 2026:298:23:33:45.586 to 2026:298:23:55:56.036
2026-11-03 08:34:24,325 get_kalman_drops_nman: processing NMAN data
2026-11-03 08:34:24,344 _get_tlm: Getting telemetry for 2026:298:22:51:21.297
2026-11-03 08:34:24,772 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-25/index.html
2026-11-03 08:34:24,777 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-23/data.npz
2026-11-03 08:34:24,849 get_manvrs_perigee: Getting maneuvers from 2026:296:01:49:53.605 to 2026:296:11:55:56.411
2026-11-03 08:34:24,881 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:296:01:49:53.605 to 2026:296:11:55:56.411
2026-11-03 08:34:25,109 get_mon_dataset: Getting MON data from 2026:296:08:11:45.671 to 2026:296:08:55:56.321
2026-11-03 08:34:25,109 get_aca_images_cached: Getting ACA images from 2026:296:08:11:45.671 to 2026:296:08:55:56.321
2026-11-03 08:34:25,321 get_kalman_drops_nman: processing NMAN data
2026-11-03 08:34:25,335 _get_tlm: Getting telemetry for 2026:296:07:23:13.605
2026-11-03 08:34:25,919 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-23/index.html
2026-11-03 08:34:25,924 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-20/data.npz
2026-11-03 08:34:25,990 get_manvrs_perigee: Getting maneuvers from 2026:293:10:22:22.147 to 2026:293:20:28:55.706
2026-11-03 08:34:26,023 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:293:10:22:22.147 to 2026:293:20:28:55.706
2026-11-03 08:34:26,414 get_mon_dataset: Getting MON data from 2026:293:14:31:44.780 to 2026:293:14:55:56.180
2026-11-03 08:34:26,414 get_aca_images_cached: Getting ACA images from 2026:293:14:31:44.780 to 2026:293:14:55:56.180
2026-11-03 08:34:26,624 get_mon_dataset: Getting MON data from 2026:293:17:25:54.655 to 2026:293:17:55:55.581
2026-11-03 08:34:26,624 get_aca_images_cached: Getting ACA images from 2026:293:17:25:54.655 to 2026:293:17:55:55.581
2026-11-03 08:34:26,993 get_kalman_drops_nman: processing NMAN data
2026-11-03 08:34:27,011 _get_tlm: Getting telemetry for 2026:293:15:55:42.147
2026-11-03 08:34:27,418 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Oct-20/index.html
2026-11-03 08:34:27,430 make_index_list_pages: Writing recent index list page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/index.html
2026-11-03 08:34:27,441 make_index_list_pages: Writing index list page for 2025 to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2025/index.html
2026-11-03 08:34:27,449 make_index_list_pages: Writing index list page for 2026 to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/index.html
2026-11-03 08:34:33,422 get_manvrs_perigee: Getting maneuvers from 2026:262:13:34:33.421 to 2026:306:13:34:33.422
2026-11-03 08:34:38,051 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:262:13:34:33.421 to 2026:306:13:34:33.422
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:266:23:05:14.526 to 2026:266:23:06:31.401
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:267:18:43:07.256 to 2026:267:18:48:02.456
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:269:12:43:47.041 to 2026:269:12:49:11.966
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:273:03:17:01.937 to 2026:273:03:22:25.837
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:273:10:59:32.788 to 2026:273:11:01:26.563
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:273:14:27:53.689 to 2026:273:14:32:21.214
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:273:22:47:07.266 to 2026:273:22:49:57.416
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:274:02:55:31.792 to 2026:274:03:00:42.367
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:274:07:03:37.868 to 2026:274:07:09:31.493
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:274:11:12:39.294 to 2026:274:11:18:01.144
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:274:15:24:21.645 to 2026:274:15:24:57.520
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:276:01:17:52.528 to 2026:276:01:22:50.803
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:276:04:50:20.454 to 2026:276:04:55:16.679
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:276:08:14:22.030 to 2026:276:08:19:59.255
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:276:11:47:11.481 to 2026:276:11:52:50.756
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:278:11:15:03.092 to 2026:278:11:21:32.592
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:279:17:52:38.250 to 2026:279:17:55:50.950
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:280:04:42:45.652 to 2026:280:04:44:13.802
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:281:12:28:52.085 to 2026:281:12:33:24.735
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:282:08:21:57.065 to 2026:282:08:27:10.715
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:285:14:10:13.708 to 2026:285:14:18:48.258
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:285:15:42:35.884 to 2026:285:15:46:38.809
2026-11-03 08:34:45,798 get_manvrs_perigee: Excluding Earth block from 2026:288:00:23:58.522 to 2026:288:00:29:57.272
2026-11-03 08:34:45,799 get_manvrs_perigee: Excluding Earth block from 2026:288:02:28:45.123 to 2026:288:02:33:38.273
2026-11-03 08:34:45,799 get_manvrs_perigee: Excluding Earth block from 2026:288:04:39:01.773 to 2026:288:04:46:26.624
2026-11-03 08:34:45,799 get_manvrs_perigee: Excluding Earth block from 2026:292:04:15:02.972 to 2026:292:04:20:37.122
2026-11-03 08:34:45,799 get_manvrs_perigee: Excluding Earth block from 2026:292:08:37:55.673 to 2026:292:08:42:37.548
2026-11-03 08:34:45,799 get_manvrs_perigee: Excluding Earth block from 2026:292:12:24:29.223 to 2026:292:12:27:07.073
2026-11-03 08:34:45,799 get_manvrs_perigee: Excluding Earth block from 2026:297:09:04:55.802 to 2026:297:09:10:30.977
2026-11-03 08:34:45,799 get_manvrs_perigee: Excluding Earth block from 2026:298:16:56:29.209 to 2026:298:17:03:27.409
2026-11-03 08:34:45,865 get_mon_dataset: Getting MON data from 2026:269:20:34:09.393 to 2026:269:20:41:19.893
2026-11-03 08:34:45,865 get_aca_images_cached: Getting ACA images from 2026:269:20:34:09.393 to 2026:269:20:41:19.893
2026-11-03 08:34:45,896 get_mon_dataset: Not enough images for slot 0 found 0)
2026-11-03 08:34:45,897 get_mon_dataset: Not enough images for slot 1 found 0)
2026-11-03 08:34:45,898 get_mon_dataset: Not enough images for slot 2 found 0)
2026-11-03 08:34:45,899 get_mon_dataset: Not enough images for slot 3 found 0)
2026-11-03 08:34:45,900 get_mon_dataset: Not enough images for slot 4 found 0)
2026-11-03 08:34:45,901 get_mon_dataset: Not enough images for slot 5 found 0)
2026-11-03 08:34:45,902 get_mon_dataset: Not enough images for slot 6 found 0)
2026-11-03 08:34:45,903 get_mon_dataset: Not enough images for slot 7 found 0)
2026-11-03 08:34:45,904 get_mon_dataset: Getting MON data from 2026:272:10:38:17.357 to 2026:272:11:07:55.733
2026-11-03 08:34:45,904 get_aca_images_cached: Getting ACA images from 2026:272:10:38:17.357 to 2026:272:11:07:55.733
2026-11-03 08:34:46,129 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-11-03 08:37:10,857 get_mon_dataset: Getting MON data from 2026:275:03:34:59.873 to 2026:275:03:55:51.398
2026-11-03 08:37:10,857 get_aca_images_cached: Getting ACA images from 2026:275:03:34:59.873 to 2026:275:03:55:51.398
2026-11-03 08:37:11,102 get_mon_dataset: Getting MON data from 2026:277:17:22:37.688 to 2026:277:17:55:55.413
2026-11-03 08:37:11,102 get_aca_images_cached: Getting ACA images from 2026:277:17:22:37.688 to 2026:277:17:55:55.413
2026-11-03 08:37:11,121 get_mon_dataset: Not enough images for slot 0 found 0)
2026-11-03 08:37:11,122 get_mon_dataset: Not enough images for slot 1 found 0)
2026-11-03 08:37:11,123 get_mon_dataset: Not enough images for slot 2 found 0)
2026-11-03 08:37:11,123 get_mon_dataset: Not enough images for slot 3 found 0)
2026-11-03 08:37:11,124 get_mon_dataset: Not enough images for slot 4 found 0)
2026-11-03 08:37:11,124 get_mon_dataset: Not enough images for slot 5 found 0)
2026-11-03 08:37:11,125 get_mon_dataset: Not enough images for slot 6 found 0)
2026-11-03 08:37:11,125 get_mon_dataset: Not enough images for slot 7 found 0)
2026-11-03 08:37:11,126 get_mon_dataset: Getting MON data from 2026:277:20:44:54.714 to 2026:277:21:15:56.114
2026-11-03 08:37:11,126 get_aca_images_cached: Getting ACA images from 2026:277:20:44:54.714 to 2026:277:21:15:56.114
2026-11-03 08:37:11,350 get_mon_dataset: Getting MON data from 2026:280:11:24:32.629 to 2026:280:11:55:55.554
2026-11-03 08:37:11,350 get_aca_images_cached: Getting ACA images from 2026:280:11:24:32.629 to 2026:280:11:55:55.554
2026-11-03 08:37:11,547 get_mon_dataset: Getting MON data from 2026:283:00:16:16.644 to 2026:283:00:55:55.669
2026-11-03 08:37:11,547 get_aca_images_cached: Getting ACA images from 2026:283:00:16:16.644 to 2026:283:00:55:55.669
2026-11-03 08:37:11,938 get_mon_dataset: Getting MON data from 2026:283:03:16:17.069 to 2026:283:03:55:56.094
2026-11-03 08:37:11,938 get_aca_images_cached: Getting ACA images from 2026:283:03:16:17.069 to 2026:283:03:55:56.094
2026-11-03 08:37:12,149 get_mon_dataset: Getting MON data from 2026:285:15:46:38.809 to 2026:285:15:55:55.384
2026-11-03 08:37:12,149 get_aca_images_cached: Getting ACA images from 2026:285:15:46:38.809 to 2026:285:15:55:55.384
2026-11-03 08:37:12,349 get_mon_dataset: Getting MON data from 2026:285:19:10:51.660 to 2026:285:19:40:55.660
2026-11-03 08:37:12,349 get_aca_images_cached: Getting ACA images from 2026:285:19:10:51.660 to 2026:285:19:40:55.660
2026-11-03 08:37:12,870 get_mon_dataset: Getting MON data from 2026:288:08:00:59.324 to 2026:288:08:25:55.824
2026-11-03 08:37:12,870 get_aca_images_cached: Getting ACA images from 2026:288:08:00:59.324 to 2026:288:08:25:55.824
2026-11-03 08:37:13,079 get_mon_dataset: Getting MON data from 2026:288:09:40:25.850 to 2026:288:10:10:55.475
2026-11-03 08:37:13,079 get_aca_images_cached: Getting ACA images from 2026:288:09:40:25.850 to 2026:288:10:10:55.475
2026-11-03 08:37:13,392 get_mon_dataset: Getting MON data from 2026:288:10:33:44.875 to 2026:288:11:12:56.225
2026-11-03 08:37:13,392 get_aca_images_cached: Getting ACA images from 2026:288:10:33:44.875 to 2026:288:11:12:56.225
2026-11-03 08:37:13,612 get_mon_dataset: Getting MON data from 2026:290:23:11:47.865 to 2026:290:23:55:56.465
2026-11-03 08:37:13,612 get_aca_images_cached: Getting ACA images from 2026:290:23:11:47.865 to 2026:290:23:55:56.465
2026-11-03 08:37:13,845 get_mon_dataset: Getting MON data from 2026:291:00:37:26.190 to 2026:291:01:05:55.890
2026-11-03 08:37:13,845 get_aca_images_cached: Getting ACA images from 2026:291:00:37:26.190 to 2026:291:01:05:55.890
2026-11-03 08:37:14,226 get_mon_dataset: Getting MON data from 2026:291:01:28:15.565 to 2026:291:02:07:55.615
2026-11-03 08:37:14,226 get_aca_images_cached: Getting ACA images from 2026:291:01:28:15.565 to 2026:291:02:07:55.615
2026-11-03 08:37:14,448 get_mon_dataset: Getting MON data from 2026:293:14:31:44.780 to 2026:293:14:55:56.180
2026-11-03 08:37:14,448 get_aca_images_cached: Getting ACA images from 2026:293:14:31:44.780 to 2026:293:14:55:56.180
2026-11-03 08:37:14,659 get_mon_dataset: Getting MON data from 2026:293:17:25:54.655 to 2026:293:17:55:55.581
2026-11-03 08:37:14,659 get_aca_images_cached: Getting ACA images from 2026:293:17:25:54.655 to 2026:293:17:55:55.581
2026-11-03 08:37:15,093 get_mon_dataset: Getting MON data from 2026:296:08:11:45.671 to 2026:296:08:55:56.321
2026-11-03 08:37:15,093 get_aca_images_cached: Getting ACA images from 2026:296:08:11:45.671 to 2026:296:08:55:56.321
2026-11-03 08:37:15,314 get_mon_dataset: Getting MON data from 2026:298:21:01:08.235 to 2026:298:21:28:55.910
2026-11-03 08:37:15,314 get_aca_images_cached: Getting ACA images from 2026:298:21:01:08.235 to 2026:298:21:28:55.910
2026-11-03 08:37:15,514 get_mon_dataset: Getting MON data from 2026:298:23:33:45.586 to 2026:298:23:55:56.036
2026-11-03 08:37:15,514 get_aca_images_cached: Getting ACA images from 2026:298:23:33:45.586 to 2026:298:23:55:56.036
2026-11-03 08:37:15,707 get_mon_dataset: Getting MON data from 2026:301:12:45:22.701 to 2026:301:13:15:55.401
2026-11-03 08:37:15,707 get_aca_images_cached: Getting ACA images from 2026:301:12:45:22.701 to 2026:301:13:15:55.401
2026-11-03 08:37:15,915 get_mon_dataset: Getting MON data from 2026:301:14:10:00.551 to 2026:301:14:37:12.351
2026-11-03 08:37:15,916 get_aca_images_cached: Getting ACA images from 2026:301:14:10:00.551 to 2026:301:14:37:12.351
2026-11-03 08:37:16,113 get_mon_dataset: Getting MON data from 2026:301:14:57:56.701 to 2026:301:15:24:39.801
2026-11-03 08:37:16,113 get_aca_images_cached: Getting ACA images from 2026:301:14:57:56.701 to 2026:301:15:24:39.801
2026-11-03 08:37:16,315 get_mon_dataset: Getting MON data from 2026:301:15:45:24.151 to 2026:301:16:15:02.526
2026-11-03 08:37:16,315 get_aca_images_cached: Getting ACA images from 2026:301:15:45:24.151 to 2026:301:16:15:02.526
2026-11-03 08:37:16,643 get_mon_dataset: Getting MON data from 2026:304:05:31:25.616 to 2026:304:06:10:56.441
2026-11-03 08:37:16,644 get_aca_images_cached: Getting ACA images from 2026:304:05:31:25.616 to 2026:304:06:10:56.441
2026-11-03 08:37:16,857 get_kalman_drops_nman: processing NMAN data
2026-11-03 08:37:16,879 get_kalman_drops_nman: Skipping NMAN from 2026:277:20:44:54.714 to 2026:277:21:15:56.114 due to insufficient monitor window data within 100 minutes of perigee
2026-11-03 08:37:16,911 get_kalman_drops_nman: Skipping NMAN from 2026:285:15:46:38.809 to 2026:285:15:55:55.384 due to insufficient monitor window data within 100 minutes of perigee
2026-11-03 08:37:16,917 get_kalman_drops_nman: Skipping NMAN from 2026:285:19:10:51.660 to 2026:285:19:40:55.660 due to insufficient monitor window data within 100 minutes of perigee
2026-11-03 07:37:19,402 _get_tlm: Getting telemetry for 2026:264:13:49:17.940
2026-11-03 07:37:20,040 obss: Getting observations from kadi commands for 2026/Sep-21
2026-11-03 07:37:20,056 _get_tlm: Getting telemetry for 2026:267:05:16:43.498
2026-11-03 07:37:20,379 obss: Getting observations from kadi commands for 2026/Sep-24
2026-11-03 07:37:20,395 _get_tlm: Getting telemetry for 2026:269:20:44:14.691
2026-11-03 07:37:20,723 obss: Getting observations from kadi commands for 2026/Sep-26
2026-11-03 07:37:20,739 _get_tlm: Getting telemetry for 2026:272:12:12:25.197
2026-11-03 07:37:21,315 obss: Getting observations from kadi commands for 2026/Sep-29
2026-11-03 07:37:21,330 _get_tlm: Getting telemetry for 2026:275:03:41:15.015
2026-11-03 07:37:21,677 obss: Getting observations from kadi commands for 2026/Oct-02
2026-11-03 07:37:21,692 _get_tlm: Getting telemetry for 2026:277:19:09:51.718
2026-11-03 07:37:22,009 obss: Getting observations from kadi commands for 2026/Oct-04
2026-11-03 07:37:22,024 _get_tlm: Getting telemetry for 2026:280:10:37:44.962
2026-11-03 07:37:22,336 obss: Getting observations from kadi commands for 2026/Oct-07
2026-11-03 07:37:22,350 _get_tlm: Getting telemetry for 2026:283:02:05:06.148
2026-11-03 07:37:22,711 obss: Getting observations from kadi commands for 2026/Oct-10
2026-11-03 07:37:22,723 _get_tlm: Getting telemetry for 2026:285:17:32:26.957
2026-11-03 07:37:23,036 obss: Getting observations from kadi commands for 2026/Oct-12
2026-11-03 07:37:23,052 _get_tlm: Getting telemetry for 2026:288:09:00:09.561
2026-11-03 07:37:23,490 obss: Getting observations from kadi commands for 2026/Oct-15
2026-11-03 07:37:23,503 _get_tlm: Getting telemetry for 2026:291:00:28:02.332
2026-11-03 07:37:23,879 obss: Getting observations from kadi commands for 2026/Oct-18
2026-11-03 07:37:23,888 _get_tlm: Getting telemetry for 2026:293:15:55:42.147
2026-11-03 07:37:24,213 obss: Getting observations from kadi commands for 2026/Oct-20
2026-11-03 07:37:24,227 _get_tlm: Getting telemetry for 2026:296:07:23:13.605
2026-11-03 07:37:24,547 obss: Getting observations from kadi commands for 2026/Oct-23
2026-11-03 07:37:24,560 _get_tlm: Getting telemetry for 2026:298:22:51:21.297
2026-11-03 07:37:24,870 obss: Getting observations from kadi commands for 2026/Oct-25
2026-11-03 07:37:24,887 _get_tlm: Getting telemetry for 2026:301:14:20:12.626
2026-11-03 07:37:25,228 obss: Getting observations from kadi commands for 2026/Oct-28
2026-11-03 07:37:25,237 _get_tlm: Getting telemetry for 2026:304:05:49:05.932
2026-11-03 07:37:25,537 obss: Getting observations from kadi commands for 2026/Oct-31
2026-11-03 07:37:37,554 get_color_marker_for_perigee_plotly: Perigee 2026:264:13:49:17.940 color='rgb(229, 134, 6)' marker='circle'
2026-11-03 07:37:37,555 get_color_marker_for_perigee_plotly: Perigee 2026:267:05:16:43.498 color='rgb(93, 105, 177)' marker='square'
2026-11-03 07:37:37,555 get_color_marker_for_perigee_plotly: Perigee 2026:269:20:44:14.691 color='rgb(82, 188, 163)' marker='diamond'
2026-11-03 07:37:37,555 get_color_marker_for_perigee_plotly: Perigee 2026:272:12:12:25.197 color='rgb(153, 201, 69)' marker='triangle-up'
2026-11-03 07:37:37,555 get_color_marker_for_perigee_plotly: Perigee 2026:275:03:41:15.015 color='rgb(204, 97, 176)' marker='triangle-down'
2026-11-03 07:37:37,556 get_color_marker_for_perigee_plotly: Perigee 2026:277:19:09:51.718 color='rgb(36, 121, 108)' marker='triangle-left'
2026-11-03 07:37:37,556 get_color_marker_for_perigee_plotly: Perigee 2026:280:10:37:44.962 color='rgb(218, 165, 27)' marker='triangle-right'
2026-11-03 07:37:37,556 get_color_marker_for_perigee_plotly: Perigee 2026:283:02:05:06.148 color='rgb(47, 138, 196)' marker='circle'
2026-11-03 07:37:37,556 get_color_marker_for_perigee_plotly: Perigee 2026:285:17:32:26.957 color='rgb(118, 78, 159)' marker='square'
2026-11-03 07:37:37,556 get_color_marker_for_perigee_plotly: Perigee 2026:288:09:00:09.561 color='rgb(237, 100, 90)' marker='diamond'
2026-11-03 07:37:37,557 get_color_marker_for_perigee_plotly: Perigee 2026:291:00:28:02.332 color='rgb(165, 170, 153)' marker='triangle-up'
2026-11-03 07:37:37,557 get_color_marker_for_perigee_plotly: Perigee 2026:293:15:55:42.147 color='rgb(229, 134, 6)' marker='triangle-down'
2026-11-03 07:37:37,557 get_color_marker_for_perigee_plotly: Perigee 2026:296:07:23:13.605 color='rgb(93, 105, 177)' marker='triangle-left'
2026-11-03 07:37:37,557 get_color_marker_for_perigee_plotly: Perigee 2026:298:22:51:21.297 color='rgb(82, 188, 163)' marker='triangle-right'
2026-11-03 07:37:37,557 get_color_marker_for_perigee_plotly: Perigee 2026:301:14:20:12.626 color='rgb(153, 201, 69)' marker='circle'
2026-11-03 07:37:37,558 get_color_marker_for_perigee_plotly: Perigee 2026:304:05:49:05.932 color='rgb(204, 97, 176)' marker='square'
2026-11-03 07:37:37,558 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-11-03 07:37:38,124 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-11-03 07:37:38,127 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:203:16:09:47.211_2026:203:16:40:55.786.fits.gz
2026-11-03 07:37:38,128 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:203:17:33:04.086_2026:203:18:05:56.186.fits.gz
2026-11-03 07:37:38,128 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:203:18:44:10.136_2026:203:18:51:21.661.fits.gz
2026-11-03 08:37:44,406 main: Overriding starting time with the time of latest low-kalman event
2026-11-03 08:37:44,407 get_lowkals_new: Getting telemetry between 2026:305:18:18:12.557 and 2026:307:13:37:44.398
2026-11-03 08:37:45,010 get_lowkals_new: Finding intervals of low kalman stars
2026-11-03 08:37:45,041 get_lowkals_new: WARNING: Fewer than two kalman stars at 2026:306:18:10:20.875 for 31.8 secs
2026-11-03 08:37:45,042 get_lowkals_new: Last telemetry date: 2026:307:05:19:02.963
2026-11-03 08:37:45,042 get_lowkals_new: Found 1 new low kalman events
2026-11-03 08:37:45,045 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-11-03 08:37:45,831 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:305:18:18:12.557 2026:307:13:37:44.398