Prev   Index   Next

kalman_watch3: Wed Jul 8 08:34:27 2026

File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log

Task Status AgeMaxAge Last Date
kalman_watch3 OK 0.091.0 Wed Jul 8 08:34:27 2026

No errors

File contents:

2026-07-08 08:31:20,742 log_run_info: ******************************************
2026-07-08 08:31:20,742 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-07-08 08:31:20,742 log_run_info: Version: 0.6.2
2026-07-08 08:31:20,742 log_run_info: Time: Wed Jul 8 08:31:20 2026
2026-07-08 08:31:20,743 log_run_info: User: aca
2026-07-08 08:31:20,743 log_run_info: Machine: kady.cfa.harvard.edu
2026-07-08 08:31:20,743 log_run_info: Processing args:
2026-07-08 08:31:20,743 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-07-08 08:31:20,743 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-07-08 08:31:20,743 log_run_info: 'lookback': 14,
2026-07-08 08:31:20,743 log_run_info: 'make_html': True,
2026-07-08 08:31:20,743 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-07-08 08:31:20,743 log_run_info: 'stop': None}
2026-07-08 08:31:20,743 log_run_info: ******************************************
2026-07-08 08:31:20,748 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-07-08 08:31:20,788 get_evts_perigee: Getting perigee events between 2026:175:12:31:20.743 and 2026:189:12:31:20.743
2026-07-08 08:31:24,875 get_evts_perigee: Found 0 new perigee event(s)
2026-07-08 08:31:24,875 main: No new perigee events, exiting
2026-07-08 08:31:28,854 get_manvrs_perigee: Getting maneuvers from 2026:144:12:31:28.853 to 2026:188:12:31:28.854
2026-07-08 08:31:32,107 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:144:12:31:28.853 to 2026:188:12:31:28.854
2026-07-08 08:31:40,592 get_manvrs_perigee: Excluding Earth block from 2026:150:19:35:15.807 to 2026:150:19:45:28.757
2026-07-08 08:31:40,592 get_manvrs_perigee: Excluding Earth block from 2026:153:12:31:07.072 to 2026:153:12:50:15.072
2026-07-08 08:31:40,593 get_manvrs_perigee: Excluding Earth block from 2026:158:19:11:22.427 to 2026:158:20:02:05.653
2026-07-08 08:31:40,593 get_manvrs_perigee: Excluding Earth block from 2026:161:16:09:23.069 to 2026:161:16:16:05.894
2026-07-08 08:31:40,594 get_manvrs_perigee: Excluding Earth block from 2026:169:08:42:16.338 to 2026:169:09:30:24.788
2026-07-08 08:31:40,661 get_mon_dataset: Getting MON data from 2026:145:13:23:01.451 to 2026:145:13:55:55.601
2026-07-08 08:31:40,661 get_aca_images_cached: Getting ACA images from 2026:145:13:23:01.451 to 2026:145:13:55:55.601
2026-07-08 08:31:40,900 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-07-08 08:34:02,174 get_mon_dataset: Getting MON data from 2026:145:15:03:01.802 to 2026:145:15:35:55.952
2026-07-08 08:34:02,175 get_aca_images_cached: Getting ACA images from 2026:145:15:03:01.802 to 2026:145:15:35:55.952
2026-07-08 08:34:02,401 get_mon_dataset: Getting MON data from 2026:148:03:54:33.516 to 2026:148:04:45:55.691
2026-07-08 08:34:02,401 get_aca_images_cached: Getting ACA images from 2026:148:03:54:33.516 to 2026:148:04:45:55.691
2026-07-08 08:34:02,621 get_mon_dataset: Getting MON data from 2026:148:05:21:42.042 to 2026:148:05:55:56.142
2026-07-08 08:34:02,621 get_aca_images_cached: Getting ACA images from 2026:148:05:21:42.042 to 2026:148:05:55:56.142
2026-07-08 08:34:02,815 get_mon_dataset: Getting MON data from 2026:150:19:09:09.606 to 2026:150:19:35:15.807
2026-07-08 08:34:02,815 get_aca_images_cached: Getting ACA images from 2026:150:19:09:09.606 to 2026:150:19:35:15.807
2026-07-08 08:34:03,006 get_mon_dataset: Getting MON data from 2026:150:19:45:28.757 to 2026:150:19:55:56.057
2026-07-08 08:34:03,006 get_aca_images_cached: Getting ACA images from 2026:150:19:45:28.757 to 2026:150:19:55:56.057
2026-07-08 08:34:03,171 get_mon_dataset: Getting MON data from 2026:153:10:33:29.947 to 2026:153:10:55:55.772
2026-07-08 08:34:03,171 get_aca_images_cached: Getting ACA images from 2026:153:10:33:29.947 to 2026:153:10:55:55.772
2026-07-08 08:34:03,354 get_mon_dataset: Getting MON data from 2026:153:12:28:16.922 to 2026:153:12:31:07.072
2026-07-08 08:34:03,354 get_aca_images_cached: Getting ACA images from 2026:153:12:28:16.922 to 2026:153:12:31:07.072
2026-07-08 08:34:03,508 get_mon_dataset: Getting MON data from 2026:153:12:50:15.072 to 2026:153:12:50:56.072
2026-07-08 08:34:03,508 get_aca_images_cached: Getting ACA images from 2026:153:12:50:15.072 to 2026:153:12:50:56.072
2026-07-08 08:34:03,528 get_mon_dataset: Not enough images for slot 0 found 6)
2026-07-08 08:34:03,529 get_mon_dataset: Not enough images for slot 1 found 6)
2026-07-08 08:34:03,529 get_mon_dataset: Not enough images for slot 2 found 6)
2026-07-08 08:34:03,530 get_mon_dataset: Not enough images for slot 3 found 6)
2026-07-08 08:34:03,531 get_mon_dataset: Not enough images for slot 4 found 6)
2026-07-08 08:34:03,532 get_mon_dataset: Not enough images for slot 5 found 6)
2026-07-08 08:34:03,533 get_mon_dataset: Not enough images for slot 6 found 6)
2026-07-08 08:34:03,533 get_mon_dataset: Not enough images for slot 7 found 6)
2026-07-08 08:34:03,534 get_mon_dataset: Getting MON data from 2026:153:13:45:00.197 to 2026:153:14:14:04.748
2026-07-08 08:34:03,534 get_aca_images_cached: Getting ACA images from 2026:153:13:45:00.197 to 2026:153:14:14:04.748
2026-07-08 08:34:03,731 get_mon_dataset: Getting MON data from 2026:156:02:24:07.762 to 2026:156:02:55:56.312
2026-07-08 08:34:03,731 get_aca_images_cached: Getting ACA images from 2026:156:02:24:07.762 to 2026:156:02:55:56.312
2026-07-08 08:34:03,948 get_mon_dataset: Getting MON data from 2026:156:03:50:00.437 to 2026:156:04:09:56.612
2026-07-08 08:34:03,948 get_aca_images_cached: Getting ACA images from 2026:156:03:50:00.437 to 2026:156:04:09:56.612
2026-07-08 08:34:04,130 get_mon_dataset: Getting MON data from 2026:158:17:45:50.252 to 2026:158:18:10:55.977
2026-07-08 08:34:04,130 get_aca_images_cached: Getting ACA images from 2026:158:17:45:50.252 to 2026:158:18:10:55.977
2026-07-08 08:34:04,323 get_mon_dataset: Getting MON data from 2026:158:19:05:00.102 to 2026:158:19:11:22.427
2026-07-08 08:34:04,323 get_aca_images_cached: Getting ACA images from 2026:158:19:05:00.102 to 2026:158:19:11:22.427
2026-07-08 08:34:04,482 get_mon_dataset: Getting MON data from 2026:158:20:02:05.653 to 2026:158:20:03:25.603
2026-07-08 08:34:04,482 get_aca_images_cached: Getting ACA images from 2026:158:20:02:05.653 to 2026:158:20:03:25.603
2026-07-08 08:34:04,633 get_mon_dataset: Getting MON data from 2026:158:20:23:11.528 to 2026:158:20:51:03.303
2026-07-08 08:34:04,633 get_aca_images_cached: Getting ACA images from 2026:158:20:23:11.528 to 2026:158:20:51:03.303
2026-07-08 08:34:05,052 get_mon_dataset: Getting MON data from 2026:161:10:24:24.218 to 2026:161:10:55:56.368
2026-07-08 08:34:05,052 get_aca_images_cached: Getting ACA images from 2026:161:10:24:24.218 to 2026:161:10:55:56.368
2026-07-08 08:34:05,252 get_mon_dataset: Getting MON data from 2026:161:11:50:00.493 to 2026:161:12:29:27.218
2026-07-08 08:34:05,252 get_aca_images_cached: Getting ACA images from 2026:161:11:50:00.493 to 2026:161:12:29:27.218
2026-07-08 08:34:05,473 get_mon_dataset: Getting MON data from 2026:164:00:55:52.183 to 2026:164:01:25:56.183
2026-07-08 08:34:05,473 get_aca_images_cached: Getting ACA images from 2026:164:00:55:52.183 to 2026:164:01:25:56.183
2026-07-08 08:34:05,669 get_mon_dataset: Getting MON data from 2026:164:02:20:00.308 to 2026:164:03:00:34.683
2026-07-08 08:34:05,669 get_aca_images_cached: Getting ACA images from 2026:164:02:20:00.308 to 2026:164:03:00:34.683
2026-07-08 08:34:05,882 get_mon_dataset: Getting MON data from 2026:169:07:07:36.813 to 2026:169:07:34:30.163
2026-07-08 08:34:05,882 get_aca_images_cached: Getting ACA images from 2026:169:07:07:36.813 to 2026:169:07:34:30.163
2026-07-08 08:34:06,084 get_mon_dataset: Getting MON data from 2026:169:08:41:30.213 to 2026:169:08:42:16.338
2026-07-08 08:34:06,085 get_aca_images_cached: Getting ACA images from 2026:169:08:41:30.213 to 2026:169:08:42:16.338
2026-07-08 08:34:06,111 get_mon_dataset: Not enough images for slot 0 found 8)
2026-07-08 08:34:06,112 get_mon_dataset: Not enough images for slot 1 found 8)
2026-07-08 08:34:06,113 get_mon_dataset: Not enough images for slot 2 found 8)
2026-07-08 08:34:06,113 get_mon_dataset: Not enough images for slot 3 found 8)
2026-07-08 08:34:06,114 get_mon_dataset: Not enough images for slot 4 found 8)
2026-07-08 08:34:06,115 get_mon_dataset: Not enough images for slot 5 found 8)
2026-07-08 08:34:06,116 get_mon_dataset: Not enough images for slot 6 found 8)
2026-07-08 08:34:06,116 get_mon_dataset: Not enough images for slot 7 found 8)
2026-07-08 08:34:06,117 get_mon_dataset: Getting MON data from 2026:169:09:30:24.788 to 2026:169:09:39:55.713
2026-07-08 08:34:06,117 get_aca_images_cached: Getting ACA images from 2026:169:09:30:24.788 to 2026:169:09:39:55.713
2026-07-08 08:34:06,293 get_mon_dataset: Getting MON data from 2026:172:01:59:09.379 to 2026:172:02:06:19.879
2026-07-08 08:34:06,293 get_aca_images_cached: Getting ACA images from 2026:172:01:59:09.379 to 2026:172:02:06:19.879
2026-07-08 08:34:06,354 get_mon_dataset: Not enough images for slot 0 found 0)
2026-07-08 08:34:06,356 get_mon_dataset: Not enough images for slot 1 found 0)
2026-07-08 08:34:06,356 get_mon_dataset: Not enough images for slot 2 found 0)
2026-07-08 08:34:06,357 get_mon_dataset: Not enough images for slot 3 found 0)
2026-07-08 08:34:06,358 get_mon_dataset: Not enough images for slot 4 found 0)
2026-07-08 08:34:06,359 get_mon_dataset: Not enough images for slot 5 found 0)
2026-07-08 08:34:06,360 get_mon_dataset: Not enough images for slot 6 found 0)
2026-07-08 08:34:06,361 get_mon_dataset: Not enough images for slot 7 found 0)
2026-07-08 08:34:06,362 get_mon_dataset: Getting MON data from 2026:174:14:16:33.143 to 2026:174:14:55:55.768
2026-07-08 08:34:06,362 get_aca_images_cached: Getting ACA images from 2026:174:14:16:33.143 to 2026:174:14:55:55.768
2026-07-08 08:34:06,602 get_mon_dataset: Getting MON data from 2026:174:17:14:10.069 to 2026:174:17:21:21.594
2026-07-08 08:34:06,602 get_aca_images_cached: Getting ACA images from 2026:174:17:14:10.069 to 2026:174:17:21:21.594
2026-07-08 08:34:06,659 get_mon_dataset: Not enough images for slot 0 found 0)
2026-07-08 08:34:06,660 get_mon_dataset: Not enough images for slot 1 found 0)
2026-07-08 08:34:06,661 get_mon_dataset: Not enough images for slot 2 found 0)
2026-07-08 08:34:06,662 get_mon_dataset: Not enough images for slot 3 found 0)
2026-07-08 08:34:06,663 get_mon_dataset: Not enough images for slot 4 found 0)
2026-07-08 08:34:06,664 get_mon_dataset: Not enough images for slot 5 found 0)
2026-07-08 08:34:06,665 get_mon_dataset: Not enough images for slot 6 found 0)
2026-07-08 08:34:06,666 get_mon_dataset: Not enough images for slot 7 found 0)
2026-07-08 08:34:06,666 get_mon_dataset: Getting MON data from 2026:177:07:06:41.034 to 2026:177:07:25:56.209
2026-07-08 08:34:06,666 get_aca_images_cached: Getting ACA images from 2026:177:07:06:41.034 to 2026:177:07:25:56.209
2026-07-08 08:34:06,893 get_mon_dataset: Getting MON data from 2026:182:12:11:40.989 to 2026:182:12:45:56.114
2026-07-08 08:34:06,893 get_aca_images_cached: Getting ACA images from 2026:182:12:11:40.989 to 2026:182:12:45:56.114
2026-07-08 08:34:07,142 get_mon_dataset: Getting MON data from 2026:182:15:51:40.940 to 2026:182:16:25:56.065
2026-07-08 08:34:07,142 get_aca_images_cached: Getting ACA images from 2026:182:15:51:40.940 to 2026:182:16:25:56.065
2026-07-08 08:34:07,360 get_mon_dataset: Getting MON data from 2026:185:04:24:00.554 to 2026:185:04:55:56.279
2026-07-08 08:34:07,360 get_aca_images_cached: Getting ACA images from 2026:185:04:24:00.554 to 2026:185:04:55:56.279
2026-07-08 08:34:07,568 get_mon_dataset: Getting MON data from 2026:187:19:16:48.744 to 2026:187:19:55:55.994
2026-07-08 08:34:07,568 get_aca_images_cached: Getting ACA images from 2026:187:19:16:48.744 to 2026:187:19:55:55.994
2026-07-08 08:34:07,822 get_mon_dataset: Getting MON data from 2026:187:20:50:00.120 to 2026:187:21:29:09.420
2026-07-08 08:34:07,822 get_aca_images_cached: Getting ACA images from 2026:187:20:50:00.120 to 2026:187:21:29:09.420
2026-07-08 08:34:08,066 get_mon_dataset: Getting MON data from 2026:187:22:23:13.545 to 2026:187:22:55:01.070
2026-07-08 08:34:08,066 get_aca_images_cached: Getting ACA images from 2026:187:22:23:13.545 to 2026:187:22:55:01.070
2026-07-08 08:34:08,657 get_kalman_drops_nman: processing NMAN data
2026-07-08 08:34:08,736 get_kalman_drops_nman: Skipping NMAN from 2026:153:12:28:16.922 to 2026:153:12:31:07.072 due to insufficient monitor window data within 100 minutes of perigee
2026-07-08 08:34:08,742 get_kalman_drops_nman: Skipping NMAN from 2026:153:13:45:00.197 to 2026:153:14:14:04.748 due to insufficient monitor window data within 100 minutes of perigee
2026-07-08 08:34:08,783 get_kalman_drops_nman: Skipping NMAN from 2026:158:20:02:05.653 to 2026:158:20:03:25.603 due to insufficient monitor window data within 100 minutes of perigee
2026-07-08 08:34:08,877 get_kalman_drops_nman: Skipping NMAN from 2026:182:12:11:40.989 to 2026:182:12:45:56.114 due to insufficient monitor window data within 100 minutes of perigee
2026-07-08 07:34:10,445 _get_tlm: Getting telemetry for 2026:145:13:45:34.840
2026-07-08 07:34:10,718 obss: Getting observations from kadi commands for 2026/May-25
2026-07-08 07:34:10,732 _get_tlm: Getting telemetry for 2026:148:05:13:21.213
2026-07-08 07:34:10,975 obss: Getting observations from kadi commands for 2026/May-28
2026-07-08 07:34:10,985 _get_tlm: Getting telemetry for 2026:150:20:41:23.454
2026-07-08 07:34:11,249 obss: Getting observations from kadi commands for 2026/May-30
2026-07-08 07:34:11,262 _get_tlm: Getting telemetry for 2026:153:12:09:40.189
2026-07-08 07:34:11,506 obss: Getting observations from kadi commands for 2026/Jun-02
2026-07-08 07:34:11,519 _get_tlm: Getting telemetry for 2026:156:03:37:49.671
2026-07-08 07:34:11,779 obss: Getting observations from kadi commands for 2026/Jun-05
2026-07-08 07:34:11,792 _get_tlm: Getting telemetry for 2026:158:19:05:39.194
2026-07-08 07:34:12,042 obss: Getting observations from kadi commands for 2026/Jun-07
2026-07-08 07:34:12,052 _get_tlm: Getting telemetry for 2026:161:10:33:38.945
2026-07-08 07:34:12,288 obss: Getting observations from kadi commands for 2026/Jun-10
2026-07-08 07:34:12,301 _get_tlm: Getting telemetry for 2026:164:02:02:28.112
2026-07-08 07:34:12,550 obss: Getting observations from kadi commands for 2026/Jun-13
2026-07-08 07:34:12,562 _get_tlm: Getting telemetry for 2026:166:17:31:53.459
2026-07-08 07:34:12,796 obss: Getting observations from kadi commands for 2026/Jun-15
2026-07-08 07:34:12,812 _get_tlm: Getting telemetry for 2026:169:09:00:49.551
2026-07-08 07:34:13,049 obss: Getting observations from kadi commands for 2026/Jun-18
2026-07-08 07:34:13,061 _get_tlm: Getting telemetry for 2026:172:00:28:55.299
2026-07-08 07:34:13,326 obss: Getting observations from kadi commands for 2026/Jun-21
2026-07-08 07:34:13,341 _get_tlm: Getting telemetry for 2026:174:15:56:43.956
2026-07-08 07:34:13,593 obss: Getting observations from kadi commands for 2026/Jun-23
2026-07-08 07:34:13,606 _get_tlm: Getting telemetry for 2026:177:07:24:39.671
2026-07-08 07:34:13,847 obss: Getting observations from kadi commands for 2026/Jun-26
2026-07-08 07:34:13,861 _get_tlm: Getting telemetry for 2026:179:22:52:53.972
2026-07-08 07:34:14,122 obss: Getting observations from kadi commands for 2026/Jun-28
2026-07-08 07:34:14,138 _get_tlm: Getting telemetry for 2026:182:14:21:06.581
2026-07-08 07:34:14,376 obss: Getting observations from kadi commands for 2026/Jul-01
2026-07-08 07:34:14,391 _get_tlm: Getting telemetry for 2026:185:05:48:58.192
2026-07-08 07:34:14,629 obss: Getting observations from kadi commands for 2026/Jul-04
2026-07-08 07:34:14,643 _get_tlm: Getting telemetry for 2026:187:21:16:49.234
2026-07-08 07:34:14,879 obss: Getting observations from kadi commands for 2026/Jul-06
2026-07-08 07:34:23,637 get_color_marker_for_perigee_plotly: Perigee 2026:145:13:45:34.840 color='rgb(229, 134, 6)' marker='circle'
2026-07-08 07:34:23,637 get_color_marker_for_perigee_plotly: Perigee 2026:148:05:13:21.213 color='rgb(93, 105, 177)' marker='square'
2026-07-08 07:34:23,637 get_color_marker_for_perigee_plotly: Perigee 2026:150:20:41:23.454 color='rgb(82, 188, 163)' marker='diamond'
2026-07-08 07:34:23,637 get_color_marker_for_perigee_plotly: Perigee 2026:153:12:09:40.189 color='rgb(153, 201, 69)' marker='triangle-up'
2026-07-08 07:34:23,638 get_color_marker_for_perigee_plotly: Perigee 2026:156:03:37:49.671 color='rgb(204, 97, 176)' marker='triangle-down'
2026-07-08 07:34:23,638 get_color_marker_for_perigee_plotly: Perigee 2026:158:19:05:39.194 color='rgb(36, 121, 108)' marker='triangle-left'
2026-07-08 07:34:23,638 get_color_marker_for_perigee_plotly: Perigee 2026:161:10:33:38.945 color='rgb(218, 165, 27)' marker='triangle-right'
2026-07-08 07:34:23,638 get_color_marker_for_perigee_plotly: Perigee 2026:164:02:02:28.112 color='rgb(47, 138, 196)' marker='circle'
2026-07-08 07:34:23,638 get_color_marker_for_perigee_plotly: Perigee 2026:166:17:31:53.459 color='rgb(118, 78, 159)' marker='square'
2026-07-08 07:34:23,639 get_color_marker_for_perigee_plotly: Perigee 2026:169:09:00:49.551 color='rgb(237, 100, 90)' marker='diamond'
2026-07-08 07:34:23,639 get_color_marker_for_perigee_plotly: Perigee 2026:172:00:28:55.299 color='rgb(165, 170, 153)' marker='triangle-up'
2026-07-08 07:34:23,639 get_color_marker_for_perigee_plotly: Perigee 2026:174:15:56:43.956 color='rgb(229, 134, 6)' marker='triangle-down'
2026-07-08 07:34:23,639 get_color_marker_for_perigee_plotly: Perigee 2026:177:07:24:39.671 color='rgb(93, 105, 177)' marker='triangle-left'
2026-07-08 07:34:23,640 get_color_marker_for_perigee_plotly: Perigee 2026:179:22:52:53.972 color='rgb(82, 188, 163)' marker='triangle-right'
2026-07-08 07:34:23,640 get_color_marker_for_perigee_plotly: Perigee 2026:182:14:21:06.581 color='rgb(153, 201, 69)' marker='circle'
2026-07-08 07:34:23,640 get_color_marker_for_perigee_plotly: Perigee 2026:185:05:48:58.192 color='rgb(204, 97, 176)' marker='square'
2026-07-08 07:34:23,640 get_color_marker_for_perigee_plotly: Perigee 2026:187:21:16:49.234 color='rgb(36, 121, 108)' marker='diamond'
2026-07-08 07:34:23,640 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-07-08 07:34:24,184 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-07-08 08:34:26,877 main: Overriding starting time with the time of latest low-kalman event
2026-07-08 08:34:26,877 get_lowkals_new: Getting telemetry between 2026:188:03:21:43.878 and 2026:189:12:34:26.870
2026-07-08 08:34:27,198 get_lowkals_new: Finding intervals of low kalman stars
2026-07-08 08:34:27,218 get_lowkals_new: Last telemetry date: 2026:189:00:15:14.284
2026-07-08 08:34:27,220 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-07-08 08:34:27,532 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:188:03:21:43.878 2026:189:12:34:26.870