Prev
Index
Next
kalman_watch3: Mon Nov 10 08:34:16 2025
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
OK
|
0.09 | 1.0 |
Mon Nov 10 08:34:16 2025 |
No errors
File contents:
2025-11-10 08:31:12,248 log_run_info: ******************************************
2025-11-10 08:31:12,248 log_run_info: Running: /proj/sot/ska3/aca/lib/python3.12/site-packages/kalman_watch/kalman_perigee_mon.py
2025-11-10 08:31:12,248 log_run_info: Version: 0.6.1
2025-11-10 08:31:12,248 log_run_info: Time: Mon Nov 10 08:31:12 2025
2025-11-10 08:31:12,248 log_run_info: User: aca
2025-11-10 08:31:12,248 log_run_info: Machine: kady.cfa.harvard.edu
2025-11-10 08:31:12,248 log_run_info: Processing args:
2025-11-10 08:31:12,248 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca/www/ASPECT/kalman_watch3'),
2025-11-10 08:31:12,248 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2025-11-10 08:31:12,248 log_run_info: 'lookback': 14,
2025-11-10 08:31:12,248 log_run_info: 'make_html': True,
2025-11-10 08:31:12,248 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca/data/stk/radiation_data.fits'),
2025-11-10 08:31:12,248 log_run_info: 'stop': None}
2025-11-10 08:31:12,248 log_run_info: ******************************************
2025-11-10 08:31:12,250 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2025-11-10 08:31:12,278 get_evts_perigee: Getting perigee events between 2025:300:13:31:12.249 and 2025:314:13:31:12.249
2025-11-10 08:31:14,322 get_evts_perigee: Found 0 new perigee event(s)
2025-11-10 08:31:14,322 main: No new perigee events, exiting
2025-11-10 08:31:18,329 get_manvrs_perigee: Getting maneuvers from 2025:269:13:31:18.328 to 2025:313:13:31:18.329
2025-11-10 08:31:22,161 get_manvrs_perigee: Getting intervals of Earth blocks from 2025:269:13:31:18.328 to 2025:313:13:31:18.329
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:275:19:44:43.207 to 2025:275:19:47:43.607
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:280:03:52:15.982 to 2025:280:03:59:16.232
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:280:05:06:09.107 to 2025:280:05:12:57.057
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:280:13:04:36.284 to 2025:280:13:14:36.934
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:286:06:25:29.142 to 2025:286:06:30:30.492
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:293:02:21:53.931 to 2025:293:02:27:35.256
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:293:05:44:44.781 to 2025:293:05:49:44.081
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:294:15:45:02.589 to 2025:294:15:47:21.989
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:294:19:44:45.390 to 2025:294:19:49:48.790
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:296:20:07:34.427 to 2025:296:20:11:55.802
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:301:14:48:10.629 to 2025:301:15:18:46.404
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:304:06:09:15.194 to 2025:304:06:28:00.644
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:305:17:09:49.203 to 2025:305:17:14:58.753
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:309:12:49:51.049 to 2025:309:12:54:40.099
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:310:22:34:54.558 to 2025:310:22:37:47.783
2025-11-10 08:31:29,134 get_manvrs_perigee: Excluding Earth block from 2025:311:06:49:50.859 to 2025:311:06:55:19.885
2025-11-10 08:31:29,205 get_mon_dataset: Getting MON data from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-11-10 08:31:29,205 get_aca_images_cached: Getting ACA images from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-11-10 08:31:29,439 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2025-11-10 08:33:47,437 get_mon_dataset: Getting MON data from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-11-10 08:33:47,437 get_aca_images_cached: Getting ACA images from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-11-10 08:33:47,662 get_mon_dataset: Getting MON data from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-11-10 08:33:47,662 get_aca_images_cached: Getting ACA images from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-11-10 08:33:48,133 get_mon_dataset: Getting MON data from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-11-10 08:33:48,133 get_aca_images_cached: Getting ACA images from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-11-10 08:33:48,576 get_mon_dataset: Getting MON data from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-11-10 08:33:48,576 get_aca_images_cached: Getting ACA images from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-11-10 08:33:48,741 get_mon_dataset: Getting MON data from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-11-10 08:33:48,741 get_aca_images_cached: Getting ACA images from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-11-10 08:33:49,202 get_mon_dataset: Getting MON data from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-11-10 08:33:49,202 get_aca_images_cached: Getting ACA images from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-11-10 08:33:49,380 get_mon_dataset: Getting MON data from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-11-10 08:33:49,380 get_aca_images_cached: Getting ACA images from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-11-10 08:33:49,560 get_mon_dataset: Getting MON data from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-11-10 08:33:49,561 get_aca_images_cached: Getting ACA images from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-11-10 08:33:49,766 get_mon_dataset: Getting MON data from 2025:288:09:34:39.629 to 2025:288:09:55:55.754
2025-11-10 08:33:49,766 get_aca_images_cached: Getting ACA images from 2025:288:09:34:39.629 to 2025:288:09:55:55.754
2025-11-10 08:33:49,944 get_mon_dataset: Getting MON data from 2025:288:11:25:14.454 to 2025:288:11:55:55.354
2025-11-10 08:33:49,944 get_aca_images_cached: Getting ACA images from 2025:288:11:25:14.454 to 2025:288:11:55:55.354
2025-11-10 08:33:50,402 get_mon_dataset: Getting MON data from 2025:291:00:19:31.194 to 2025:291:00:55:56.494
2025-11-10 08:33:50,402 get_aca_images_cached: Getting ACA images from 2025:291:00:19:31.194 to 2025:291:00:55:56.494
2025-11-10 08:33:50,869 get_mon_dataset: Getting MON data from 2025:291:02:49:30.694 to 2025:291:03:25:55.994
2025-11-10 08:33:50,870 get_aca_images_cached: Getting ACA images from 2025:291:02:49:30.694 to 2025:291:03:25:55.994
2025-11-10 08:33:51,336 get_mon_dataset: Getting MON data from 2025:293:17:04:09.034 to 2025:293:17:11:20.559
2025-11-10 08:33:51,336 get_aca_images_cached: Getting ACA images from 2025:293:17:04:09.034 to 2025:293:17:11:20.559
2025-11-10 08:33:51,364 get_mon_dataset: Not enough images for slot 0 found 0)
2025-11-10 08:33:51,365 get_mon_dataset: Not enough images for slot 1 found 0)
2025-11-10 08:33:51,366 get_mon_dataset: Not enough images for slot 2 found 0)
2025-11-10 08:33:51,367 get_mon_dataset: Not enough images for slot 3 found 0)
2025-11-10 08:33:51,368 get_mon_dataset: Not enough images for slot 4 found 0)
2025-11-10 08:33:51,369 get_mon_dataset: Not enough images for slot 5 found 0)
2025-11-10 08:33:51,370 get_mon_dataset: Not enough images for slot 6 found 0)
2025-11-10 08:33:51,371 get_mon_dataset: Not enough images for slot 7 found 0)
2025-11-10 08:33:51,371 get_mon_dataset: Getting MON data from 2025:293:17:37:54.434 to 2025:293:18:10:55.759
2025-11-10 08:33:51,371 get_aca_images_cached: Getting ACA images from 2025:293:17:37:54.434 to 2025:293:18:10:55.759
2025-11-10 08:33:51,964 get_mon_dataset: Getting MON data from 2025:296:07:50:00.049 to 2025:296:08:08:45.499
2025-11-10 08:33:51,964 get_aca_images_cached: Getting ACA images from 2025:296:07:50:00.049 to 2025:296:08:08:45.499
2025-11-10 08:33:52,151 get_mon_dataset: Getting MON data from 2025:296:10:28:28.975 to 2025:296:10:55:56.150
2025-11-10 08:33:52,151 get_aca_images_cached: Getting ACA images from 2025:296:10:28:28.975 to 2025:296:10:55:56.150
2025-11-10 08:33:52,616 get_mon_dataset: Getting MON data from 2025:298:22:26:40.639 to 2025:298:22:55:55.439
2025-11-10 08:33:52,617 get_aca_images_cached: Getting ACA images from 2025:298:22:26:40.639 to 2025:298:22:55:55.439
2025-11-10 08:33:52,815 get_mon_dataset: Getting MON data from 2025:299:01:22:17.640 to 2025:299:01:50:55.540
2025-11-10 08:33:52,815 get_aca_images_cached: Getting ACA images from 2025:299:01:22:17.640 to 2025:299:01:50:55.540
2025-11-10 08:33:53,241 get_mon_dataset: Getting MON data from 2025:301:14:24:36.129 to 2025:301:14:48:10.629
2025-11-10 08:33:53,241 get_aca_images_cached: Getting ACA images from 2025:301:14:24:36.129 to 2025:301:14:48:10.629
2025-11-10 08:33:53,472 get_mon_dataset: Getting MON data from 2025:301:15:18:46.404 to 2025:301:15:21:26.304
2025-11-10 08:33:53,472 get_aca_images_cached: Getting ACA images from 2025:301:15:18:46.404 to 2025:301:15:21:26.304
2025-11-10 08:33:53,635 get_mon_dataset: Getting MON data from 2025:301:16:26:14.130 to 2025:301:17:00:55.905
2025-11-10 08:33:53,635 get_aca_images_cached: Getting ACA images from 2025:301:16:26:14.130 to 2025:301:17:00:55.905
2025-11-10 08:33:53,836 get_mon_dataset: Getting MON data from 2025:301:17:20:41.830 to 2025:301:17:57:37.880
2025-11-10 08:33:53,836 get_aca_images_cached: Getting ACA images from 2025:301:17:20:41.830 to 2025:301:17:57:37.880
2025-11-10 08:33:54,041 get_mon_dataset: Getting MON data from 2025:304:05:44:16.644 to 2025:304:06:09:15.194
2025-11-10 08:33:54,041 get_aca_images_cached: Getting ACA images from 2025:304:05:44:16.644 to 2025:304:06:09:15.194
2025-11-10 08:33:54,499 get_mon_dataset: Getting MON data from 2025:304:06:28:00.644 to 2025:304:06:40:25.819
2025-11-10 08:33:54,499 get_aca_images_cached: Getting ACA images from 2025:304:06:28:00.644 to 2025:304:06:40:25.819
2025-11-10 08:33:54,693 get_mon_dataset: Getting MON data from 2025:306:21:21:39.059 to 2025:306:21:55:56.235
2025-11-10 08:33:54,694 get_aca_images_cached: Getting ACA images from 2025:306:21:21:39.059 to 2025:306:21:55:56.235
2025-11-10 08:33:55,166 get_mon_dataset: Getting MON data from 2025:307:00:05:12.410 to 2025:307:00:25:55.735
2025-11-10 08:33:55,166 get_aca_images_cached: Getting ACA images from 2025:307:00:05:12.410 to 2025:307:00:25:55.735
2025-11-10 08:33:55,352 get_mon_dataset: Getting MON data from 2025:309:12:39:08.374 to 2025:309:12:49:51.049
2025-11-10 08:33:55,352 get_aca_images_cached: Getting ACA images from 2025:309:12:39:08.374 to 2025:309:12:49:51.049
2025-11-10 08:33:55,527 get_mon_dataset: Getting MON data from 2025:309:12:54:40.099 to 2025:309:13:15:56.225
2025-11-10 08:33:55,527 get_aca_images_cached: Getting ACA images from 2025:309:12:54:40.099 to 2025:309:13:15:56.225
2025-11-10 08:33:55,714 get_mon_dataset: Getting MON data from 2025:309:14:48:53.250 to 2025:309:15:25:55.450
2025-11-10 08:33:55,714 get_aca_images_cached: Getting ACA images from 2025:309:14:48:53.250 to 2025:309:15:25:55.450
2025-11-10 08:33:55,922 get_mon_dataset: Getting MON data from 2025:312:04:03:19.490 to 2025:312:04:35:56.215
2025-11-10 08:33:55,922 get_aca_images_cached: Getting ACA images from 2025:312:04:03:19.490 to 2025:312:04:35:56.215
2025-11-10 08:33:56,403 get_mon_dataset: Getting MON data from 2025:312:06:15:59.640 to 2025:312:06:40:56.140
2025-11-10 08:33:56,403 get_aca_images_cached: Getting ACA images from 2025:312:06:15:59.640 to 2025:312:06:40:56.140
2025-11-10 08:33:56,599 get_mon_dataset: Getting MON data from 2025:312:07:14:43.590 to 2025:312:07:45:56.265
2025-11-10 08:33:56,599 get_aca_images_cached: Getting ACA images from 2025:312:07:14:43.590 to 2025:312:07:45:56.265
2025-11-10 08:33:56,807 get_kalman_drops_nman: processing NMAN data
2025-11-10 08:33:56,959 get_kalman_drops_nman: Skipping NMAN from 2025:296:10:28:28.975 to 2025:296:10:55:56.150 due to insufficient monitor window data within 100 minutes of perigee
2025-11-10 08:33:56,992 get_kalman_drops_nman: Skipping NMAN from 2025:301:15:18:46.404 to 2025:301:15:21:26.304 due to insufficient monitor window data within 100 minutes of perigee
2025-11-10 08:33:57,099 get_kalman_drops_nman: Skipping NMAN from 2025:312:07:14:43.590 to 2025:312:07:45:56.265 due to insufficient monitor window data within 100 minutes of perigee
2025-11-10 07:33:57,544 _get_tlm: Getting telemetry for 2025:269:22:13:27.704
2025-11-10 07:33:58,055 obss: Getting observations from kadi commands for 2025/Sep-26
2025-11-10 07:33:58,068 _get_tlm: Getting telemetry for 2025:272:13:41:09.383
2025-11-10 07:33:58,309 obss: Getting observations from kadi commands for 2025/Sep-29
2025-11-10 07:33:58,326 _get_tlm: Getting telemetry for 2025:275:05:08:45.990
2025-11-10 07:33:58,583 obss: Getting observations from kadi commands for 2025/Oct-02
2025-11-10 07:33:58,597 _get_tlm: Getting telemetry for 2025:277:20:35:43.686
2025-11-10 07:33:58,831 obss: Getting observations from kadi commands for 2025/Oct-04
2025-11-10 07:33:58,848 _get_tlm: Getting telemetry for 2025:280:12:02:48.870
2025-11-10 07:33:59,301 obss: Getting observations from kadi commands for 2025/Oct-07
2025-11-10 07:33:59,315 _get_tlm: Getting telemetry for 2025:283:03:31:06.093
2025-11-10 07:33:59,569 obss: Getting observations from kadi commands for 2025/Oct-10
2025-11-10 07:33:59,582 _get_tlm: Getting telemetry for 2025:285:19:00:07.176
2025-11-10 07:33:59,826 obss: Getting observations from kadi commands for 2025/Oct-12
2025-11-10 07:33:59,840 _get_tlm: Getting telemetry for 2025:288:10:28:48.952
2025-11-10 07:34:00,097 obss: Getting observations from kadi commands for 2025/Oct-15
2025-11-10 07:34:00,110 _get_tlm: Getting telemetry for 2025:291:01:56:50.217
2025-11-10 07:34:00,364 obss: Getting observations from kadi commands for 2025/Oct-18
2025-11-10 07:34:00,375 _get_tlm: Getting telemetry for 2025:293:17:24:20.673
2025-11-10 07:34:00,629 obss: Getting observations from kadi commands for 2025/Oct-20
2025-11-10 07:34:00,643 _get_tlm: Getting telemetry for 2025:296:08:51:47.275
2025-11-10 07:34:00,900 obss: Getting observations from kadi commands for 2025/Oct-23
2025-11-10 07:34:00,916 _get_tlm: Getting telemetry for 2025:299:00:19:32.107
2025-11-10 07:34:01,184 obss: Getting observations from kadi commands for 2025/Oct-26
2025-11-10 07:34:01,198 _get_tlm: Getting telemetry for 2025:301:15:47:27.439
2025-11-10 07:34:01,501 obss: Getting observations from kadi commands for 2025/Oct-28
2025-11-10 07:34:01,512 _get_tlm: Getting telemetry for 2025:304:07:14:52.585
2025-11-10 07:34:01,819 obss: Getting observations from kadi commands for 2025/Oct-31
2025-11-10 07:34:01,833 _get_tlm: Getting telemetry for 2025:306:22:42:00.361
2025-11-10 07:34:02,122 obss: Getting observations from kadi commands for 2025/Nov-02
2025-11-10 07:34:02,136 _get_tlm: Getting telemetry for 2025:309:14:10:01.995
2025-11-10 07:34:02,460 obss: Getting observations from kadi commands for 2025/Nov-05
2025-11-10 07:34:02,472 _get_tlm: Getting telemetry for 2025:312:05:39:09.826
2025-11-10 07:34:02,776 obss: Getting observations from kadi commands for 2025/Nov-08
2025-11-10 07:34:12,099 get_color_marker_for_perigee_plotly: Perigee 2025:269:22:13:27.704 color='rgb(229, 134, 6)' marker='circle'
2025-11-10 07:34:12,099 get_color_marker_for_perigee_plotly: Perigee 2025:272:13:41:09.383 color='rgb(93, 105, 177)' marker='square'
2025-11-10 07:34:12,099 get_color_marker_for_perigee_plotly: Perigee 2025:275:05:08:45.990 color='rgb(82, 188, 163)' marker='diamond'
2025-11-10 07:34:12,100 get_color_marker_for_perigee_plotly: Perigee 2025:277:20:35:43.686 color='rgb(153, 201, 69)' marker='triangle-up'
2025-11-10 07:34:12,100 get_color_marker_for_perigee_plotly: Perigee 2025:280:12:02:48.870 color='rgb(204, 97, 176)' marker='triangle-down'
2025-11-10 07:34:12,100 get_color_marker_for_perigee_plotly: Perigee 2025:283:03:31:06.093 color='rgb(36, 121, 108)' marker='triangle-left'
2025-11-10 07:34:12,100 get_color_marker_for_perigee_plotly: Perigee 2025:285:19:00:07.176 color='rgb(218, 165, 27)' marker='triangle-right'
2025-11-10 07:34:12,100 get_color_marker_for_perigee_plotly: Perigee 2025:288:10:28:48.952 color='rgb(47, 138, 196)' marker='circle'
2025-11-10 07:34:12,101 get_color_marker_for_perigee_plotly: Perigee 2025:291:01:56:50.217 color='rgb(118, 78, 159)' marker='square'
2025-11-10 07:34:12,101 get_color_marker_for_perigee_plotly: Perigee 2025:293:17:24:20.673 color='rgb(237, 100, 90)' marker='diamond'
2025-11-10 07:34:12,101 get_color_marker_for_perigee_plotly: Perigee 2025:296:08:51:47.275 color='rgb(165, 170, 153)' marker='triangle-up'
2025-11-10 07:34:12,101 get_color_marker_for_perigee_plotly: Perigee 2025:299:00:19:32.107 color='rgb(229, 134, 6)' marker='triangle-down'
2025-11-10 07:34:12,101 get_color_marker_for_perigee_plotly: Perigee 2025:301:15:47:27.439 color='rgb(93, 105, 177)' marker='triangle-left'
2025-11-10 07:34:12,102 get_color_marker_for_perigee_plotly: Perigee 2025:304:07:14:52.585 color='rgb(82, 188, 163)' marker='triangle-right'
2025-11-10 07:34:12,102 get_color_marker_for_perigee_plotly: Perigee 2025:306:22:42:00.361 color='rgb(153, 201, 69)' marker='circle'
2025-11-10 07:34:12,102 get_color_marker_for_perigee_plotly: Perigee 2025:309:14:10:01.995 color='rgb(204, 97, 176)' marker='square'
2025-11-10 07:34:12,102 get_color_marker_for_perigee_plotly: Perigee 2025:312:05:39:09.826 color='rgb(36, 121, 108)' marker='diamond'
2025-11-10 07:34:12,103 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2025-11-10 07:34:12,508 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2025-11-10 08:34:15,599 main: Overriding starting time with the time of latest low-kalman event
2025-11-10 08:34:15,600 get_lowkals_new: Getting telemetry between 2025:313:01:48:17.702 and 2025:314:13:34:15.592
2025-11-10 08:34:15,918 get_lowkals_new: Finding intervals of low kalman stars
2025-11-10 08:34:15,939 get_lowkals_new: Last telemetry date: 2025:314:01:47:40.107
2025-11-10 08:34:15,943 main: Updating events file /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2025-11-10 08:34:16,367 make_web_page: Writing HTML to /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/index.html
2025:313:01:48:17.702 2025:314:13:34:15.592