Prev
Index
Next
kalman_watch3: Thu Nov 6 08:34:21 2025
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Thu Nov 6 08:34:21 2025 |
Errors:
- Line 165: 2025-11-06 08:34:21,009 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
File contents:
2025-11-06 08:31:15,313 log_run_info: ******************************************
2025-11-06 08:31:15,313 log_run_info: Running: /proj/sot/ska3/aca/lib/python3.12/site-packages/kalman_watch/kalman_perigee_mon.py
2025-11-06 08:31:15,313 log_run_info: Version: 0.6.1
2025-11-06 08:31:15,313 log_run_info: Time: Thu Nov 6 08:31:15 2025
2025-11-06 08:31:15,313 log_run_info: User: aca
2025-11-06 08:31:15,313 log_run_info: Machine: kady.cfa.harvard.edu
2025-11-06 08:31:15,313 log_run_info: Processing args:
2025-11-06 08:31:15,313 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca/www/ASPECT/kalman_watch3'),
2025-11-06 08:31:15,313 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2025-11-06 08:31:15,313 log_run_info: 'lookback': 14,
2025-11-06 08:31:15,313 log_run_info: 'make_html': True,
2025-11-06 08:31:15,313 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca/data/stk/radiation_data.fits'),
2025-11-06 08:31:15,313 log_run_info: 'stop': None}
2025-11-06 08:31:15,313 log_run_info: ******************************************
2025-11-06 08:31:15,315 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2025-11-06 08:31:15,344 get_evts_perigee: Getting perigee events between 2025:296:13:31:15.314 and 2025:310:13:31:15.314
2025-11-06 08:31:18,806 _get_tlm: Getting telemetry for 2025:309:14:10:01.995
2025-11-06 08:31:19,329 get_evts_perigee: No TLM found for perigee event at 2025:309:14:10:01.995, skipping
2025-11-06 08:31:19,329 get_evts_perigee: Found 0 new perigee event(s)
2025-11-06 08:31:19,329 main: No new perigee events, exiting
2025-11-06 08:31:23,285 get_manvrs_perigee: Getting maneuvers from 2025:265:13:31:23.284 to 2025:309:13:31:23.285
2025-11-06 08:31:26,995 get_manvrs_perigee: Getting intervals of Earth blocks from 2025:265:13:31:23.284 to 2025:309:13:31:23.285
2025-11-06 08:31:34,227 get_manvrs_perigee: Excluding Earth block from 2025:267:08:17:06.358 to 2025:267:08:24:58.883
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:275:19:44:43.207 to 2025:275:19:47:43.607
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:280:03:52:15.982 to 2025:280:03:59:16.232
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:280:05:06:09.107 to 2025:280:05:12:57.057
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:280:13:04:36.284 to 2025:280:13:14:36.934
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:286:06:25:29.142 to 2025:286:06:30:30.492
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:293:02:21:53.931 to 2025:293:02:27:35.256
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:293:05:44:44.781 to 2025:293:05:49:44.081
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:294:15:45:02.589 to 2025:294:15:47:21.989
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:294:19:44:45.390 to 2025:294:19:49:48.790
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:296:20:07:34.427 to 2025:296:20:11:55.802
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:301:14:48:10.629 to 2025:301:15:18:46.404
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:304:06:09:15.194 to 2025:304:06:28:00.644
2025-11-06 08:31:34,228 get_manvrs_perigee: Excluding Earth block from 2025:305:17:09:49.203 to 2025:305:17:14:58.753
2025-11-06 08:31:34,297 get_mon_dataset: Getting MON data from 2025:267:05:33:11.483 to 2025:267:05:55:55.758
2025-11-06 08:31:34,297 get_aca_images_cached: Getting ACA images from 2025:267:05:33:11.483 to 2025:267:05:55:55.758
2025-11-06 08:31:34,498 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2025-11-06 08:33:54,075 get_mon_dataset: Getting MON data from 2025:267:08:12:56.258 to 2025:267:08:17:06.358
2025-11-06 08:33:54,075 get_aca_images_cached: Getting ACA images from 2025:267:08:12:56.258 to 2025:267:08:17:06.358
2025-11-06 08:33:54,255 get_mon_dataset: Getting MON data from 2025:267:08:24:58.883 to 2025:267:08:35:55.908
2025-11-06 08:33:54,255 get_aca_images_cached: Getting ACA images from 2025:267:08:24:58.883 to 2025:267:08:35:55.908
2025-11-06 08:33:54,414 get_mon_dataset: Getting MON data from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-11-06 08:33:54,414 get_aca_images_cached: Getting ACA images from 2025:269:20:57:05.173 to 2025:269:21:25:56.398
2025-11-06 08:33:54,594 get_mon_dataset: Getting MON data from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-11-06 08:33:54,594 get_aca_images_cached: Getting ACA images from 2025:269:23:31:30.148 to 2025:269:23:55:55.899
2025-11-06 08:33:54,767 get_mon_dataset: Getting MON data from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-11-06 08:33:54,767 get_aca_images_cached: Getting ACA images from 2025:275:05:23:07.328 to 2025:275:05:55:55.329
2025-11-06 08:33:54,948 get_mon_dataset: Getting MON data from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-11-06 08:33:54,948 get_aca_images_cached: Getting ACA images from 2025:280:12:47:17.959 to 2025:280:13:04:36.284
2025-11-06 08:33:55,220 get_mon_dataset: Getting MON data from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-11-06 08:33:55,220 get_aca_images_cached: Getting ACA images from 2025:280:13:14:36.934 to 2025:280:13:25:56.509
2025-11-06 08:33:55,378 get_mon_dataset: Getting MON data from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-11-06 08:33:55,378 get_aca_images_cached: Getting ACA images from 2025:283:02:03:56.423 to 2025:283:02:35:26.523
2025-11-06 08:33:55,564 get_mon_dataset: Getting MON data from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-11-06 08:33:55,564 get_aca_images_cached: Getting ACA images from 2025:283:04:55:02.824 to 2025:283:05:15:56.399
2025-11-06 08:33:55,733 get_mon_dataset: Getting MON data from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-11-06 08:33:55,734 get_aca_images_cached: Getting ACA images from 2025:285:17:32:17.638 to 2025:285:17:55:56.239
2025-11-06 08:33:55,909 get_mon_dataset: Getting MON data from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-11-06 08:33:55,909 get_aca_images_cached: Getting ACA images from 2025:285:19:55:14.839 to 2025:285:20:25:55.739
2025-11-06 08:33:56,093 get_mon_dataset: Getting MON data from 2025:288:09:34:39.629 to 2025:288:09:55:55.754
2025-11-06 08:33:56,093 get_aca_images_cached: Getting ACA images from 2025:288:09:34:39.629 to 2025:288:09:55:55.754
2025-11-06 08:33:56,262 get_mon_dataset: Getting MON data from 2025:288:11:25:14.454 to 2025:288:11:55:55.354
2025-11-06 08:33:56,262 get_aca_images_cached: Getting ACA images from 2025:288:11:25:14.454 to 2025:288:11:55:55.354
2025-11-06 08:33:56,443 get_mon_dataset: Getting MON data from 2025:291:00:19:31.194 to 2025:291:00:55:56.494
2025-11-06 08:33:56,443 get_aca_images_cached: Getting ACA images from 2025:291:00:19:31.194 to 2025:291:00:55:56.494
2025-11-06 08:33:56,634 get_mon_dataset: Getting MON data from 2025:291:02:49:30.694 to 2025:291:03:25:55.994
2025-11-06 08:33:56,634 get_aca_images_cached: Getting ACA images from 2025:291:02:49:30.694 to 2025:291:03:25:55.994
2025-11-06 08:33:56,827 get_mon_dataset: Getting MON data from 2025:293:17:04:09.034 to 2025:293:17:11:20.559
2025-11-06 08:33:56,827 get_aca_images_cached: Getting ACA images from 2025:293:17:04:09.034 to 2025:293:17:11:20.559
2025-11-06 08:33:56,854 get_mon_dataset: Not enough images for slot 0 found 0)
2025-11-06 08:33:56,855 get_mon_dataset: Not enough images for slot 1 found 0)
2025-11-06 08:33:56,856 get_mon_dataset: Not enough images for slot 2 found 0)
2025-11-06 08:33:56,857 get_mon_dataset: Not enough images for slot 3 found 0)
2025-11-06 08:33:56,858 get_mon_dataset: Not enough images for slot 4 found 0)
2025-11-06 08:33:56,859 get_mon_dataset: Not enough images for slot 5 found 0)
2025-11-06 08:33:56,860 get_mon_dataset: Not enough images for slot 6 found 0)
2025-11-06 08:33:56,861 get_mon_dataset: Not enough images for slot 7 found 0)
2025-11-06 08:33:56,862 get_mon_dataset: Getting MON data from 2025:293:17:37:54.434 to 2025:293:18:10:55.759
2025-11-06 08:33:56,862 get_aca_images_cached: Getting ACA images from 2025:293:17:37:54.434 to 2025:293:18:10:55.759
2025-11-06 08:33:57,059 get_mon_dataset: Getting MON data from 2025:296:07:50:00.049 to 2025:296:08:08:45.499
2025-11-06 08:33:57,059 get_aca_images_cached: Getting ACA images from 2025:296:07:50:00.049 to 2025:296:08:08:45.499
2025-11-06 08:33:57,240 get_mon_dataset: Getting MON data from 2025:296:10:28:28.975 to 2025:296:10:55:56.150
2025-11-06 08:33:57,240 get_aca_images_cached: Getting ACA images from 2025:296:10:28:28.975 to 2025:296:10:55:56.150
2025-11-06 08:33:57,429 get_mon_dataset: Getting MON data from 2025:298:22:26:40.639 to 2025:298:22:55:55.439
2025-11-06 08:33:57,430 get_aca_images_cached: Getting ACA images from 2025:298:22:26:40.639 to 2025:298:22:55:55.439
2025-11-06 08:33:57,621 get_mon_dataset: Getting MON data from 2025:299:01:22:17.640 to 2025:299:01:50:55.540
2025-11-06 08:33:57,621 get_aca_images_cached: Getting ACA images from 2025:299:01:22:17.640 to 2025:299:01:50:55.540
2025-11-06 08:33:57,810 get_mon_dataset: Getting MON data from 2025:301:14:24:36.129 to 2025:301:14:48:10.629
2025-11-06 08:33:57,811 get_aca_images_cached: Getting ACA images from 2025:301:14:24:36.129 to 2025:301:14:48:10.629
2025-11-06 08:33:57,993 get_mon_dataset: Getting MON data from 2025:301:15:18:46.404 to 2025:301:15:21:26.304
2025-11-06 08:33:57,994 get_aca_images_cached: Getting ACA images from 2025:301:15:18:46.404 to 2025:301:15:21:26.304
2025-11-06 08:33:58,149 get_mon_dataset: Getting MON data from 2025:301:16:26:14.130 to 2025:301:17:00:55.905
2025-11-06 08:33:58,149 get_aca_images_cached: Getting ACA images from 2025:301:16:26:14.130 to 2025:301:17:00:55.905
2025-11-06 08:33:58,345 get_mon_dataset: Getting MON data from 2025:301:17:20:41.830 to 2025:301:17:57:37.880
2025-11-06 08:33:58,345 get_aca_images_cached: Getting ACA images from 2025:301:17:20:41.830 to 2025:301:17:57:37.880
2025-11-06 08:33:58,544 get_mon_dataset: Getting MON data from 2025:304:05:44:16.644 to 2025:304:06:09:15.194
2025-11-06 08:33:58,544 get_aca_images_cached: Getting ACA images from 2025:304:05:44:16.644 to 2025:304:06:09:15.194
2025-11-06 08:33:58,731 get_mon_dataset: Getting MON data from 2025:304:06:28:00.644 to 2025:304:06:40:25.819
2025-11-06 08:33:58,731 get_aca_images_cached: Getting ACA images from 2025:304:06:28:00.644 to 2025:304:06:40:25.819
2025-11-06 08:33:58,994 get_mon_dataset: Getting MON data from 2025:306:21:21:39.059 to 2025:306:21:55:56.235
2025-11-06 08:33:58,994 get_aca_images_cached: Getting ACA images from 2025:306:21:21:39.059 to 2025:306:21:55:56.235
2025-11-06 08:33:59,192 get_mon_dataset: Getting MON data from 2025:307:00:05:12.410 to 2025:307:00:25:55.735
2025-11-06 08:33:59,192 get_aca_images_cached: Getting ACA images from 2025:307:00:05:12.410 to 2025:307:00:25:55.735
2025-11-06 08:33:59,371 get_kalman_drops_nman: processing NMAN data
2025-11-06 08:33:59,385 get_kalman_drops_nman: Skipping NMAN from 2025:267:08:12:56.258 to 2025:267:08:17:06.358 due to insufficient monitor window data within 100 minutes of perigee
2025-11-06 08:33:59,391 get_kalman_drops_nman: Skipping NMAN from 2025:267:08:24:58.883 to 2025:267:08:35:55.908 due to insufficient monitor window data within 100 minutes of perigee
2025-11-06 08:33:59,535 get_kalman_drops_nman: Skipping NMAN from 2025:296:10:28:28.975 to 2025:296:10:55:56.150 due to insufficient monitor window data within 100 minutes of perigee
2025-11-06 08:33:59,567 get_kalman_drops_nman: Skipping NMAN from 2025:301:15:18:46.404 to 2025:301:15:21:26.304 due to insufficient monitor window data within 100 minutes of perigee
2025-11-06 07:34:00,674 _get_tlm: Getting telemetry for 2025:267:06:46:04.296
2025-11-06 07:34:01,109 obss: Getting observations from kadi commands for 2025/Sep-24
2025-11-06 07:34:01,123 _get_tlm: Getting telemetry for 2025:269:22:13:27.704
2025-11-06 07:34:01,515 obss: Getting observations from kadi commands for 2025/Sep-26
2025-11-06 07:34:01,528 _get_tlm: Getting telemetry for 2025:272:13:41:09.383
2025-11-06 07:34:01,810 obss: Getting observations from kadi commands for 2025/Sep-29
2025-11-06 07:34:01,827 _get_tlm: Getting telemetry for 2025:275:05:08:45.990
2025-11-06 07:34:02,179 obss: Getting observations from kadi commands for 2025/Oct-02
2025-11-06 07:34:02,193 _get_tlm: Getting telemetry for 2025:277:20:35:43.686
2025-11-06 07:34:02,483 obss: Getting observations from kadi commands for 2025/Oct-04
2025-11-06 07:34:02,502 _get_tlm: Getting telemetry for 2025:280:12:02:48.870
2025-11-06 07:34:02,837 obss: Getting observations from kadi commands for 2025/Oct-07
2025-11-06 07:34:02,851 _get_tlm: Getting telemetry for 2025:283:03:31:06.093
2025-11-06 07:34:03,132 obss: Getting observations from kadi commands for 2025/Oct-10
2025-11-06 07:34:03,145 _get_tlm: Getting telemetry for 2025:285:19:00:07.176
2025-11-06 07:34:03,426 obss: Getting observations from kadi commands for 2025/Oct-12
2025-11-06 07:34:03,439 _get_tlm: Getting telemetry for 2025:288:10:28:48.952
2025-11-06 07:34:04,008 obss: Getting observations from kadi commands for 2025/Oct-15
2025-11-06 07:34:04,022 _get_tlm: Getting telemetry for 2025:291:01:56:50.217
2025-11-06 07:34:04,644 obss: Getting observations from kadi commands for 2025/Oct-18
2025-11-06 07:34:04,655 _get_tlm: Getting telemetry for 2025:293:17:24:20.673
2025-11-06 07:34:05,603 obss: Getting observations from kadi commands for 2025/Oct-20
2025-11-06 07:34:05,618 _get_tlm: Getting telemetry for 2025:296:08:51:47.275
2025-11-06 07:34:06,956 obss: Getting observations from kadi commands for 2025/Oct-23
2025-11-06 07:34:06,971 _get_tlm: Getting telemetry for 2025:299:00:19:32.107
2025-11-06 07:34:07,221 obss: Getting observations from kadi commands for 2025/Oct-26
2025-11-06 07:34:07,235 _get_tlm: Getting telemetry for 2025:301:15:47:27.439
2025-11-06 07:34:07,857 obss: Getting observations from kadi commands for 2025/Oct-28
2025-11-06 07:34:07,868 _get_tlm: Getting telemetry for 2025:304:07:14:52.585
2025-11-06 07:34:08,190 obss: Getting observations from kadi commands for 2025/Oct-31
2025-11-06 07:34:08,204 _get_tlm: Getting telemetry for 2025:306:22:42:00.361
2025-11-06 07:34:08,452 obss: Getting observations from kadi commands for 2025/Nov-02
2025-11-06 07:34:08,465 _get_tlm: Getting telemetry for 2025:309:14:10:01.995
2025-11-06 07:34:08,670 get_kalman_drops_npnt: No telemetry for perigee 2025:309:14:10:01.995
2025-11-06 07:34:17,422 get_color_marker_for_perigee_plotly: Perigee 2025:267:06:46:04.296 color='rgb(229, 134, 6)' marker='circle'
2025-11-06 07:34:17,422 get_color_marker_for_perigee_plotly: Perigee 2025:269:22:13:27.704 color='rgb(93, 105, 177)' marker='square'
2025-11-06 07:34:17,422 get_color_marker_for_perigee_plotly: Perigee 2025:272:13:41:09.383 color='rgb(82, 188, 163)' marker='diamond'
2025-11-06 07:34:17,423 get_color_marker_for_perigee_plotly: Perigee 2025:275:05:08:45.990 color='rgb(153, 201, 69)' marker='triangle-up'
2025-11-06 07:34:17,423 get_color_marker_for_perigee_plotly: Perigee 2025:277:20:35:43.686 color='rgb(204, 97, 176)' marker='triangle-down'
2025-11-06 07:34:17,423 get_color_marker_for_perigee_plotly: Perigee 2025:280:12:02:48.870 color='rgb(36, 121, 108)' marker='triangle-left'
2025-11-06 07:34:17,423 get_color_marker_for_perigee_plotly: Perigee 2025:283:03:31:06.093 color='rgb(218, 165, 27)' marker='triangle-right'
2025-11-06 07:34:17,423 get_color_marker_for_perigee_plotly: Perigee 2025:285:19:00:07.176 color='rgb(47, 138, 196)' marker='circle'
2025-11-06 07:34:17,424 get_color_marker_for_perigee_plotly: Perigee 2025:288:10:28:48.952 color='rgb(118, 78, 159)' marker='square'
2025-11-06 07:34:17,424 get_color_marker_for_perigee_plotly: Perigee 2025:291:01:56:50.217 color='rgb(237, 100, 90)' marker='diamond'
2025-11-06 07:34:17,424 get_color_marker_for_perigee_plotly: Perigee 2025:293:17:24:20.673 color='rgb(165, 170, 153)' marker='triangle-up'
2025-11-06 07:34:17,424 get_color_marker_for_perigee_plotly: Perigee 2025:296:08:51:47.275 color='rgb(229, 134, 6)' marker='triangle-down'
2025-11-06 07:34:17,425 get_color_marker_for_perigee_plotly: Perigee 2025:299:00:19:32.107 color='rgb(93, 105, 177)' marker='triangle-left'
2025-11-06 07:34:17,425 get_color_marker_for_perigee_plotly: Perigee 2025:301:15:47:27.439 color='rgb(82, 188, 163)' marker='triangle-right'
2025-11-06 07:34:17,425 get_color_marker_for_perigee_plotly: Perigee 2025:304:07:14:52.585 color='rgb(153, 201, 69)' marker='circle'
2025-11-06 07:34:17,425 get_color_marker_for_perigee_plotly: Perigee 2025:306:22:42:00.361 color='rgb(204, 97, 176)' marker='square'
2025-11-06 07:34:17,425 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2025-11-06 07:34:17,474 plot_mon_win_and_aokalstr_composite_plotly: Skipping prediction for 2025:309:14:10:01.995 because there is no observed data
2025-11-06 07:34:18,162 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2025-11-06 08:34:20,727 main: Overriding starting time with the time of latest low-kalman event
2025-11-06 08:34:20,727 get_lowkals_new: Getting telemetry between 2025:309:02:14:51.279 and 2025:310:13:34:20.718
2025-11-06 08:34:21,009 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
2025-11-06 08:34:21,013 main: Updating events file /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2025-11-06 08:34:21,169 make_web_page: Writing HTML to /proj/sot/ska3/aca/www/ASPECT/kalman_watch3/index.html
2025:309:02:14:51.279 2025:310:13:34:20.718