Prev   Index   Next

kalman_watch3: Thu Aug 28 08:34:22 2025

File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log

Task Status AgeMaxAge Last Date
kalman_watch3 OK 0.091.0 Thu Aug 28 08:34:22 2025

No errors

File contents:

2025-08-28 08:31:12,800 log_run_info: ******************************************
2025-08-28 08:31:12,801 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.12/site-packages/kalman_watch/kalman_perigee_mon.py
2025-08-28 08:31:12,801 log_run_info: Version: 0.6.0
2025-08-28 08:31:12,801 log_run_info: Time: Thu Aug 28 08:31:12 2025
2025-08-28 08:31:12,801 log_run_info: User: aca
2025-08-28 08:31:12,801 log_run_info: Machine: kady.cfa.harvard.edu
2025-08-28 08:31:12,801 log_run_info: Processing args:
2025-08-28 08:31:12,801 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/flight/www/ASPECT/kalman_watch3'),
2025-08-28 08:31:12,801 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2025-08-28 08:31:12,801 log_run_info: 'lookback': 14,
2025-08-28 08:31:12,801 log_run_info: 'make_html': True,
2025-08-28 08:31:12,801 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/flight/data/stk/radiation_data.fits'),
2025-08-28 08:31:12,801 log_run_info: 'stop': None}
2025-08-28 08:31:12,801 log_run_info: ******************************************
2025-08-28 08:31:12,803 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2025-08-28 08:31:12,840 get_evts_perigee: Getting perigee events between 2025:226:12:31:12.801 and 2025:240:12:31:12.801
2025-08-28 08:31:16,182 get_evts_perigee: Found 0 new perigee event(s)
2025-08-28 08:31:16,182 main: No new perigee events, exiting
2025-08-28 08:31:19,908 get_manvrs_perigee: Getting maneuvers from 2025:195:12:31:19.907 to 2025:239:12:31:19.908
2025-08-28 08:31:24,172 get_manvrs_perigee: Getting intervals of Earth blocks from 2025:195:12:31:19.907 to 2025:239:12:31:19.908
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:195:23:37:19.801 to 2025:195:23:48:50.651
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:198:13:21:58.241 to 2025:198:13:36:32.566
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:211:20:07:17.592 to 2025:211:20:15:51.117
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:212:07:24:58.319 to 2025:212:07:30:42.719
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:214:10:41:32.632 to 2025:214:10:55:59.782
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:214:12:36:39.082 to 2025:214:12:44:48.007
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:217:01:13:02.646 to 2025:217:01:23:18.671
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:220:05:49:54.790 to 2025:220:05:55:49.440
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:222:08:22:46.127 to 2025:222:08:24:37.852
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:225:00:45:34.017 to 2025:225:00:57:15.117
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:225:14:25:41.195 to 2025:225:14:29:05.170
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:226:00:00:19.122 to 2025:226:00:05:58.397
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:226:19:05:26.927 to 2025:226:19:09:21.652
2025-08-28 08:31:34,031 get_manvrs_perigee: Excluding Earth block from 2025:227:19:42:31.508 to 2025:227:19:47:19.533
2025-08-28 08:31:34,104 get_mon_dataset: Getting MON data from 2025:198:13:02:18.466 to 2025:198:13:21:58.241
2025-08-28 08:31:34,104 get_aca_images_cached: Getting ACA images from 2025:198:13:02:18.466 to 2025:198:13:21:58.241
2025-08-28 08:31:34,320 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2025-08-28 08:33:52,768 get_mon_dataset: Getting MON data from 2025:198:13:36:32.566 to 2025:198:13:37:55.591
2025-08-28 08:33:52,768 get_aca_images_cached: Getting ACA images from 2025:198:13:36:32.566 to 2025:198:13:37:55.591
2025-08-28 08:33:52,955 get_mon_dataset: Getting MON data from 2025:198:14:15:20.341 to 2025:198:14:50:46.191
2025-08-28 08:33:52,955 get_aca_images_cached: Getting ACA images from 2025:198:14:15:20.341 to 2025:198:14:50:46.191
2025-08-28 08:33:53,157 get_mon_dataset: Getting MON data from 2025:201:02:19:09.231 to 2025:201:02:26:19.731
2025-08-28 08:33:53,157 get_aca_images_cached: Getting ACA images from 2025:201:02:19:09.231 to 2025:201:02:26:19.731
2025-08-28 08:33:53,194 get_mon_dataset: Not enough images for slot 0 found 0)
2025-08-28 08:33:53,195 get_mon_dataset: Not enough images for slot 1 found 0)
2025-08-28 08:33:53,196 get_mon_dataset: Not enough images for slot 2 found 0)
2025-08-28 08:33:53,197 get_mon_dataset: Not enough images for slot 3 found 0)
2025-08-28 08:33:53,198 get_mon_dataset: Not enough images for slot 4 found 0)
2025-08-28 08:33:53,199 get_mon_dataset: Not enough images for slot 5 found 0)
2025-08-28 08:33:53,200 get_mon_dataset: Not enough images for slot 6 found 0)
2025-08-28 08:33:53,201 get_mon_dataset: Not enough images for slot 7 found 0)
2025-08-28 08:33:53,202 get_mon_dataset: Getting MON data from 2025:203:17:11:53.320 to 2025:203:18:00:56.096
2025-08-28 08:33:53,202 get_aca_images_cached: Getting ACA images from 2025:203:17:11:53.320 to 2025:203:18:00:56.096
2025-08-28 08:33:53,446 get_mon_dataset: Getting MON data from 2025:203:18:25:41.321 to 2025:203:19:00:55.896
2025-08-28 08:33:53,446 get_aca_images_cached: Getting ACA images from 2025:203:18:25:41.321 to 2025:203:19:00:55.896
2025-08-28 08:33:53,887 get_mon_dataset: Getting MON data from 2025:203:19:26:01.621 to 2025:203:20:10:55.321
2025-08-28 08:33:53,887 get_aca_images_cached: Getting ACA images from 2025:203:19:26:01.621 to 2025:203:20:10:55.321
2025-08-28 08:33:54,105 get_mon_dataset: Getting MON data from 2025:206:10:15:38.136 to 2025:206:10:55:56.111
2025-08-28 08:33:54,106 get_aca_images_cached: Getting ACA images from 2025:206:10:15:38.136 to 2025:206:10:55:56.111
2025-08-28 08:33:54,570 get_mon_dataset: Getting MON data from 2025:209:00:24:21.826 to 2025:209:01:02:29.626
2025-08-28 08:33:54,571 get_aca_images_cached: Getting ACA images from 2025:209:00:24:21.826 to 2025:209:01:02:29.626
2025-08-28 08:33:54,770 get_mon_dataset: Getting MON data from 2025:211:16:21:56.816 to 2025:211:16:53:55.616
2025-08-28 08:33:54,770 get_aca_images_cached: Getting ACA images from 2025:211:16:21:56.816 to 2025:211:16:53:55.616
2025-08-28 08:33:54,962 get_mon_dataset: Getting MON data from 2025:211:17:13:41.541 to 2025:211:17:52:29.316
2025-08-28 08:33:54,962 get_aca_images_cached: Getting ACA images from 2025:211:17:13:41.541 to 2025:211:17:52:29.316
2025-08-28 08:33:55,168 get_mon_dataset: Getting MON data from 2025:214:08:04:31.856 to 2025:214:08:40:23.331
2025-08-28 08:33:55,168 get_aca_images_cached: Getting ACA images from 2025:214:08:04:31.856 to 2025:214:08:40:23.331
2025-08-28 08:33:55,642 get_mon_dataset: Getting MON data from 2025:214:10:18:10.431 to 2025:214:10:41:32.632
2025-08-28 08:33:55,642 get_aca_images_cached: Getting ACA images from 2025:214:10:18:10.431 to 2025:214:10:41:32.632
2025-08-28 08:33:55,816 get_mon_dataset: Getting MON data from 2025:214:10:55:59.782 to 2025:214:10:56:25.407
2025-08-28 08:33:55,816 get_aca_images_cached: Getting ACA images from 2025:214:10:55:59.782 to 2025:214:10:56:25.407
2025-08-28 08:33:55,837 get_mon_dataset: Not enough images for slot 0 found 4)
2025-08-28 08:33:55,838 get_mon_dataset: Not enough images for slot 1 found 4)
2025-08-28 08:33:55,838 get_mon_dataset: Not enough images for slot 2 found 4)
2025-08-28 08:33:55,839 get_mon_dataset: Not enough images for slot 3 found 4)
2025-08-28 08:33:55,840 get_mon_dataset: Not enough images for slot 4 found 4)
2025-08-28 08:33:55,841 get_mon_dataset: Not enough images for slot 5 found 4)
2025-08-28 08:33:55,841 get_mon_dataset: Not enough images for slot 6 found 4)
2025-08-28 08:33:55,842 get_mon_dataset: Not enough images for slot 7 found 4)
2025-08-28 08:33:55,843 get_mon_dataset: Getting MON data from 2025:216:23:52:04.146 to 2025:217:00:25:55.696
2025-08-28 08:33:55,843 get_aca_images_cached: Getting ACA images from 2025:216:23:52:04.146 to 2025:217:00:25:55.696
2025-08-28 08:33:56,043 get_mon_dataset: Getting MON data from 2025:217:01:11:40.646 to 2025:217:01:13:02.646
2025-08-28 08:33:56,043 get_aca_images_cached: Getting ACA images from 2025:217:01:11:40.646 to 2025:217:01:13:02.646
2025-08-28 08:33:56,188 get_mon_dataset: Getting MON data from 2025:217:01:23:18.671 to 2025:217:01:51:15.572
2025-08-28 08:33:56,188 get_aca_images_cached: Getting ACA images from 2025:217:01:23:18.671 to 2025:217:01:51:15.572
2025-08-28 08:33:56,638 get_mon_dataset: Getting MON data from 2025:217:02:11:01.497 to 2025:217:02:59:47.872
2025-08-28 08:33:56,638 get_aca_images_cached: Getting ACA images from 2025:217:02:11:01.497 to 2025:217:02:59:47.872
2025-08-28 08:33:56,881 get_mon_dataset: Getting MON data from 2025:219:15:14:17.386 to 2025:219:15:30:55.736
2025-08-28 08:33:56,881 get_aca_images_cached: Getting ACA images from 2025:219:15:14:17.386 to 2025:219:15:30:55.736
2025-08-28 08:33:57,047 get_mon_dataset: Getting MON data from 2025:219:15:50:40.636 to 2025:219:16:21:51.261
2025-08-28 08:33:57,047 get_aca_images_cached: Getting ACA images from 2025:219:15:50:40.636 to 2025:219:16:21:51.261
2025-08-28 08:33:57,244 get_mon_dataset: Getting MON data from 2025:219:16:41:37.187 to 2025:219:17:04:40.937
2025-08-28 08:33:57,244 get_aca_images_cached: Getting ACA images from 2025:219:16:41:37.187 to 2025:219:17:04:40.937
2025-08-28 08:33:57,420 get_mon_dataset: Getting MON data from 2025:219:17:24:25.837 to 2025:219:18:02:16.212
2025-08-28 08:33:57,420 get_aca_images_cached: Getting ACA images from 2025:219:17:24:25.837 to 2025:219:18:02:16.212
2025-08-28 08:33:57,613 get_mon_dataset: Getting MON data from 2025:222:06:44:14.951 to 2025:222:07:15:56.326
2025-08-28 08:33:57,613 get_aca_images_cached: Getting ACA images from 2025:222:06:44:14.951 to 2025:222:07:15:56.326
2025-08-28 08:33:57,830 get_mon_dataset: Getting MON data from 2025:222:08:20:53.377 to 2025:222:08:22:46.127
2025-08-28 08:33:57,830 get_aca_images_cached: Getting ACA images from 2025:222:08:20:53.377 to 2025:222:08:22:46.127
2025-08-28 08:33:57,989 get_mon_dataset: Getting MON data from 2025:222:08:24:37.852 to 2025:222:08:57:55.577
2025-08-28 08:33:57,989 get_aca_images_cached: Getting ACA images from 2025:222:08:24:37.852 to 2025:222:08:57:55.577
2025-08-28 08:33:58,294 get_mon_dataset: Getting MON data from 2025:225:00:26:32.167 to 2025:225:00:45:34.017
2025-08-28 08:33:58,294 get_aca_images_cached: Getting ACA images from 2025:225:00:26:32.167 to 2025:225:00:45:34.017
2025-08-28 08:33:58,480 get_mon_dataset: Getting MON data from 2025:225:00:57:15.117 to 2025:225:01:00:55.492
2025-08-28 08:33:58,480 get_aca_images_cached: Getting ACA images from 2025:225:00:57:15.117 to 2025:225:01:00:55.492
2025-08-28 08:33:58,641 get_mon_dataset: Getting MON data from 2025:230:06:32:06.772 to 2025:230:06:55:55.622
2025-08-28 08:33:58,641 get_aca_images_cached: Getting ACA images from 2025:230:06:32:06.772 to 2025:230:06:55:55.622
2025-08-28 08:33:59,141 get_mon_dataset: Getting MON data from 2025:232:22:01:59.212 to 2025:232:22:25:56.262
2025-08-28 08:33:59,141 get_aca_images_cached: Getting ACA images from 2025:232:22:01:59.212 to 2025:232:22:25:56.262
2025-08-28 08:33:59,327 get_mon_dataset: Getting MON data from 2025:235:12:15:56.552 to 2025:235:12:40:56.127
2025-08-28 08:33:59,327 get_aca_images_cached: Getting ACA images from 2025:235:12:15:56.552 to 2025:235:12:40:56.127
2025-08-28 08:33:59,783 get_mon_dataset: Getting MON data from 2025:235:13:44:38.352 to 2025:235:14:10:55.827
2025-08-28 08:33:59,783 get_aca_images_cached: Getting ACA images from 2025:235:13:44:38.352 to 2025:235:14:10:55.827
2025-08-28 08:33:59,972 get_kalman_drops_nman: processing NMAN data
2025-08-28 07:34:00,567 _get_tlm: Getting telemetry for 2025:195:21:07:46.179
2025-08-28 07:34:01,230 obss: Getting observations from kadi commands for 2025/Jul-14
2025-08-28 07:34:01,246 _get_tlm: Getting telemetry for 2025:198:12:35:25.287
2025-08-28 07:34:01,613 obss: Getting observations from kadi commands for 2025/Jul-17
2025-08-28 07:34:01,626 _get_tlm: Getting telemetry for 2025:201:04:04:03.671
2025-08-28 07:34:01,976 obss: Getting observations from kadi commands for 2025/Jul-20
2025-08-28 07:34:01,992 _get_tlm: Getting telemetry for 2025:203:19:33:39.483
2025-08-28 07:34:02,291 obss: Getting observations from kadi commands for 2025/Jul-22
2025-08-28 07:34:02,301 _get_tlm: Getting telemetry for 2025:206:11:02:57.982
2025-08-28 07:34:02,619 obss: Getting observations from kadi commands for 2025/Jul-25
2025-08-28 07:34:02,632 _get_tlm: Getting telemetry for 2025:209:02:31:28.360
2025-08-28 07:34:02,915 obss: Getting observations from kadi commands for 2025/Jul-28
2025-08-28 07:34:02,930 _get_tlm: Getting telemetry for 2025:211:17:59:21.001
2025-08-28 07:34:03,255 obss: Getting observations from kadi commands for 2025/Jul-30
2025-08-28 07:34:03,267 _get_tlm: Getting telemetry for 2025:214:09:27:05.965
2025-08-28 07:34:03,568 obss: Getting observations from kadi commands for 2025/Aug-02
2025-08-28 07:34:03,579 _get_tlm: Getting telemetry for 2025:217:00:55:05.235
2025-08-28 07:34:03,869 obss: Getting observations from kadi commands for 2025/Aug-05
2025-08-28 07:34:03,879 _get_tlm: Getting telemetry for 2025:219:16:23:05.959
2025-08-28 07:34:04,166 obss: Getting observations from kadi commands for 2025/Aug-07
2025-08-28 07:34:04,175 _get_tlm: Getting telemetry for 2025:222:07:50:33.984
2025-08-28 07:34:04,650 obss: Getting observations from kadi commands for 2025/Aug-10
2025-08-28 07:34:04,662 _get_tlm: Getting telemetry for 2025:224:23:17:50.090
2025-08-28 07:34:05,362 obss: Getting observations from kadi commands for 2025/Aug-12
2025-08-28 07:34:05,376 _get_tlm: Getting telemetry for 2025:227:14:45:55.575
2025-08-28 07:34:06,078 obss: Getting observations from kadi commands for 2025/Aug-15
2025-08-28 07:34:06,096 _get_tlm: Getting telemetry for 2025:230:06:15:00.434
2025-08-28 07:34:07,439 obss: Getting observations from kadi commands for 2025/Aug-18
2025-08-28 07:34:07,453 _get_tlm: Getting telemetry for 2025:232:21:44:10.009
2025-08-28 07:34:07,713 obss: Getting observations from kadi commands for 2025/Aug-20
2025-08-28 07:34:07,728 _get_tlm: Getting telemetry for 2025:235:13:12:37.172
2025-08-28 07:34:08,234 obss: Getting observations from kadi commands for 2025/Aug-23
2025-08-28 07:34:08,247 _get_tlm: Getting telemetry for 2025:238:04:40:22.432
2025-08-28 07:34:08,516 obss: Getting observations from kadi commands for 2025/Aug-26
2025-08-28 07:34:18,475 get_color_marker_for_perigee_plotly: Perigee 2025:195:21:07:46.179 color='rgb(229, 134, 6)' marker='circle'
2025-08-28 07:34:18,476 get_color_marker_for_perigee_plotly: Perigee 2025:198:12:35:25.287 color='rgb(93, 105, 177)' marker='square'
2025-08-28 07:34:18,476 get_color_marker_for_perigee_plotly: Perigee 2025:201:04:04:03.671 color='rgb(82, 188, 163)' marker='diamond'
2025-08-28 07:34:18,476 get_color_marker_for_perigee_plotly: Perigee 2025:203:19:33:39.483 color='rgb(153, 201, 69)' marker='triangle-up'
2025-08-28 07:34:18,476 get_color_marker_for_perigee_plotly: Perigee 2025:206:11:02:57.982 color='rgb(204, 97, 176)' marker='triangle-down'
2025-08-28 07:34:18,476 get_color_marker_for_perigee_plotly: Perigee 2025:209:02:31:28.360 color='rgb(36, 121, 108)' marker='triangle-left'
2025-08-28 07:34:18,477 get_color_marker_for_perigee_plotly: Perigee 2025:211:17:59:21.001 color='rgb(218, 165, 27)' marker='triangle-right'
2025-08-28 07:34:18,477 get_color_marker_for_perigee_plotly: Perigee 2025:214:09:27:05.965 color='rgb(47, 138, 196)' marker='circle'
2025-08-28 07:34:18,477 get_color_marker_for_perigee_plotly: Perigee 2025:217:00:55:05.235 color='rgb(118, 78, 159)' marker='square'
2025-08-28 07:34:18,477 get_color_marker_for_perigee_plotly: Perigee 2025:219:16:23:05.959 color='rgb(237, 100, 90)' marker='diamond'
2025-08-28 07:34:18,478 get_color_marker_for_perigee_plotly: Perigee 2025:222:07:50:33.984 color='rgb(165, 170, 153)' marker='triangle-up'
2025-08-28 07:34:18,478 get_color_marker_for_perigee_plotly: Perigee 2025:224:23:17:50.090 color='rgb(229, 134, 6)' marker='triangle-down'
2025-08-28 07:34:18,478 get_color_marker_for_perigee_plotly: Perigee 2025:227:14:45:55.575 color='rgb(93, 105, 177)' marker='triangle-left'
2025-08-28 07:34:18,478 get_color_marker_for_perigee_plotly: Perigee 2025:230:06:15:00.434 color='rgb(82, 188, 163)' marker='triangle-right'
2025-08-28 07:34:18,478 get_color_marker_for_perigee_plotly: Perigee 2025:232:21:44:10.009 color='rgb(153, 201, 69)' marker='circle'
2025-08-28 07:34:18,479 get_color_marker_for_perigee_plotly: Perigee 2025:235:13:12:37.172 color='rgb(204, 97, 176)' marker='square'
2025-08-28 07:34:18,479 get_color_marker_for_perigee_plotly: Perigee 2025:238:04:40:22.432 color='rgb(36, 121, 108)' marker='diamond'
2025-08-28 07:34:18,479 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2025-08-28 07:34:19,334 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2025-08-28 08:34:21,534 main: Overriding starting time with the time of latest low-kalman event
2025-08-28 08:34:21,534 get_lowkals_new: Getting telemetry between 2025:239:01:50:55.679 and 2025:240:12:34:21.527
2025-08-28 08:34:21,762 get_lowkals_new: Finding intervals of low kalman stars
2025-08-28 08:34:21,781 get_lowkals_new: Last telemetry date: 2025:240:00:15:43.685
2025-08-28 08:34:21,785 main: Updating events file /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2025-08-28 08:34:22,193 make_web_page: Writing HTML to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/index.html
2025:239:01:50:55.679 2025:240:12:34:21.527