Prev
Index
Next
kalman_watch3: Wed Feb 25 08:34:21 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Wed Feb 25 08:34:21 2026 |
Errors:
- Line 157: 2026-02-25 08:34:21,448 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
File contents:
2026-02-25 08:31:17,004 log_run_info: ******************************************
2026-02-25 08:31:17,004 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-02-25 08:31:17,004 log_run_info: Version: 0.6.2
2026-02-25 08:31:17,005 log_run_info: Time: Wed Feb 25 08:31:17 2026
2026-02-25 08:31:17,005 log_run_info: User: aca
2026-02-25 08:31:17,005 log_run_info: Machine: kady.cfa.harvard.edu
2026-02-25 08:31:17,005 log_run_info: Processing args:
2026-02-25 08:31:17,005 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-02-25 08:31:17,005 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-02-25 08:31:17,005 log_run_info: 'lookback': 14,
2026-02-25 08:31:17,005 log_run_info: 'make_html': True,
2026-02-25 08:31:17,005 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-02-25 08:31:17,005 log_run_info: 'stop': None}
2026-02-25 08:31:17,005 log_run_info: ******************************************
2026-02-25 08:31:17,008 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-02-25 08:31:17,026 get_evts_perigee: Getting perigee events between 2026:042:13:31:17.005 and 2026:056:13:31:17.005
2026-02-25 08:31:21,017 _get_tlm: Getting telemetry for 2026:055:15:54:54.637
2026-02-25 08:31:21,298 get_evts_perigee: No TLM found for perigee event at 2026:055:15:54:54.637, skipping
2026-02-25 08:31:21,298 get_evts_perigee: Found 0 new perigee event(s)
2026-02-25 08:31:21,298 main: No new perigee events, exiting
2026-02-25 08:31:25,277 get_manvrs_perigee: Getting maneuvers from 2026:011:13:31:25.276 to 2026:055:13:31:25.276
2026-02-25 08:31:29,384 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:011:13:31:25.276 to 2026:055:13:31:25.276
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:015:18:51:22.007 to 2026:015:18:57:07.432
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:021:01:58:47.112 to 2026:021:02:17:02.838
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:022:02:27:20.218 to 2026:022:02:33:12.818
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:026:06:36:33.217 to 2026:026:06:40:28.967
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:026:09:44:40.518 to 2026:026:10:13:35.843
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:029:00:34:04.733 to 2026:029:00:45:58.133
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:031:17:10:24.423 to 2026:031:17:15:33.973
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:042:07:30:43.659 to 2026:042:07:31:36.959
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:044:21:55:01.124 to 2026:044:22:01:47.024
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:045:05:52:19.626 to 2026:045:06:02:34.626
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:047:10:15:39.638 to 2026:047:10:19:43.588
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:051:14:43:38.087 to 2026:051:14:44:46.762
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:053:18:31:58.900 to 2026:053:18:35:36.200
2026-02-25 08:31:38,846 get_manvrs_perigee: Excluding Earth block from 2026:053:22:05:40.625 to 2026:053:22:09:59.950
2026-02-25 08:31:38,847 get_manvrs_perigee: Excluding Earth block from 2026:054:02:16:07.126 to 2026:054:02:22:08.951
2026-02-25 08:31:38,975 get_mon_dataset: Getting MON data from 2026:013:07:20:30.343 to 2026:013:07:45:21.718
2026-02-25 08:31:38,975 get_aca_images_cached: Getting ACA images from 2026:013:07:20:30.343 to 2026:013:07:45:21.718
2026-02-25 08:31:39,195 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-02-25 08:33:57,967 get_mon_dataset: Getting MON data from 2026:013:09:46:35.118 to 2026:013:10:15:56.069
2026-02-25 08:33:57,967 get_aca_images_cached: Getting ACA images from 2026:013:09:46:35.118 to 2026:013:10:15:56.069
2026-02-25 08:33:58,186 get_mon_dataset: Getting MON data from 2026:015:22:44:59.908 to 2026:015:23:12:42.458
2026-02-25 08:33:58,186 get_aca_images_cached: Getting ACA images from 2026:015:22:44:59.908 to 2026:015:23:12:42.458
2026-02-25 08:33:58,632 get_mon_dataset: Getting MON data from 2026:016:01:26:51.784 to 2026:016:01:55:56.334
2026-02-25 08:33:58,632 get_aca_images_cached: Getting ACA images from 2026:016:01:26:51.784 to 2026:016:01:55:56.334
2026-02-25 08:33:58,814 get_mon_dataset: Getting MON data from 2026:018:13:46:04.198 to 2026:018:14:10:55.573
2026-02-25 08:33:58,814 get_aca_images_cached: Getting ACA images from 2026:018:13:46:04.198 to 2026:018:14:10:55.573
2026-02-25 08:33:58,990 get_mon_dataset: Getting MON data from 2026:018:16:59:02.599 to 2026:018:17:25:55.949
2026-02-25 08:33:58,990 get_aca_images_cached: Getting ACA images from 2026:018:16:59:02.599 to 2026:018:17:25:55.949
2026-02-25 08:33:59,436 get_mon_dataset: Getting MON data from 2026:023:20:42:23.053 to 2026:023:21:05:55.503
2026-02-25 08:33:59,436 get_aca_images_cached: Getting ACA images from 2026:023:20:42:23.053 to 2026:023:21:05:55.503
2026-02-25 08:33:59,614 get_mon_dataset: Getting MON data from 2026:026:13:56:41.319 to 2026:026:14:03:52.844
2026-02-25 08:33:59,614 get_aca_images_cached: Getting ACA images from 2026:026:13:56:41.319 to 2026:026:14:03:52.844
2026-02-25 08:33:59,641 get_mon_dataset: Not enough images for slot 0 found 0)
2026-02-25 08:33:59,642 get_mon_dataset: Not enough images for slot 1 found 0)
2026-02-25 08:33:59,643 get_mon_dataset: Not enough images for slot 2 found 0)
2026-02-25 08:33:59,644 get_mon_dataset: Not enough images for slot 3 found 0)
2026-02-25 08:33:59,644 get_mon_dataset: Not enough images for slot 4 found 0)
2026-02-25 08:33:59,645 get_mon_dataset: Not enough images for slot 5 found 0)
2026-02-25 08:33:59,646 get_mon_dataset: Not enough images for slot 6 found 0)
2026-02-25 08:33:59,647 get_mon_dataset: Not enough images for slot 7 found 0)
2026-02-25 08:33:59,648 get_mon_dataset: Getting MON data from 2026:034:11:04:59.639 to 2026:034:11:25:56.289
2026-02-25 08:33:59,648 get_aca_images_cached: Getting ACA images from 2026:034:11:04:59.639 to 2026:034:11:25:56.289
2026-02-25 08:33:59,822 get_mon_dataset: Getting MON data from 2026:034:11:49:10.289 to 2026:034:11:56:20.789
2026-02-25 08:33:59,822 get_aca_images_cached: Getting ACA images from 2026:034:11:49:10.289 to 2026:034:11:56:20.789
2026-02-25 08:33:59,849 get_mon_dataset: Not enough images for slot 0 found 0)
2026-02-25 08:33:59,850 get_mon_dataset: Not enough images for slot 1 found 0)
2026-02-25 08:33:59,851 get_mon_dataset: Not enough images for slot 2 found 0)
2026-02-25 08:33:59,852 get_mon_dataset: Not enough images for slot 3 found 0)
2026-02-25 08:33:59,853 get_mon_dataset: Not enough images for slot 4 found 0)
2026-02-25 08:33:59,854 get_mon_dataset: Not enough images for slot 5 found 0)
2026-02-25 08:33:59,855 get_mon_dataset: Not enough images for slot 6 found 0)
2026-02-25 08:33:59,856 get_mon_dataset: Not enough images for slot 7 found 0)
2026-02-25 08:33:59,857 get_mon_dataset: Getting MON data from 2026:037:03:34:27.279 to 2026:037:03:55:27.005
2026-02-25 08:33:59,857 get_aca_images_cached: Getting ACA images from 2026:037:03:34:27.279 to 2026:037:03:55:27.005
2026-02-25 08:34:00,032 get_mon_dataset: Getting MON data from 2026:039:19:06:22.720 to 2026:039:19:25:43.020
2026-02-25 08:34:00,032 get_aca_images_cached: Getting ACA images from 2026:039:19:06:22.720 to 2026:039:19:25:43.020
2026-02-25 08:34:00,215 get_mon_dataset: Getting MON data from 2026:042:09:03:30.434 to 2026:042:09:34:53.359
2026-02-25 08:34:00,215 get_aca_images_cached: Getting ACA images from 2026:042:09:03:30.434 to 2026:042:09:34:53.359
2026-02-25 08:34:00,409 get_mon_dataset: Getting MON data from 2026:042:09:54:39.285 to 2026:042:10:22:31.060
2026-02-25 08:34:00,409 get_aca_images_cached: Getting ACA images from 2026:042:09:54:39.285 to 2026:042:10:22:31.060
2026-02-25 08:34:00,600 get_mon_dataset: Getting MON data from 2026:042:10:59:55.810 to 2026:042:11:07:07.335
2026-02-25 08:34:00,600 get_aca_images_cached: Getting ACA images from 2026:042:10:59:55.810 to 2026:042:11:07:07.335
2026-02-25 08:34:00,627 get_mon_dataset: Not enough images for slot 0 found 0)
2026-02-25 08:34:00,628 get_mon_dataset: Not enough images for slot 1 found 0)
2026-02-25 08:34:00,629 get_mon_dataset: Not enough images for slot 2 found 0)
2026-02-25 08:34:00,630 get_mon_dataset: Not enough images for slot 3 found 0)
2026-02-25 08:34:00,631 get_mon_dataset: Not enough images for slot 4 found 0)
2026-02-25 08:34:00,632 get_mon_dataset: Not enough images for slot 5 found 0)
2026-02-25 08:34:00,633 get_mon_dataset: Not enough images for slot 6 found 0)
2026-02-25 08:34:00,634 get_mon_dataset: Not enough images for slot 7 found 0)
2026-02-25 08:34:00,635 get_mon_dataset: Getting MON data from 2026:045:01:28:17.225 to 2026:045:01:55:55.675
2026-02-25 08:34:00,635 get_aca_images_cached: Getting ACA images from 2026:045:01:28:17.225 to 2026:045:01:55:55.675
2026-02-25 08:34:00,824 get_mon_dataset: Getting MON data from 2026:047:16:22:34.590 to 2026:047:16:55:56.415
2026-02-25 08:34:00,824 get_aca_images_cached: Getting ACA images from 2026:047:16:22:34.590 to 2026:047:16:55:56.415
2026-02-25 08:34:01,025 get_mon_dataset: Getting MON data from 2026:050:07:25:17.280 to 2026:050:07:55:56.130
2026-02-25 08:34:01,025 get_aca_images_cached: Getting ACA images from 2026:050:07:25:17.280 to 2026:050:07:55:56.130
2026-02-25 08:34:01,493 get_mon_dataset: Getting MON data from 2026:052:23:29:21.770 to 2026:052:23:55:55.645
2026-02-25 08:34:01,493 get_aca_images_cached: Getting ACA images from 2026:052:23:29:21.770 to 2026:052:23:55:55.645
2026-02-25 08:34:01,691 get_kalman_drops_nman: processing NMAN data
2026-02-25 08:34:01,736 get_kalman_drops_nman: Skipping NMAN from 2026:018:16:59:02.599 to 2026:018:17:25:55.949 due to insufficient monitor window data within 100 minutes of perigee
2026-02-25 07:34:02,493 _get_tlm: Getting telemetry for 2026:013:08:26:59.924
2026-02-25 07:34:02,775 obss: Getting observations from kadi commands for 2026/Jan-13
2026-02-25 07:34:02,789 _get_tlm: Getting telemetry for 2026:015:23:55:07.758
2026-02-25 07:34:03,033 obss: Getting observations from kadi commands for 2026/Jan-15
2026-02-25 07:34:03,046 _get_tlm: Getting telemetry for 2026:018:15:23:15.432
2026-02-25 07:34:03,304 obss: Getting observations from kadi commands for 2026/Jan-18
2026-02-25 07:34:03,318 _get_tlm: Getting telemetry for 2026:021:06:50:55.733
2026-02-25 07:34:03,877 obss: Getting observations from kadi commands for 2026/Jan-21
2026-02-25 07:34:03,893 _get_tlm: Getting telemetry for 2026:023:22:18:28.433
2026-02-25 07:34:04,194 obss: Getting observations from kadi commands for 2026/Jan-23
2026-02-25 07:34:04,209 _get_tlm: Getting telemetry for 2026:026:13:46:43.902
2026-02-25 07:34:04,499 obss: Getting observations from kadi commands for 2026/Jan-26
2026-02-25 07:34:04,514 _get_tlm: Getting telemetry for 2026:029:05:15:50.249
2026-02-25 07:34:04,971 obss: Getting observations from kadi commands for 2026/Jan-29
2026-02-25 07:34:04,986 _get_tlm: Getting telemetry for 2026:031:20:44:58.909
2026-02-25 07:34:05,721 obss: Getting observations from kadi commands for 2026/Jan-31
2026-02-25 07:34:05,737 _get_tlm: Getting telemetry for 2026:034:12:13:16.410
2026-02-25 07:34:06,870 obss: Getting observations from kadi commands for 2026/Feb-03
2026-02-25 07:34:06,884 _get_tlm: Getting telemetry for 2026:037:03:40:52.593
2026-02-25 07:34:07,519 obss: Getting observations from kadi commands for 2026/Feb-06
2026-02-25 07:34:07,535 _get_tlm: Getting telemetry for 2026:039:19:08:21.952
2026-02-25 07:34:08,081 obss: Getting observations from kadi commands for 2026/Feb-08
2026-02-25 07:34:08,101 _get_tlm: Getting telemetry for 2026:042:10:36:04.628
2026-02-25 07:34:08,412 obss: Getting observations from kadi commands for 2026/Feb-11
2026-02-25 07:34:08,423 _get_tlm: Getting telemetry for 2026:045:02:03:56.696
2026-02-25 07:34:08,718 obss: Getting observations from kadi commands for 2026/Feb-14
2026-02-25 07:34:08,733 _get_tlm: Getting telemetry for 2026:047:17:31:28.743
2026-02-25 07:34:08,992 obss: Getting observations from kadi commands for 2026/Feb-16
2026-02-25 07:34:09,005 _get_tlm: Getting telemetry for 2026:050:08:58:37.782
2026-02-25 07:34:09,254 obss: Getting observations from kadi commands for 2026/Feb-19
2026-02-25 07:34:09,268 _get_tlm: Getting telemetry for 2026:053:00:26:17.845
2026-02-25 07:34:09,507 obss: Getting observations from kadi commands for 2026/Feb-22
2026-02-25 07:34:09,521 _get_tlm: Getting telemetry for 2026:055:15:54:54.637
2026-02-25 07:34:09,717 get_kalman_drops_npnt: No telemetry for perigee 2026:055:15:54:54.637
2026-02-25 07:34:17,840 get_color_marker_for_perigee_plotly: Perigee 2026:013:08:26:59.924 color='rgb(229, 134, 6)' marker='circle'
2026-02-25 07:34:17,841 get_color_marker_for_perigee_plotly: Perigee 2026:015:23:55:07.758 color='rgb(93, 105, 177)' marker='square'
2026-02-25 07:34:17,841 get_color_marker_for_perigee_plotly: Perigee 2026:018:15:23:15.432 color='rgb(82, 188, 163)' marker='diamond'
2026-02-25 07:34:17,841 get_color_marker_for_perigee_plotly: Perigee 2026:021:06:50:55.733 color='rgb(153, 201, 69)' marker='triangle-up'
2026-02-25 07:34:17,841 get_color_marker_for_perigee_plotly: Perigee 2026:023:22:18:28.433 color='rgb(204, 97, 176)' marker='triangle-down'
2026-02-25 07:34:17,842 get_color_marker_for_perigee_plotly: Perigee 2026:026:13:46:43.902 color='rgb(36, 121, 108)' marker='triangle-left'
2026-02-25 07:34:17,842 get_color_marker_for_perigee_plotly: Perigee 2026:029:05:15:50.249 color='rgb(218, 165, 27)' marker='triangle-right'
2026-02-25 07:34:17,842 get_color_marker_for_perigee_plotly: Perigee 2026:031:20:44:58.909 color='rgb(47, 138, 196)' marker='circle'
2026-02-25 07:34:17,842 get_color_marker_for_perigee_plotly: Perigee 2026:034:12:13:16.410 color='rgb(118, 78, 159)' marker='square'
2026-02-25 07:34:17,842 get_color_marker_for_perigee_plotly: Perigee 2026:037:03:40:52.593 color='rgb(237, 100, 90)' marker='diamond'
2026-02-25 07:34:17,842 get_color_marker_for_perigee_plotly: Perigee 2026:039:19:08:21.952 color='rgb(165, 170, 153)' marker='triangle-up'
2026-02-25 07:34:17,843 get_color_marker_for_perigee_plotly: Perigee 2026:042:10:36:04.628 color='rgb(229, 134, 6)' marker='triangle-down'
2026-02-25 07:34:17,843 get_color_marker_for_perigee_plotly: Perigee 2026:045:02:03:56.696 color='rgb(93, 105, 177)' marker='triangle-left'
2026-02-25 07:34:17,843 get_color_marker_for_perigee_plotly: Perigee 2026:047:17:31:28.743 color='rgb(82, 188, 163)' marker='triangle-right'
2026-02-25 07:34:17,843 get_color_marker_for_perigee_plotly: Perigee 2026:050:08:58:37.782 color='rgb(153, 201, 69)' marker='circle'
2026-02-25 07:34:17,844 get_color_marker_for_perigee_plotly: Perigee 2026:053:00:26:17.845 color='rgb(204, 97, 176)' marker='square'
2026-02-25 07:34:17,844 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-02-25 07:34:17,849 plot_mon_win_and_aokalstr_composite_plotly: Skipping prediction for 2026:055:15:54:54.637 because there is no observed data
2026-02-25 07:34:18,563 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-02-25 08:34:21,219 main: Overriding starting time with the time of latest low-kalman event
2026-02-25 08:34:21,220 get_lowkals_new: Getting telemetry between 2026:055:04:05:42.314 and 2026:056:13:34:21.213
2026-02-25 08:34:21,448 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
2026-02-25 08:34:21,451 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-02-25 08:34:21,760 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:055:04:05:42.314 2026:056:13:34:21.213