Prev   Index   Next

kalman_watch3: Tue Jul 16 08:34:10 2024

File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log

Task Status AgeMaxAge Last Date
kalman_watch3 NOT OK 0.091.0 Tue Jul 16 08:34:10 2024

Errors:

File contents:

2024-07-16 08:31:04,286 get_lowkals_new: Getting telemetry between 2024:196:10:21:23.767 and 2024:198:12:31:04.273
2024-07-16 08:31:04,936 get_lowkals_new: Finding intervals of low kalman stars
2024-07-16 08:31:04,968 get_lowkals_new: Last telemetry date: 2024:198:00:27:00.569
2024-07-16 08:31:04,973 main: Updating events file /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2024-07-16 08:31:05,717 make_web_page: Writing HTML to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/index.html
2024-07-16 08:31:12,529 log_run_info: ******************************************
2024-07-16 08:31:12,530 log_run_info: Running: /proj/sot/ska3/flight/lib/python3.11/site-packages/kalman_watch/kalman_perigee_mon.py
2024-07-16 08:31:12,530 log_run_info: Version: 0.4.0
2024-07-16 08:31:12,530 log_run_info: Time: Tue Jul 16 08:31:12 2024
2024-07-16 08:31:12,530 log_run_info: User: aca
2024-07-16 08:31:12,530 log_run_info: Machine: kady.cfa.harvard.edu
2024-07-16 08:31:12,530 log_run_info: Processing args:
2024-07-16 08:31:12,530 log_run_info: {'data_dir': '/proj/sot/ska3/flight/www/ASPECT/kalman_watch3',
2024-07-16 08:31:12,530 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2024-07-16 08:31:12,530 log_run_info: 'lookback': 14,
2024-07-16 08:31:12,530 log_run_info: 'make_html': True,
2024-07-16 08:31:12,530 log_run_info: 'stop': None}
2024-07-16 08:31:12,530 log_run_info: ******************************************
2024-07-16 08:31:12,531 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2024-07-16 08:31:12,613 get_evts_perigee: Getting perigee events between 2024:184:12:31:12.530 and 2024:198:12:31:12.530
2024-07-16 08:31:13,760 _get_tlm: Getting telemetry for 2024:196:22:49:48.288
2024-07-16 08:31:14,558 get_evts_perigee: Found 1 new perigee event(s)
2024-07-16 08:31:14,559 obss: Getting observations from kadi commands for 2024/Jul-14
2024-07-16 08:31:17,950 write_data: Writing perigee data to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-14/data.npz
2024-07-16 08:31:17,956 write_info: Writing info to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-14/info.json
2024-07-16 08:31:17,970 main: Writing perigee data /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2024-07-16 08:31:17,991 from_npz: Loading perigee event from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-14/data.npz
2024-07-16 08:31:19,124 make_detail_page: Writing perigee detail page to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-14/index.html
2024-07-16 08:31:19,130 from_npz: Loading perigee event from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-12/data.npz
2024-07-16 08:31:19,218 make_detail_page: Writing perigee detail page to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-12/index.html
2024-07-16 08:31:19,226 from_npz: Loading perigee event from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-09/data.npz
2024-07-16 08:31:19,430 make_detail_page: Writing perigee detail page to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-09/index.html
2024-07-16 08:31:19,437 from_npz: Loading perigee event from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-07/data.npz
2024-07-16 08:31:19,528 make_detail_page: Writing perigee detail page to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-07/index.html
2024-07-16 08:31:19,535 from_npz: Loading perigee event from /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-04/data.npz
2024-07-16 08:31:19,627 make_detail_page: Writing perigee detail page to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/Jul-04/index.html
2024-07-16 08:31:19,642 make_index_list_pages: Writing recent index list page to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/index.html
2024-07-16 08:31:19,651 make_index_list_pages: Writing index list page for 2023 to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2023/index.html
2024-07-16 08:31:19,658 make_index_list_pages: Writing index list page for 2024 to /proj/sot/ska3/flight/www/ASPECT/kalman_watch3/perigees/2024/index.html
2024-07-16 08:31:24,092 get_manvrs_perigee: Getting maneuvers from 2024:153:12:31:24.091 to 2024:197:12:31:24.092
2024-07-16 08:31:28,290 get_manvrs_perigee: Getting intervals of Earth blocks from 2024:153:12:31:24.091 to 2024:197:12:31:24.092
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:154:15:09:11.896 to 2024:154:15:37:57.996
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:154:16:39:56.696 to 2024:154:16:51:29.597
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:154:18:15:43.872 to 2024:154:18:23:47.672
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:157:05:58:50.461 to 2024:157:06:12:31.486
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:159:21:53:41.451 to 2024:159:22:23:15.726
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:165:05:03:16.731 to 2024:165:05:22:08.331
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:167:20:31:32.820 to 2024:167:20:49:44.446
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:170:10:03:00.985 to 2024:170:10:13:26.235
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:170:11:47:27.835 to 2024:170:12:17:32.860
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:172:17:34:19.073 to 2024:172:17:38:11.748
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:173:03:39:25.600 to 2024:173:03:53:54.800
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:178:10:46:37.380 to 2024:178:10:56:49.305
2024-07-16 08:31:42,865 get_manvrs_perigee: Excluding Earth block from 2024:178:12:05:55.430 to 2024:178:12:15:44.805
2024-07-16 08:31:42,866 get_manvrs_perigee: Excluding Earth block from 2024:183:17:11:40.485 to 2024:183:17:41:33.210
2024-07-16 08:31:42,866 get_manvrs_perigee: Excluding Earth block from 2024:191:15:41:00.379 to 2024:191:16:11:17.704
2024-07-16 08:31:42,866 get_manvrs_perigee: Excluding Earth block from 2024:194:07:09:24.669 to 2024:194:07:39:47.119
2024-07-16 08:31:42,866 get_manvrs_perigee: Excluding Earth block from 2024:196:22:37:14.109 to 2024:196:23:07:43.734
2024-07-16 08:31:43,457 get_mon_dataset: Getting MON data from 2024:154:14:10:24.871 to 2024:154:14:40:55.521
2024-07-16 08:31:43,457 get_aca_images_cached: Getting ACA images from 2024:154:14:10:24.871 to 2024:154:14:40:55.521
2024-07-16 08:31:43,695 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2024-07-16 08:33:38,949 get_mon_dataset: Getting MON data from 2024:154:15:03:00.846 to 2024:154:15:09:11.896
2024-07-16 08:33:38,949 get_aca_images_cached: Getting ACA images from 2024:154:15:03:00.846 to 2024:154:15:09:11.896
2024-07-16 08:33:39,155 get_mon_dataset: Getting MON data from 2024:154:15:37:57.996 to 2024:154:15:53:55.346
2024-07-16 08:33:39,155 get_aca_images_cached: Getting ACA images from 2024:154:15:37:57.996 to 2024:154:15:53:55.346
2024-07-16 08:33:39,345 get_mon_dataset: Getting MON data from 2024:157:06:12:31.486 to 2024:157:06:13:55.536
2024-07-16 08:33:39,345 get_aca_images_cached: Getting ACA images from 2024:157:06:12:31.486 to 2024:157:06:13:55.536
2024-07-16 08:33:39,517 get_mon_dataset: Getting MON data from 2024:157:06:33:41.461 to 2024:157:07:26:57.411
2024-07-16 08:33:39,517 get_aca_images_cached: Getting ACA images from 2024:157:06:33:41.461 to 2024:157:07:26:57.411
2024-07-16 08:33:39,775 get_mon_dataset: Getting MON data from 2024:159:21:53:00.451 to 2024:159:21:53:41.451
2024-07-16 08:33:39,775 get_aca_images_cached: Getting ACA images from 2024:159:21:53:00.451 to 2024:159:21:53:41.451
2024-07-16 08:33:40,074 get_mon_dataset: Not enough images for slot 0 found 7)
2024-07-16 08:33:40,077 get_mon_dataset: Not enough images for slot 1 found 7)
2024-07-16 08:33:40,081 get_mon_dataset: Not enough images for slot 2 found 7)
2024-07-16 08:33:40,084 get_mon_dataset: Not enough images for slot 3 found 7)
2024-07-16 08:33:40,087 get_mon_dataset: Not enough images for slot 4 found 7)
2024-07-16 08:33:40,090 get_mon_dataset: Not enough images for slot 5 found 7)
2024-07-16 08:33:40,093 get_mon_dataset: Not enough images for slot 6 found 7)
2024-07-16 08:33:40,096 get_mon_dataset: Not enough images for slot 7 found 7)
2024-07-16 08:33:40,096 main: No image data between 2024:159:21:53:00.451 and 2024:159:21:53:41.451
2024-07-16 08:33:40,097 get_mon_dataset: Getting MON data from 2024:159:22:23:15.726 to 2024:159:22:51:46.451
2024-07-16 08:33:40,097 get_aca_images_cached: Getting ACA images from 2024:159:22:23:15.726 to 2024:159:22:51:46.451
2024-07-16 08:33:47,051 get_mon_dataset: Getting MON data from 2024:162:13:30:36.191 to 2024:162:14:18:55.916
2024-07-16 08:33:47,051 get_aca_images_cached: Getting ACA images from 2024:162:13:30:36.191 to 2024:162:14:18:55.916
2024-07-16 08:33:58,798 get_mon_dataset: Getting MON data from 2024:165:04:59:37.381 to 2024:165:05:03:16.731
2024-07-16 08:33:58,798 get_aca_images_cached: Getting ACA images from 2024:165:04:59:37.381 to 2024:165:05:03:16.731
2024-07-16 08:33:58,966 get_mon_dataset: Getting MON data from 2024:165:05:22:08.331 to 2024:165:05:49:56.006
2024-07-16 08:33:58,966 get_aca_images_cached: Getting ACA images from 2024:165:05:22:08.331 to 2024:165:05:49:56.006
2024-07-16 08:33:59,174 get_mon_dataset: Getting MON data from 2024:167:20:28:25.245 to 2024:167:20:31:32.820
2024-07-16 08:33:59,174 get_aca_images_cached: Getting ACA images from 2024:167:20:28:25.245 to 2024:167:20:31:32.820
2024-07-16 08:33:59,344 get_mon_dataset: Getting MON data from 2024:167:20:49:44.446 to 2024:167:21:16:06.021
2024-07-16 08:33:59,344 get_aca_images_cached: Getting ACA images from 2024:167:20:49:44.446 to 2024:167:21:16:06.021
2024-07-16 08:33:59,562 get_mon_dataset: Getting MON data from 2024:170:11:47:00.160 to 2024:170:11:47:27.835
2024-07-16 08:33:59,562 get_aca_images_cached: Getting ACA images from 2024:170:11:47:00.160 to 2024:170:11:47:27.835
2024-07-16 08:33:59,585 get_mon_dataset: Not enough images for slot 0 found 4)
2024-07-16 08:33:59,587 get_mon_dataset: Not enough images for slot 1 found 4)
2024-07-16 08:33:59,589 get_mon_dataset: Not enough images for slot 2 found 4)
2024-07-16 08:33:59,591 get_mon_dataset: Not enough images for slot 3 found 4)
2024-07-16 08:33:59,593 get_mon_dataset: Not enough images for slot 4 found 4)
2024-07-16 08:33:59,595 get_mon_dataset: Not enough images for slot 5 found 4)
2024-07-16 08:33:59,597 get_mon_dataset: Not enough images for slot 6 found 4)
2024-07-16 08:33:59,599 get_mon_dataset: Not enough images for slot 7 found 4)
2024-07-16 08:33:59,600 main: No image data between 2024:170:11:47:00.160 and 2024:170:11:47:27.835
2024-07-16 08:33:59,600 get_mon_dataset: Getting MON data from 2024:170:12:17:32.860 to 2024:170:12:43:55.461
2024-07-16 08:33:59,600 get_aca_images_cached: Getting ACA images from 2024:170:12:17:32.860 to 2024:170:12:43:55.461
2024-07-16 08:33:59,810 get_mon_dataset: Getting MON data from 2024:173:03:24:00.025 to 2024:173:03:39:25.600
2024-07-16 08:33:59,811 get_aca_images_cached: Getting ACA images from 2024:173:03:24:00.025 to 2024:173:03:39:25.600
2024-07-16 08:34:00,004 get_mon_dataset: Getting MON data from 2024:173:03:53:54.800 to 2024:173:04:12:55.625
2024-07-16 08:34:00,004 get_aca_images_cached: Getting ACA images from 2024:173:03:53:54.800 to 2024:173:04:12:55.625
2024-07-16 08:34:00,216 get_mon_dataset: Getting MON data from 2024:175:18:49:59.790 to 2024:175:19:41:55.790
2024-07-16 08:34:00,217 get_aca_images_cached: Getting ACA images from 2024:175:18:49:59.790 to 2024:175:19:41:55.790
2024-07-16 08:34:00,495 get_mon_dataset: Getting MON data from 2024:178:10:18:00.505 to 2024:178:10:46:37.380
2024-07-16 08:34:00,495 get_aca_images_cached: Getting ACA images from 2024:178:10:18:00.505 to 2024:178:10:46:37.380
2024-07-16 08:34:00,736 get_mon_dataset: Getting MON data from 2024:178:10:56:49.305 to 2024:178:11:07:55.555
2024-07-16 08:34:00,737 get_aca_images_cached: Getting ACA images from 2024:178:10:56:49.305 to 2024:178:11:07:55.555
2024-07-16 08:34:00,934 get_mon_dataset: Getting MON data from 2024:181:01:44:59.720 to 2024:181:02:35:56.270
2024-07-16 08:34:00,934 get_aca_images_cached: Getting ACA images from 2024:181:01:44:59.720 to 2024:181:02:35:56.270
2024-07-16 08:34:01,203 get_mon_dataset: Getting MON data from 2024:183:16:27:59.559 to 2024:183:16:50:56.135
2024-07-16 08:34:01,203 get_aca_images_cached: Getting ACA images from 2024:183:16:27:59.559 to 2024:183:16:50:56.135
2024-07-16 08:34:01,420 get_mon_dataset: Getting MON data from 2024:183:17:10:41.035 to 2024:183:17:11:40.485
2024-07-16 08:34:01,420 get_aca_images_cached: Getting ACA images from 2024:183:17:10:41.035 to 2024:183:17:11:40.485
2024-07-16 08:34:01,596 get_mon_dataset: Getting MON data from 2024:183:17:41:33.210 to 2024:183:18:02:26.785
2024-07-16 08:34:01,596 get_aca_images_cached: Getting ACA images from 2024:183:17:41:33.210 to 2024:183:18:02:26.785
2024-07-16 08:34:01,810 get_mon_dataset: Getting MON data from 2024:186:07:52:20.924 to 2024:186:08:20:55.749
2024-07-16 08:34:01,810 get_aca_images_cached: Getting ACA images from 2024:186:07:52:20.924 to 2024:186:08:20:55.749
2024-07-16 08:34:02,036 get_mon_dataset: Getting MON data from 2024:186:08:40:40.650 to 2024:186:09:32:26.400
2024-07-16 08:34:02,036 get_aca_images_cached: Getting ACA images from 2024:186:08:40:40.650 to 2024:186:09:32:26.400
2024-07-16 08:34:02,299 get_mon_dataset: Getting MON data from 2024:188:23:22:20.539 to 2024:188:23:50:55.364
2024-07-16 08:34:02,299 get_aca_images_cached: Getting ACA images from 2024:188:23:22:20.539 to 2024:188:23:50:55.364
2024-07-16 08:34:02,528 get_mon_dataset: Getting MON data from 2024:189:00:10:41.289 to 2024:189:01:02:27.040
2024-07-16 08:34:02,528 get_aca_images_cached: Getting ACA images from 2024:189:00:10:41.289 to 2024:189:01:02:27.040
2024-07-16 08:34:02,803 get_mon_dataset: Getting MON data from 2024:191:15:39:59.904 to 2024:191:15:41:00.379
2024-07-16 08:34:02,803 get_aca_images_cached: Getting ACA images from 2024:191:15:39:59.904 to 2024:191:15:41:00.379
2024-07-16 08:34:03,095 get_mon_dataset: Getting MON data from 2024:191:16:11:17.704 to 2024:191:16:30:55.429
2024-07-16 08:34:03,095 get_aca_images_cached: Getting ACA images from 2024:191:16:11:17.704 to 2024:191:16:30:55.429
2024-07-16 08:34:03,310 get_mon_dataset: Getting MON data from 2024:194:07:09:00.069 to 2024:194:07:09:24.669
2024-07-16 08:34:03,311 get_aca_images_cached: Getting ACA images from 2024:194:07:09:00.069 to 2024:194:07:09:24.669
2024-07-16 08:34:03,347 get_mon_dataset: Not enough images for slot 0 found 3)
2024-07-16 08:34:03,350 get_mon_dataset: Not enough images for slot 1 found 3)
2024-07-16 08:34:03,353 get_mon_dataset: Not enough images for slot 2 found 3)
2024-07-16 08:34:03,355 get_mon_dataset: Not enough images for slot 3 found 3)
2024-07-16 08:34:03,358 get_mon_dataset: Not enough images for slot 4 found 3)
2024-07-16 08:34:03,360 get_mon_dataset: Not enough images for slot 5 found 3)
2024-07-16 08:34:03,363 get_mon_dataset: Not enough images for slot 6 found 3)
2024-07-16 08:34:03,365 get_mon_dataset: Not enough images for slot 7 found 3)
2024-07-16 08:34:03,365 main: No image data between 2024:194:07:09:00.069 and 2024:194:07:09:24.669
2024-07-16 08:34:03,367 get_mon_dataset: Getting MON data from 2024:194:07:39:47.119 to 2024:194:08:00:56.069
2024-07-16 08:34:03,367 get_aca_images_cached: Getting ACA images from 2024:194:07:39:47.119 to 2024:194:08:00:56.069
2024-07-16 08:34:03,600 get_mon_dataset: Getting MON data from 2024:196:22:32:59.909 to 2024:196:22:37:14.109
2024-07-16 08:34:03,600 get_aca_images_cached: Getting ACA images from 2024:196:22:32:59.909 to 2024:196:22:37:14.109
2024-07-16 08:34:05,028 get_mon_dataset: Getting MON data from 2024:196:23:07:43.734 to 2024:196:23:25:55.359
2024-07-16 08:34:05,028 get_aca_images_cached: Getting ACA images from 2024:196:23:07:43.734 to 2024:196:23:25:55.359
Traceback (most recent call last):
File "/proj/sot/ska3/flight/bin/kalman_watch_monitor_win_perigee", line 10, in
sys.exit(main())
^^^^^^
File "/proj/sot/ska3/flight/lib/python3.11/site-packages/kalman_watch/monitor_win_perigee.py", line 824, in main
kalman_drops_nman = get_kalman_drops_nman(mon, idx)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.11/site-packages/kalman_watch/monitor_win_perigee.py", line 531, in get_kalman_drops_nman
dt_mins, kalman_drops = get_kalman_drops_per_minute(mon)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.11/site-packages/kalman_watch/monitor_win_perigee.py", line 509, in get_kalman_drops_per_minute
ok = (mon["hits"]["dt_min"] >= dt_min0) & (mon["hits"]["dt_min"] < dt_min1)
~~~~~~~~~~~^^^^^^^^^^
File "/proj/sot/ska3/flight/lib/python3.11/site-packages/astropy/table/table.py", line 2061, in __getitem__
return self.columns[item]
~~~~~~~~~~~~^^^^^^
File "/proj/sot/ska3/flight/lib/python3.11/site-packages/astropy/table/table.py", line 264, in __getitem__
return OrderedDict.__getitem__(self, item)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'dt_min'