Prev   Index   Next

centroid_dashboard: Sun May 10 13:18:02 2026

File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log

Task Status AgeMaxAge Last Date
centroid_dashboard OK 0.891.0 Sun May 10 13:18:02 2026

No errors

File contents:

2026-05-10 13:16:17,117 main: Processing from 2026:123:17:16:17.116 to 2026:130:17:16:17.116
2026-05-10 13:16:23,815 get_observations: Found observation 32324 at 2026:123:19:50:36.292 with 1 manvrs
2026-05-10 13:16:23,815 get_observations: Found observation 30101 at 2026:123:23:52:41.275 with 1 manvrs
2026-05-10 13:16:23,816 get_observations: Found observation 41516 at 2026:124:03:17:31.114 with 1 manvrs
2026-05-10 13:16:23,816 get_observations: Found observation 41515 at 2026:124:06:55:40.252 with 1 manvrs
2026-05-10 13:16:23,816 get_observations: Found observation 41514 at 2026:124:08:55:40.252 with 1 manvrs
2026-05-10 13:16:23,817 get_observations: Found observation 41513 at 2026:124:11:55:40.252 with 1 manvrs
2026-05-10 13:16:23,817 get_observations: Found observation 32328 at 2026:124:14:25:15.614 with 1 manvrs
2026-05-10 13:16:23,818 get_observations: Found observation 30536 at 2026:124:20:29:29.487 with 1 manvrs
2026-05-10 13:16:23,818 get_observations: Found observation 31929 at 2026:125:04:49:19.054 with 1 manvrs
2026-05-10 13:16:23,818 get_observations: Found observation 32326 at 2026:125:08:45:24.101 with 1 manvrs
2026-05-10 13:16:23,819 get_observations: Found observation 30262 at 2026:125:12:03:12.912 with 1 manvrs
2026-05-10 13:16:23,819 get_observations: Found observation 32291 at 2026:125:21:16:01.235 with 1 manvrs
2026-05-10 13:16:23,820 get_observations: Found observation 32325 at 2026:125:23:09:08.415 with 1 manvrs
2026-05-10 13:16:23,820 get_observations: Found observation 32080 at 2026:126:02:44:51.482 with 1 manvrs
2026-05-10 13:16:23,820 get_observations: Found observation 41512 at 2026:126:08:11:04.185 with 1 manvrs
2026-05-10 13:16:23,821 get_observations: Found observation 30204 at 2026:126:09:10:36.328 with 1 manvrs
2026-05-10 13:16:23,821 get_observations: Found observation 30063 at 2026:126:12:29:33.411 with 1 manvrs
2026-05-10 13:16:23,822 get_observations: Found observation 41511 at 2026:126:18:36:19.297 with 1 manvrs
2026-05-10 13:16:23,822 get_observations: Found observation 41510 at 2026:126:21:55:40.252 with 1 manvrs
2026-05-10 13:16:23,822 get_observations: Found observation 41509 at 2026:127:00:55:40.252 with 1 manvrs
2026-05-10 13:16:23,823 get_observations: Found observation 31376 at 2026:127:05:55:57.503 with 1 manvrs
2026-05-10 13:16:23,823 get_observations: Found observation 30210 at 2026:127:15:11:02.947 with 2 manvrs
2026-05-10 13:16:23,824 get_observations: Found observation 30141 at 2026:127:19:23:36.709 with 2 manvrs
2026-05-10 13:16:23,824 get_observations: Found observation 32330 at 2026:128:01:04:46.952 with 2 manvrs
2026-05-10 13:16:23,825 get_observations: Found observation 32329 at 2026:128:04:49:15.806 with 2 manvrs
2026-05-10 13:16:23,825 get_observations: Found observation 32331 at 2026:128:08:50:36.341 with 2 manvrs
2026-05-10 13:16:23,825 get_observations: Found observation 30062 at 2026:128:13:15:38.709 with 1 manvrs
2026-05-10 13:16:23,826 get_observations: Found observation 32161 at 2026:129:06:42:35.614 with 1 manvrs
2026-05-10 13:16:23,826 get_observations: Found observation 41503 at 2026:129:10:49:36.697 with 1 manvrs
2026-05-10 13:16:23,827 get_observations: Found observation 41502 at 2026:129:12:21:28.023 with 1 manvrs
2026-05-10 13:16:23,827 get_observations: Found observation 41501 at 2026:129:13:39:00.325 with 1 manvrs
2026-05-10 13:16:23,827 get_observations: Found observation 41500 at 2026:129:14:56:33.538 with 1 manvrs
2026-05-10 13:16:23,828 get_observations: Found observation 41499 at 2026:129:16:15:40.252 with 1 manvrs
2026-05-10 13:16:23,828 get_observations: Found observation 32327 at 2026:129:20:51:41.774 with 1 manvrs
2026-05-10 13:16:23,829 get_observations: Found observation 32332 at 2026:130:03:13:12.255 with 1 manvrs
2026-05-10 13:16:23,829 get_observations: Found observation 31494 at 2026:130:08:00:19.211 with 1 manvrs
2026-05-10 13:16:23,829 get_observations: Found observation 31918 at 2026:130:12:38:31.297 with 1 manvrs
2026-05-10 13:16:23,830 main: Found 37 observations
2026-05-10 13:16:23,830 main: ********************************************************************************
2026-05-10 13:16:23,830 main: Processing observation 32324
2026-05-10 13:16:23,830 main: ********************************************************************************
2026-05-10 13:16:23,840 obs_link_from_info: Found prev obsid 31736
2026-05-10 13:16:23,848 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,851 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-10 13:16:23,867 process_obs: ObsID 32324 already processed, skipping
2026-05-10 13:16:23,867 main:
2026-05-10 13:16:23,867 main: ********************************************************************************
2026-05-10 13:16:23,867 main: Processing observation 30101
2026-05-10 13:16:23,867 main: ********************************************************************************
2026-05-10 13:16:23,868 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,869 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:23,885 process_obs: ObsID 30101 already processed, skipping
2026-05-10 13:16:23,885 main:
2026-05-10 13:16:23,885 main: ********************************************************************************
2026-05-10 13:16:23,885 main: Processing observation 41516
2026-05-10 13:16:23,885 main: ********************************************************************************
2026-05-10 13:16:23,889 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,892 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:23,905 process_obs: ObsID 41516 already processed, skipping
2026-05-10 13:16:23,905 main:
2026-05-10 13:16:23,905 main: ********************************************************************************
2026-05-10 13:16:23,905 main: Processing observation 41515
2026-05-10 13:16:23,905 main: ********************************************************************************
2026-05-10 13:16:23,909 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,911 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:23,916 process_obs: ObsID 41515 already processed, skipping
2026-05-10 13:16:23,916 main:
2026-05-10 13:16:23,916 main: ********************************************************************************
2026-05-10 13:16:23,916 main: Processing observation 41514
2026-05-10 13:16:23,916 main: ********************************************************************************
2026-05-10 13:16:23,918 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,920 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:23,931 process_obs: ObsID 41514 already processed, skipping
2026-05-10 13:16:23,931 main:
2026-05-10 13:16:23,931 main: ********************************************************************************
2026-05-10 13:16:23,931 main: Processing observation 41513
2026-05-10 13:16:23,931 main: ********************************************************************************
2026-05-10 13:16:23,937 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,944 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:23,949 process_obs: ObsID 41513 already processed, skipping
2026-05-10 13:16:23,949 main:
2026-05-10 13:16:23,949 main: ********************************************************************************
2026-05-10 13:16:23,949 main: Processing observation 32328
2026-05-10 13:16:23,949 main: ********************************************************************************
2026-05-10 13:16:23,951 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,953 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:23,977 process_obs: ObsID 32328 already processed, skipping
2026-05-10 13:16:23,977 main:
2026-05-10 13:16:23,977 main: ********************************************************************************
2026-05-10 13:16:23,977 main: Processing observation 30536
2026-05-10 13:16:23,977 main: ********************************************************************************
2026-05-10 13:16:23,980 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:23,982 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:23,996 process_obs: ObsID 30536 already processed, skipping
2026-05-10 13:16:23,996 main:
2026-05-10 13:16:23,996 main: ********************************************************************************
2026-05-10 13:16:23,996 main: Processing observation 31929
2026-05-10 13:16:23,996 main: ********************************************************************************
2026-05-10 13:16:24,000 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:24,005 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:24,032 process_obs: ObsID 31929 already processed, skipping
2026-05-10 13:16:24,032 main:
2026-05-10 13:16:24,032 main: ********************************************************************************
2026-05-10 13:16:24,032 main: Processing observation 32326
2026-05-10 13:16:24,032 main: ********************************************************************************
2026-05-10 13:16:24,033 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:24,035 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:24,040 process_obs: ObsID 32326 already processed, skipping
2026-05-10 13:16:24,040 main:
2026-05-10 13:16:24,040 main: ********************************************************************************
2026-05-10 13:16:24,040 main: Processing observation 30262
2026-05-10 13:16:24,040 main: ********************************************************************************
2026-05-10 13:16:24,043 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:24,046 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:24,060 process_obs: ObsID 30262 already processed, skipping
2026-05-10 13:16:24,060 main:
2026-05-10 13:16:24,060 main: ********************************************************************************
2026-05-10 13:16:24,060 main: Processing observation 32291
2026-05-10 13:16:24,060 main: ********************************************************************************
2026-05-10 13:16:24,062 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:24,069 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 13:16:24,082 process_obs: ObsID 32291 already processed, skipping
2026-05-10 13:16:24,082 main:
2026-05-10 13:16:24,082 main: ********************************************************************************
2026-05-10 13:16:24,082 main: Processing observation 32325
2026-05-10 13:16:24,082 main: ********************************************************************************
2026-05-10 13:16:24,084 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 13:16:24,085 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:29,414 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/centroid_resids.pkl
2026-05-10 12:16:29,459 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-10 12:16:29,459 plot_crs_time: Plot file exists, skipping
2026-05-10 12:16:29,462 plot_crs_scatter: Plot file exists, skipping
2026-05-10 12:16:29,755 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:16:32,006 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/n_kalman_delta_roll.png
2026-05-10 12:16:35,716 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/index.html
2026-05-10 12:16:35,718 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/info.json
2026-05-10 12:16:35,724 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32325/index.html
2026-05-10 12:16:35,727 main:
2026-05-10 12:16:35,727 main: ********************************************************************************
2026-05-10 12:16:35,727 main: Processing observation 32080
2026-05-10 12:16:35,727 main: ********************************************************************************
2026-05-10 12:16:35,730 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,734 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:35,741 process_obs: ObsID 32080 already processed, skipping
2026-05-10 12:16:35,741 main:
2026-05-10 12:16:35,741 main: ********************************************************************************
2026-05-10 12:16:35,741 main: Processing observation 41512
2026-05-10 12:16:35,741 main: ********************************************************************************
2026-05-10 12:16:35,744 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,746 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:35,756 process_obs: ObsID 41512 already processed, skipping
2026-05-10 12:16:35,756 main:
2026-05-10 12:16:35,756 main: ********************************************************************************
2026-05-10 12:16:35,756 main: Processing observation 30204
2026-05-10 12:16:35,756 main: ********************************************************************************
2026-05-10 12:16:35,758 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,761 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:35,777 process_obs: ObsID 30204 already processed, skipping
2026-05-10 12:16:35,777 main:
2026-05-10 12:16:35,777 main: ********************************************************************************
2026-05-10 12:16:35,777 main: Processing observation 30063
2026-05-10 12:16:35,777 main: ********************************************************************************
2026-05-10 12:16:35,780 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,800 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:35,830 process_obs: ObsID 30063 already processed, skipping
2026-05-10 12:16:35,830 main:
2026-05-10 12:16:35,830 main: ********************************************************************************
2026-05-10 12:16:35,830 main: Processing observation 41511
2026-05-10 12:16:35,830 main: ********************************************************************************
2026-05-10 12:16:35,832 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,833 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:35,846 process_obs: ObsID 41511 already processed, skipping
2026-05-10 12:16:35,846 main:
2026-05-10 12:16:35,846 main: ********************************************************************************
2026-05-10 12:16:35,846 main: Processing observation 41510
2026-05-10 12:16:35,846 main: ********************************************************************************
2026-05-10 12:16:35,854 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,870 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:35,898 process_obs: ObsID 41510 already processed, skipping
2026-05-10 12:16:35,898 main:
2026-05-10 12:16:35,898 main: ********************************************************************************
2026-05-10 12:16:35,898 main: Processing observation 41509
2026-05-10 12:16:35,898 main: ********************************************************************************
2026-05-10 12:16:35,906 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,910 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:35,934 process_obs: ObsID 41509 already processed, skipping
2026-05-10 12:16:35,934 main:
2026-05-10 12:16:35,934 main: ********************************************************************************
2026-05-10 12:16:35,934 main: Processing observation 31376
2026-05-10 12:16:35,934 main: ********************************************************************************
2026-05-10 12:16:35,940 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:35,962 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:38,931 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/centroid_resids.pkl
2026-05-10 12:16:38,939 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-10 12:16:38,939 plot_crs_time: Plot file exists, skipping
2026-05-10 12:16:38,940 plot_crs_scatter: Plot file exists, skipping
2026-05-10 12:16:39,013 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:16:39,116 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/n_kalman_delta_roll.png
2026-05-10 12:16:39,231 get_aberration_correction: More than one entry for 31376 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAY0426/oflsa/output/MAY0426A_ManErr.txt. Skipping aber correction
2026-05-10 12:16:41,489 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/index.html
2026-05-10 12:16:41,491 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/info.json
2026-05-10 12:16:41,496 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31376/index.html
2026-05-10 12:16:41,498 main:
2026-05-10 12:16:41,498 main: ********************************************************************************
2026-05-10 12:16:41,498 main: Processing observation 30210
2026-05-10 12:16:41,498 main: ********************************************************************************
2026-05-10 12:16:41,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:41,503 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:41,509 process_obs: ObsID 30210 already processed, skipping
2026-05-10 12:16:41,509 main:
2026-05-10 12:16:41,509 main: ********************************************************************************
2026-05-10 12:16:41,509 main: Processing observation 30141
2026-05-10 12:16:41,509 main: ********************************************************************************
2026-05-10 12:16:41,511 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:41,512 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:41,518 process_obs: ObsID 30141 already processed, skipping
2026-05-10 12:16:41,518 main:
2026-05-10 12:16:41,518 main: ********************************************************************************
2026-05-10 12:16:41,518 main: Processing observation 32330
2026-05-10 12:16:41,518 main: ********************************************************************************
2026-05-10 12:16:41,519 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:41,521 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:41,538 process_obs: ObsID 32330 already processed, skipping
2026-05-10 12:16:41,538 main:
2026-05-10 12:16:41,538 main: ********************************************************************************
2026-05-10 12:16:41,538 main: Processing observation 32329
2026-05-10 12:16:41,538 main: ********************************************************************************
2026-05-10 12:16:41,539 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:41,542 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:41,555 process_obs: ObsID 32329 already processed, skipping
2026-05-10 12:16:41,555 main:
2026-05-10 12:16:41,555 main: ********************************************************************************
2026-05-10 12:16:41,555 main: Processing observation 32331
2026-05-10 12:16:41,555 main: ********************************************************************************
2026-05-10 12:16:41,556 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:41,558 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:41,590 process_obs: ObsID 32331 already processed, skipping
2026-05-10 12:16:41,590 main:
2026-05-10 12:16:41,590 main: ********************************************************************************
2026-05-10 12:16:41,590 main: Processing observation 30062
2026-05-10 12:16:41,590 main: ********************************************************************************
2026-05-10 12:16:41,607 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:41,627 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:44,142 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-10 12:16:44,709 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/centroid_resids.pkl with 5 slots
2026-05-10 12:16:44,818 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/centroid_resids_time.png
2026-05-10 12:16:45,350 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/centroid_resids_scatter.png
2026-05-10 12:16:45,748 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:16:45,902 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/n_kalman_delta_roll.png
2026-05-10 12:16:48,463 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/index.html
2026-05-10 12:16:48,465 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/info.json
2026-05-10 12:16:48,488 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30062/index.html
2026-05-10 12:16:48,489 main:
2026-05-10 12:16:48,489 main: ********************************************************************************
2026-05-10 12:16:48,489 main: Processing observation 32161
2026-05-10 12:16:48,489 main: ********************************************************************************
2026-05-10 12:16:48,491 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:48,492 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:51,517 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-10 12:16:51,984 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32161/centroid_resids.pkl with 5 slots
2026-05-10 12:16:52,052 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32161/centroid_resids_time.png
2026-05-10 12:16:52,322 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32161/centroid_resids_scatter.png
2026-05-10 12:16:53,923 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32161/n_kalman_delta_roll.png
2026-05-10 12:16:54,081 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32161/index.html
2026-05-10 12:16:54,082 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32161/info.json
2026-05-10 12:16:54,085 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32161/index.html
2026-05-10 12:16:54,086 main:
2026-05-10 12:16:54,086 main: ********************************************************************************
2026-05-10 12:16:54,086 main: Processing observation 41503
2026-05-10 12:16:54,086 main: ********************************************************************************
2026-05-10 12:16:54,087 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:54,088 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:16:56,488 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-10 12:16:56,958 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41503/centroid_resids.pkl with 8 slots
2026-05-10 12:16:57,020 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41503/centroid_resids_time.png
2026-05-10 12:16:57,318 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41503/centroid_resids_scatter.png
2026-05-10 12:16:57,405 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:16:57,571 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41503/n_kalman_delta_roll.png
2026-05-10 12:16:57,745 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41503/index.html
2026-05-10 12:16:57,746 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41503/info.json
2026-05-10 12:16:57,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41503/index.html
2026-05-10 12:16:57,766 main:
2026-05-10 12:16:57,766 main: ********************************************************************************
2026-05-10 12:16:57,766 main: Processing observation 41502
2026-05-10 12:16:57,766 main: ********************************************************************************
2026-05-10 12:16:57,767 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:16:57,768 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:00,476 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-10 12:17:00,993 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41502/centroid_resids.pkl with 8 slots
2026-05-10 12:17:01,060 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41502/centroid_resids_time.png
2026-05-10 12:17:01,347 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41502/centroid_resids_scatter.png
2026-05-10 12:17:01,446 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:17:01,603 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41502/n_kalman_delta_roll.png
2026-05-10 12:17:01,799 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41502/index.html
2026-05-10 12:17:01,810 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41502/info.json
2026-05-10 12:17:01,816 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41502/index.html
2026-05-10 12:17:01,817 main:
2026-05-10 12:17:01,817 main: ********************************************************************************
2026-05-10 12:17:01,817 main: Processing observation 41501
2026-05-10 12:17:01,817 main: ********************************************************************************
2026-05-10 12:17:01,819 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:17:01,821 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:05,079 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-10 12:17:05,910 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41501/centroid_resids.pkl with 8 slots
2026-05-10 12:17:05,978 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41501/centroid_resids_time.png
2026-05-10 12:17:06,284 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41501/centroid_resids_scatter.png
2026-05-10 12:17:06,413 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:17:06,576 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41501/n_kalman_delta_roll.png
2026-05-10 12:17:07,190 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41501/index.html
2026-05-10 12:17:07,196 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41501/info.json
2026-05-10 12:17:07,204 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41501/index.html
2026-05-10 12:17:07,206 main:
2026-05-10 12:17:07,206 main: ********************************************************************************
2026-05-10 12:17:07,206 main: Processing observation 41500
2026-05-10 12:17:07,206 main: ********************************************************************************
2026-05-10 12:17:07,209 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:17:07,213 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:11,194 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-10 12:17:11,631 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41500/centroid_resids.pkl with 8 slots
2026-05-10 12:17:11,698 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41500/centroid_resids_time.png
2026-05-10 12:17:11,992 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41500/centroid_resids_scatter.png
2026-05-10 12:17:12,068 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:17:12,228 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41500/n_kalman_delta_roll.png
2026-05-10 12:17:12,797 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41500/index.html
2026-05-10 12:17:12,798 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41500/info.json
2026-05-10 12:17:12,801 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41500/index.html
2026-05-10 12:17:12,802 main:
2026-05-10 12:17:12,802 main: ********************************************************************************
2026-05-10 12:17:12,802 main: Processing observation 41499
2026-05-10 12:17:12,802 main: ********************************************************************************
2026-05-10 12:17:12,803 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:17:12,804 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:15,032 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-10 12:17:15,547 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41499/centroid_resids.pkl with 8 slots
2026-05-10 12:17:15,627 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41499/centroid_resids_time.png
2026-05-10 12:17:16,515 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41499/centroid_resids_scatter.png
2026-05-10 12:17:16,705 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-10 12:17:16,879 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41499/n_kalman_delta_roll.png
2026-05-10 12:17:17,038 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41499/index.html
2026-05-10 12:17:17,040 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41499/info.json
2026-05-10 12:17:17,043 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41499/index.html
2026-05-10 12:17:17,044 main:
2026-05-10 12:17:17,044 main: ********************************************************************************
2026-05-10 12:17:17,044 main: Processing observation 32327
2026-05-10 12:17:17,044 main: ********************************************************************************
2026-05-10 12:17:17,045 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:17:17,046 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:19,446 __init__: ObsID 32327 has no maneuver event in telemetry, skipping
2026-05-10 12:17:19,448 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/index.html
2026-05-10 12:17:19,454 info: could not get attribute kalman_start for obsid 32327
2026-05-10 12:17:19,454 info: could not get attribute kalman_stop for obsid 32327
2026-05-10 12:17:19,454 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/info.json
2026-05-10 12:17:19,455 main:
2026-05-10 12:17:19,455 main: ********************************************************************************
2026-05-10 12:17:19,455 main: Processing observation 32332
2026-05-10 12:17:19,455 main: ********************************************************************************
2026-05-10 12:17:19,457 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:17:19,460 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:22,092 __init__: ObsID 32332 has no maneuver event in telemetry, skipping
2026-05-10 12:17:22,092 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/index.html
2026-05-10 12:17:22,099 info: could not get attribute kalman_start for obsid 32332
2026-05-10 12:17:22,099 info: could not get attribute kalman_stop for obsid 32332
2026-05-10 12:17:22,099 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/info.json
2026-05-10 12:17:22,100 main:
2026-05-10 12:17:22,100 main: ********************************************************************************
2026-05-10 12:17:22,100 main: Processing observation 31494
2026-05-10 12:17:22,100 main: ********************************************************************************
2026-05-10 12:17:22,102 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:17:22,103 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:24,743 __init__: ObsID 31494 has no maneuver event in telemetry, skipping
2026-05-10 12:17:24,744 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/index.html
2026-05-10 12:17:24,748 info: could not get attribute kalman_start for obsid 31494
2026-05-10 12:17:24,749 info: could not get attribute kalman_stop for obsid 31494
2026-05-10 12:17:24,749 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/info.json
2026-05-10 12:17:24,749 main:
2026-05-10 12:17:24,749 main: ********************************************************************************
2026-05-10 12:17:24,750 main: Processing observation 31918
2026-05-10 12:17:24,750 main: ********************************************************************************
2026-05-10 12:17:24,750 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/info.json file found, obs=None
2026-05-10 12:17:24,751 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-10 12:17:24,752 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-10 12:17:27,574 __init__: ObsID 31918 has no maneuver event in telemetry, skipping
2026-05-10 12:17:27,575 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/index.html
2026-05-10 12:17:27,579 info: could not get attribute kalman_start for obsid 31918
2026-05-10 12:17:27,579 info: could not get attribute kalman_stop for obsid 31918
2026-05-10 12:17:27,579 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/info.json
2026-05-10 12:17:27,580 main:
2026-05-10 13:17:28,991 run_check: Starting centroid dashboard continuity check
2026-05-10 13:17:28,991 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-10 13:17:28,992 collect_observations: Processing year 2020
2026-05-10 13:17:32,185 collect_observations: Processing year 2021
2026-05-10 13:17:37,231 collect_observations: Processing year 2022
2026-05-10 13:17:42,792 collect_observations: Processing year 2023
2026-05-10 13:17:48,791 collect_observations: Processing year 2024
2026-05-10 13:17:54,355 collect_observations: Processing year 2025
2026-05-10 13:18:00,764 collect_observations: Processing year 2026
2026-05-10 13:18:02,650 collect_observations: Collected 13838 observations from 4-digit years
2026-05-10 13:18:02,654 sort_observations_by_date: Sorted observations by date
2026-05-10 13:18:02,654 check_continuity: Starting continuity check from most recent: ObsID 31918 (MAY0426A) at 2026:130:12:11:43.003
2026-05-10 13:18:02,672 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-10 13:18:02,672 check_continuity: Chain complete: visited 13838 observations out of 13838 total
2026-05-10 13:18:02,673 run_check: ✓ Observation chain continuity check PASSED
2026-05-10 13:18:02,673 run_check: Summary: 13838 observations from 4-digit years, all properly linked