Prev
Index
Next
centroid_dashboard: Mon May 11 13:17:36 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Mon May 11 13:17:36 2026 |
No errors
File contents:
2026-05-11 13:16:11,813 main: Processing from 2026:124:17:16:11.812 to 2026:131:17:16:11.812
2026-05-11 13:16:19,101 get_observations: Found observation 30536 at 2026:124:20:29:29.487 with 1 manvrs
2026-05-11 13:16:19,102 get_observations: Found observation 31929 at 2026:125:04:49:19.054 with 1 manvrs
2026-05-11 13:16:19,102 get_observations: Found observation 32326 at 2026:125:08:45:24.101 with 1 manvrs
2026-05-11 13:16:19,102 get_observations: Found observation 30262 at 2026:125:12:03:12.912 with 1 manvrs
2026-05-11 13:16:19,103 get_observations: Found observation 32291 at 2026:125:21:16:01.235 with 1 manvrs
2026-05-11 13:16:19,103 get_observations: Found observation 32325 at 2026:125:23:09:08.415 with 1 manvrs
2026-05-11 13:16:19,104 get_observations: Found observation 32080 at 2026:126:02:44:51.482 with 1 manvrs
2026-05-11 13:16:19,104 get_observations: Found observation 41512 at 2026:126:08:11:04.185 with 1 manvrs
2026-05-11 13:16:19,104 get_observations: Found observation 30204 at 2026:126:09:10:36.328 with 1 manvrs
2026-05-11 13:16:19,105 get_observations: Found observation 30063 at 2026:126:12:29:33.411 with 1 manvrs
2026-05-11 13:16:19,105 get_observations: Found observation 41511 at 2026:126:18:36:19.297 with 1 manvrs
2026-05-11 13:16:19,106 get_observations: Found observation 41510 at 2026:126:21:55:40.252 with 1 manvrs
2026-05-11 13:16:19,106 get_observations: Found observation 41509 at 2026:127:00:55:40.252 with 1 manvrs
2026-05-11 13:16:19,106 get_observations: Found observation 31376 at 2026:127:05:55:57.503 with 1 manvrs
2026-05-11 13:16:19,107 get_observations: Found observation 30210 at 2026:127:15:11:02.947 with 2 manvrs
2026-05-11 13:16:19,107 get_observations: Found observation 30141 at 2026:127:19:23:36.709 with 2 manvrs
2026-05-11 13:16:19,108 get_observations: Found observation 32330 at 2026:128:01:04:46.952 with 2 manvrs
2026-05-11 13:16:19,108 get_observations: Found observation 32329 at 2026:128:04:49:15.806 with 2 manvrs
2026-05-11 13:16:19,108 get_observations: Found observation 32331 at 2026:128:08:50:36.341 with 2 manvrs
2026-05-11 13:16:19,109 get_observations: Found observation 30062 at 2026:128:13:15:38.709 with 1 manvrs
2026-05-11 13:16:19,109 get_observations: Found observation 32161 at 2026:129:06:42:35.614 with 1 manvrs
2026-05-11 13:16:19,110 get_observations: Found observation 41503 at 2026:129:10:49:36.697 with 1 manvrs
2026-05-11 13:16:19,110 get_observations: Found observation 41502 at 2026:129:12:21:28.023 with 1 manvrs
2026-05-11 13:16:19,111 get_observations: Found observation 41501 at 2026:129:13:39:00.325 with 1 manvrs
2026-05-11 13:16:19,111 get_observations: Found observation 41500 at 2026:129:14:56:33.538 with 1 manvrs
2026-05-11 13:16:19,111 get_observations: Found observation 41499 at 2026:129:16:15:40.252 with 1 manvrs
2026-05-11 13:16:19,112 get_observations: Found observation 32327 at 2026:129:20:51:41.774 with 1 manvrs
2026-05-11 13:16:19,112 get_observations: Found observation 32332 at 2026:130:03:13:12.255 with 1 manvrs
2026-05-11 13:16:19,113 get_observations: Found observation 31494 at 2026:130:08:00:19.211 with 1 manvrs
2026-05-11 13:16:19,113 get_observations: Found observation 31918 at 2026:130:12:38:31.297 with 1 manvrs
2026-05-11 13:16:19,114 get_observations: Found observation 31456 at 2026:130:18:07:40.973 with 1 manvrs
2026-05-11 13:16:19,114 get_observations: Found observation 30059 at 2026:130:21:26:17.691 with 1 manvrs
2026-05-11 13:16:19,115 get_observations: Found observation 29939 at 2026:131:09:21:12.573 with 1 manvrs
2026-05-11 13:16:19,115 get_observations: Found observation 30060 at 2026:131:13:54:23.720 with 1 manvrs
2026-05-11 13:16:19,115 main: Found 34 observations
2026-05-11 13:16:19,116 main: ********************************************************************************
2026-05-11 13:16:19,116 main: Processing observation 30536
2026-05-11 13:16:19,116 main: ********************************************************************************
2026-05-11 13:16:19,119 obs_link_from_info: Found prev obsid 32328
2026-05-11 13:16:19,122 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 13:16:19,123 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 13:16:19,126 process_obs: ObsID 30536 already processed, skipping
2026-05-11 13:16:19,126 main:
2026-05-11 13:16:19,126 main: ********************************************************************************
2026-05-11 13:16:19,126 main: Processing observation 31929
2026-05-11 13:16:19,126 main: ********************************************************************************
2026-05-11 13:16:19,127 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 13:16:19,128 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 13:16:19,132 process_obs: ObsID 31929 already processed, skipping
2026-05-11 13:16:19,132 main:
2026-05-11 13:16:19,132 main: ********************************************************************************
2026-05-11 13:16:19,132 main: Processing observation 32326
2026-05-11 13:16:19,132 main: ********************************************************************************
2026-05-11 13:16:19,133 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 13:16:19,134 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 13:16:19,138 process_obs: ObsID 32326 already processed, skipping
2026-05-11 13:16:19,138 main:
2026-05-11 13:16:19,138 main: ********************************************************************************
2026-05-11 13:16:19,138 main: Processing observation 30262
2026-05-11 13:16:19,138 main: ********************************************************************************
2026-05-11 13:16:19,139 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 13:16:19,140 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 13:16:19,143 process_obs: ObsID 30262 already processed, skipping
2026-05-11 13:16:19,143 main:
2026-05-11 13:16:19,143 main: ********************************************************************************
2026-05-11 13:16:19,143 main: Processing observation 32291
2026-05-11 13:16:19,143 main: ********************************************************************************
2026-05-11 13:16:19,144 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 13:16:19,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 13:16:19,148 process_obs: ObsID 32291 already processed, skipping
2026-05-11 13:16:19,149 main:
2026-05-11 13:16:19,149 main: ********************************************************************************
2026-05-11 13:16:19,149 main: Processing observation 32325
2026-05-11 13:16:19,149 main: ********************************************************************************
2026-05-11 13:16:19,149 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 13:16:19,151 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:21,667 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/centroid_resids.pkl
2026-05-11 12:16:21,678 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-11 12:16:21,678 plot_crs_time: Plot file exists, skipping
2026-05-11 12:16:21,681 plot_crs_scatter: Plot file exists, skipping
2026-05-11 12:16:22,091 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-11 12:16:22,570 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/n_kalman_delta_roll.png
2026-05-11 12:16:32,263 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/index.html
2026-05-11 12:16:32,268 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/info.json
2026-05-11 12:16:32,279 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32325/index.html
2026-05-11 12:16:32,286 main:
2026-05-11 12:16:32,286 main: ********************************************************************************
2026-05-11 12:16:32,286 main: Processing observation 32080
2026-05-11 12:16:32,286 main: ********************************************************************************
2026-05-11 12:16:32,290 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,295 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:32,328 process_obs: ObsID 32080 already processed, skipping
2026-05-11 12:16:32,328 main:
2026-05-11 12:16:32,328 main: ********************************************************************************
2026-05-11 12:16:32,328 main: Processing observation 41512
2026-05-11 12:16:32,328 main: ********************************************************************************
2026-05-11 12:16:32,331 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,334 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:32,358 process_obs: ObsID 41512 already processed, skipping
2026-05-11 12:16:32,358 main:
2026-05-11 12:16:32,358 main: ********************************************************************************
2026-05-11 12:16:32,358 main: Processing observation 30204
2026-05-11 12:16:32,358 main: ********************************************************************************
2026-05-11 12:16:32,362 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,371 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:32,391 process_obs: ObsID 30204 already processed, skipping
2026-05-11 12:16:32,391 main:
2026-05-11 12:16:32,391 main: ********************************************************************************
2026-05-11 12:16:32,391 main: Processing observation 30063
2026-05-11 12:16:32,391 main: ********************************************************************************
2026-05-11 12:16:32,394 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,398 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:32,419 process_obs: ObsID 30063 already processed, skipping
2026-05-11 12:16:32,419 main:
2026-05-11 12:16:32,419 main: ********************************************************************************
2026-05-11 12:16:32,419 main: Processing observation 41511
2026-05-11 12:16:32,419 main: ********************************************************************************
2026-05-11 12:16:32,421 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,430 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:32,458 process_obs: ObsID 41511 already processed, skipping
2026-05-11 12:16:32,458 main:
2026-05-11 12:16:32,458 main: ********************************************************************************
2026-05-11 12:16:32,458 main: Processing observation 41510
2026-05-11 12:16:32,458 main: ********************************************************************************
2026-05-11 12:16:32,462 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,471 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:32,502 process_obs: ObsID 41510 already processed, skipping
2026-05-11 12:16:32,502 main:
2026-05-11 12:16:32,502 main: ********************************************************************************
2026-05-11 12:16:32,502 main: Processing observation 41509
2026-05-11 12:16:32,502 main: ********************************************************************************
2026-05-11 12:16:32,507 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,514 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:32,539 process_obs: ObsID 41509 already processed, skipping
2026-05-11 12:16:32,539 main:
2026-05-11 12:16:32,539 main: ********************************************************************************
2026-05-11 12:16:32,539 main: Processing observation 31376
2026-05-11 12:16:32,539 main: ********************************************************************************
2026-05-11 12:16:32,543 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:32,555 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:36,366 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/centroid_resids.pkl
2026-05-11 12:16:36,378 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-11 12:16:36,378 plot_crs_time: Plot file exists, skipping
2026-05-11 12:16:36,380 plot_crs_scatter: Plot file exists, skipping
2026-05-11 12:16:36,563 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-11 12:16:36,669 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/n_kalman_delta_roll.png
2026-05-11 12:16:37,013 get_aberration_correction: More than one entry for 31376 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAY0426/oflsa/output/MAY0426A_ManErr.txt. Skipping aber correction
2026-05-11 12:16:39,949 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/index.html
2026-05-11 12:16:39,952 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/info.json
2026-05-11 12:16:39,959 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31376/index.html
2026-05-11 12:16:39,962 main:
2026-05-11 12:16:39,963 main: ********************************************************************************
2026-05-11 12:16:39,963 main: Processing observation 30210
2026-05-11 12:16:39,963 main: ********************************************************************************
2026-05-11 12:16:39,965 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:39,970 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:39,988 process_obs: ObsID 30210 already processed, skipping
2026-05-11 12:16:39,989 main:
2026-05-11 12:16:39,989 main: ********************************************************************************
2026-05-11 12:16:39,989 main: Processing observation 30141
2026-05-11 12:16:39,989 main: ********************************************************************************
2026-05-11 12:16:39,991 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:39,996 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:40,010 process_obs: ObsID 30141 already processed, skipping
2026-05-11 12:16:40,010 main:
2026-05-11 12:16:40,010 main: ********************************************************************************
2026-05-11 12:16:40,010 main: Processing observation 32330
2026-05-11 12:16:40,010 main: ********************************************************************************
2026-05-11 12:16:40,012 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:40,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:40,032 process_obs: ObsID 32330 already processed, skipping
2026-05-11 12:16:40,032 main:
2026-05-11 12:16:40,032 main: ********************************************************************************
2026-05-11 12:16:40,032 main: Processing observation 32329
2026-05-11 12:16:40,032 main: ********************************************************************************
2026-05-11 12:16:40,036 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:40,039 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:40,057 process_obs: ObsID 32329 already processed, skipping
2026-05-11 12:16:40,057 main:
2026-05-11 12:16:40,057 main: ********************************************************************************
2026-05-11 12:16:40,057 main: Processing observation 32331
2026-05-11 12:16:40,057 main: ********************************************************************************
2026-05-11 12:16:40,059 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:40,063 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:40,079 process_obs: ObsID 32331 already processed, skipping
2026-05-11 12:16:40,079 main:
2026-05-11 12:16:40,079 main: ********************************************************************************
2026-05-11 12:16:40,079 main: Processing observation 30062
2026-05-11 12:16:40,079 main: ********************************************************************************
2026-05-11 12:16:40,083 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:40,086 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:47,520 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/centroid_resids.pkl
2026-05-11 12:16:47,578 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-11 12:16:47,578 plot_crs_time: Plot file exists, skipping
2026-05-11 12:16:47,578 plot_crs_scatter: Plot file exists, skipping
2026-05-11 12:16:47,675 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-11 12:16:47,817 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/n_kalman_delta_roll.png
2026-05-11 12:16:50,322 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/index.html
2026-05-11 12:16:50,324 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/info.json
2026-05-11 12:16:50,346 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30062/index.html
2026-05-11 12:16:50,347 main:
2026-05-11 12:16:50,347 main: ********************************************************************************
2026-05-11 12:16:50,347 main: Processing observation 32161
2026-05-11 12:16:50,347 main: ********************************************************************************
2026-05-11 12:16:50,348 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:50,349 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:50,364 process_obs: ObsID 32161 already processed, skipping
2026-05-11 12:16:50,364 main:
2026-05-11 12:16:50,364 main: ********************************************************************************
2026-05-11 12:16:50,364 main: Processing observation 41503
2026-05-11 12:16:50,364 main: ********************************************************************************
2026-05-11 12:16:50,365 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:50,366 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:50,378 process_obs: ObsID 41503 already processed, skipping
2026-05-11 12:16:50,378 main:
2026-05-11 12:16:50,378 main: ********************************************************************************
2026-05-11 12:16:50,378 main: Processing observation 41502
2026-05-11 12:16:50,378 main: ********************************************************************************
2026-05-11 12:16:50,379 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:50,380 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:50,391 process_obs: ObsID 41502 already processed, skipping
2026-05-11 12:16:50,391 main:
2026-05-11 12:16:50,391 main: ********************************************************************************
2026-05-11 12:16:50,391 main: Processing observation 41501
2026-05-11 12:16:50,391 main: ********************************************************************************
2026-05-11 12:16:50,392 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:50,393 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:50,399 process_obs: ObsID 41501 already processed, skipping
2026-05-11 12:16:50,399 main:
2026-05-11 12:16:50,399 main: ********************************************************************************
2026-05-11 12:16:50,400 main: Processing observation 41500
2026-05-11 12:16:50,400 main: ********************************************************************************
2026-05-11 12:16:50,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:50,402 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:50,419 process_obs: ObsID 41500 already processed, skipping
2026-05-11 12:16:50,419 main:
2026-05-11 12:16:50,419 main: ********************************************************************************
2026-05-11 12:16:50,419 main: Processing observation 41499
2026-05-11 12:16:50,419 main: ********************************************************************************
2026-05-11 12:16:50,420 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:50,421 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:50,437 process_obs: ObsID 41499 already processed, skipping
2026-05-11 12:16:50,437 main:
2026-05-11 12:16:50,437 main: ********************************************************************************
2026-05-11 12:16:50,437 main: Processing observation 32327
2026-05-11 12:16:50,437 main: ********************************************************************************
2026-05-11 12:16:50,438 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:50,439 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:52,254 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-11 12:16:52,599 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/centroid_resids.pkl with 5 slots
2026-05-11 12:16:52,657 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/centroid_resids_time.png
2026-05-11 12:16:52,953 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/centroid_resids_scatter.png
2026-05-11 12:16:53,905 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/n_kalman_delta_roll.png
2026-05-11 12:16:55,859 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/index.html
2026-05-11 12:16:55,861 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32327/info.json
2026-05-11 12:16:55,864 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32327/index.html
2026-05-11 12:16:55,865 main:
2026-05-11 12:16:55,865 main: ********************************************************************************
2026-05-11 12:16:55,865 main: Processing observation 32332
2026-05-11 12:16:55,865 main: ********************************************************************************
2026-05-11 12:16:55,866 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:55,867 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:16:57,971 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-11 12:16:58,276 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/centroid_resids.pkl with 5 slots
2026-05-11 12:16:58,328 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/centroid_resids_time.png
2026-05-11 12:16:58,808 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/centroid_resids_scatter.png
2026-05-11 12:16:59,624 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/n_kalman_delta_roll.png
2026-05-11 12:16:59,781 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/index.html
2026-05-11 12:16:59,782 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32332/info.json
2026-05-11 12:16:59,785 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32332/index.html
2026-05-11 12:16:59,785 main:
2026-05-11 12:16:59,786 main: ********************************************************************************
2026-05-11 12:16:59,786 main: Processing observation 31494
2026-05-11 12:16:59,786 main: ********************************************************************************
2026-05-11 12:16:59,787 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:16:59,788 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:17:01,787 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-11 12:17:02,435 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/centroid_resids.pkl with 5 slots
2026-05-11 12:17:02,488 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/centroid_resids_time.png
2026-05-11 12:17:02,771 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/centroid_resids_scatter.png
2026-05-11 12:17:03,622 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/n_kalman_delta_roll.png
2026-05-11 12:17:03,757 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/index.html
2026-05-11 12:17:03,758 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31494/info.json
2026-05-11 12:17:03,772 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31494/index.html
2026-05-11 12:17:03,772 main:
2026-05-11 12:17:03,772 main: ********************************************************************************
2026-05-11 12:17:03,772 main: Processing observation 31918
2026-05-11 12:17:03,772 main: ********************************************************************************
2026-05-11 12:17:03,774 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:17:03,775 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:17:05,603 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-11 12:17:06,448 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/centroid_resids.pkl with 5 slots
2026-05-11 12:17:06,505 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/centroid_resids_time.png
2026-05-11 12:17:06,784 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/centroid_resids_scatter.png
2026-05-11 12:17:07,534 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/n_kalman_delta_roll.png
2026-05-11 12:17:07,674 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/index.html
2026-05-11 12:17:07,676 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31918/info.json
2026-05-11 12:17:07,679 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31918/index.html
2026-05-11 12:17:07,680 main:
2026-05-11 12:17:07,680 main: ********************************************************************************
2026-05-11 12:17:07,680 main: Processing observation 31456
2026-05-11 12:17:07,680 main: ********************************************************************************
2026-05-11 12:17:07,693 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:17:07,695 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-11 12:17:09,517 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-11 12:17:09,824 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31456/centroid_resids.pkl with 5 slots
2026-05-11 12:17:09,868 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31456/centroid_resids_time.png
2026-05-11 12:17:10,124 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31456/centroid_resids_scatter.png
2026-05-11 12:17:10,942 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31456/n_kalman_delta_roll.png
2026-05-11 12:17:11,088 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31456/index.html
2026-05-11 12:17:11,090 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31456/info.json
2026-05-11 12:17:11,092 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31456/index.html
2026-05-11 12:17:11,093 main:
2026-05-11 12:17:11,093 main: ********************************************************************************
2026-05-11 12:17:11,093 main: Processing observation 30059
2026-05-11 12:17:11,093 main: ********************************************************************************
2026-05-11 12:17:11,106 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:17:11,107 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-11 12:17:12,920 __init__: ObsID 30059 has insufficient telemetry, skipping
2026-05-11 12:17:12,920 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/index.html
2026-05-11 12:17:12,932 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/info.json
2026-05-11 12:17:12,933 main:
2026-05-11 12:17:12,933 main: ********************************************************************************
2026-05-11 12:17:12,933 main: Processing observation 29939
2026-05-11 12:17:12,933 main: ********************************************************************************
2026-05-11 12:17:12,934 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:17:12,935 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-11 12:17:15,037 __init__: ObsID 29939 has no maneuver event in telemetry, skipping
2026-05-11 12:17:15,038 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/index.html
2026-05-11 12:17:15,042 info: could not get attribute kalman_start for obsid 29939
2026-05-11 12:17:15,042 info: could not get attribute kalman_stop for obsid 29939
2026-05-11 12:17:15,042 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/info.json
2026-05-11 12:17:15,043 main:
2026-05-11 12:17:15,043 main: ********************************************************************************
2026-05-11 12:17:15,043 main: Processing observation 30060
2026-05-11 12:17:15,043 main: ********************************************************************************
2026-05-11 12:17:15,043 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/info.json file found, obs=None
2026-05-11 12:17:15,045 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-11 12:17:15,046 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-11 12:17:17,155 __init__: ObsID 30060 has no maneuver event in telemetry, skipping
2026-05-11 12:17:17,155 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/index.html
2026-05-11 12:17:17,160 info: could not get attribute kalman_start for obsid 30060
2026-05-11 12:17:17,160 info: could not get attribute kalman_stop for obsid 30060
2026-05-11 12:17:17,160 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/info.json
2026-05-11 12:17:17,161 main:
2026-05-11 13:17:18,837 run_check: Starting centroid dashboard continuity check
2026-05-11 13:17:18,837 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-11 13:17:18,838 collect_observations: Processing year 2020
2026-05-11 13:17:20,625 collect_observations: Processing year 2021
2026-05-11 13:17:23,109 collect_observations: Processing year 2022
2026-05-11 13:17:26,071 collect_observations: Processing year 2023
2026-05-11 13:17:29,184 collect_observations: Processing year 2024
2026-05-11 13:17:32,027 collect_observations: Processing year 2025
2026-05-11 13:17:35,062 collect_observations: Processing year 2026
2026-05-11 13:17:35,959 collect_observations: Collected 13842 observations from 4-digit years
2026-05-11 13:17:35,963 sort_observations_by_date: Sorted observations by date
2026-05-11 13:17:35,963 check_continuity: Starting continuity check from most recent: ObsID 30060 (MAY1126A) at 2026:131:13:27:18.321
2026-05-11 13:17:35,981 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-11 13:17:35,981 check_continuity: Chain complete: visited 13842 observations out of 13842 total
2026-05-11 13:17:35,982 run_check: ✓ Observation chain continuity check PASSED
2026-05-11 13:17:35,982 run_check: Summary: 13842 observations from 4-digit years, all properly linked