Prev
Index
Next
centroid_dashboard: Sat Nov 29 13:17:44 2025
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Sat Nov 29 13:17:44 2025 |
No errors
File contents:
2025-11-29 13:16:11,908 main: Processing from 2025:326:18:16:11.907 to 2025:333:18:16:11.907
2025-11-29 13:16:20,046 get_observations: Found observation 29882 at 2025:326:21:45:21.714 with 1 manvrs
2025-11-29 13:16:20,047 get_observations: Found observation 30861 at 2025:327:02:24:45.408 with 1 manvrs
2025-11-29 13:16:20,047 get_observations: Found observation 31443 at 2025:327:06:06:30.034 with 1 manvrs
2025-11-29 13:16:20,048 get_observations: Found observation 30392 at 2025:327:08:17:33.365 with 1 manvrs
2025-11-29 13:16:20,048 get_observations: Found observation 41933 at 2025:327:18:39:24.124 with 1 manvrs
2025-11-29 13:16:20,049 get_observations: Found observation 41932 at 2025:327:21:28:45.329 with 1 manvrs
2025-11-29 13:16:20,049 get_observations: Found observation 41931 at 2025:328:01:55:40.252 with 1 manvrs
2025-11-29 13:16:20,050 get_observations: Found observation 41930 at 2025:328:03:55:40.252 with 1 manvrs
2025-11-29 13:16:20,050 get_observations: Found observation 31879 at 2025:328:06:28:34.322 with 1 manvrs
2025-11-29 13:16:20,051 get_observations: Found observation 30281 at 2025:328:11:11:10.941 with 1 manvrs
2025-11-29 13:16:20,051 get_observations: Found observation 29991 at 2025:328:14:34:17.856 with 1 manvrs
2025-11-29 13:16:20,051 get_observations: Found observation 32014 at 2025:329:00:20:52.753 with 1 manvrs
2025-11-29 13:16:20,052 get_observations: Found observation 32010 at 2025:329:03:43:56.344 with 1 manvrs
2025-11-29 13:16:20,052 get_observations: Found observation 32015 at 2025:329:07:57:04.427 with 1 manvrs
2025-11-29 13:16:20,053 get_observations: Found observation 41929 at 2025:329:11:04:38.594 with 1 manvrs
2025-11-29 13:16:20,053 get_observations: Found observation 32021 at 2025:329:12:02:48.568 with 1 manvrs
2025-11-29 13:16:20,054 get_observations: Found observation 30317 at 2025:329:16:45:33.663 with 1 manvrs
2025-11-29 13:16:20,054 get_observations: Found observation 30102 at 2025:329:20:24:42.923 with 1 manvrs
2025-11-29 13:16:20,054 get_observations: Found observation 32016 at 2025:330:06:09:28.063 with 1 manvrs
2025-11-29 13:16:20,055 get_observations: Found observation 41928 at 2025:330:09:47:13.631 with 1 manvrs
2025-11-29 13:16:20,055 get_observations: Found observation 41927 at 2025:330:17:15:40.252 with 1 manvrs
2025-11-29 13:16:20,056 get_observations: Found observation 41926 at 2025:330:21:25:40.252 with 1 manvrs
2025-11-29 13:16:20,056 get_observations: Found observation 30532 at 2025:330:23:24:40.315 with 1 manvrs
2025-11-29 13:16:20,057 get_observations: Found observation 31987 at 2025:331:11:35:05.215 with 1 manvrs
2025-11-29 13:16:20,057 get_observations: Found observation 41925 at 2025:331:14:54:55.522 with 1 manvrs
2025-11-29 13:16:20,057 get_observations: Found observation 30121 at 2025:331:15:58:19.044 with 1 manvrs
2025-11-29 13:16:20,058 get_observations: Found observation 30521 at 2025:331:19:23:52.041 with 1 manvrs
2025-11-29 13:16:20,058 get_observations: Found observation 32011 at 2025:331:23:31:02.866 with 1 manvrs
2025-11-29 13:16:20,059 get_observations: Found observation 31482 at 2025:332:02:41:45.836 with 1 manvrs
2025-11-29 13:16:20,059 get_observations: Found observation 32018 at 2025:332:08:46:46.345 with 1 manvrs
2025-11-29 13:16:20,060 get_observations: Found observation 32012 at 2025:332:12:56:58.050 with 1 manvrs
2025-11-29 13:16:20,060 get_observations: Found observation 41924 at 2025:332:16:11:29.925 with 1 manvrs
2025-11-29 13:16:20,060 get_observations: Found observation 32019 at 2025:332:17:05:16.419 with 1 manvrs
2025-11-29 13:16:20,061 get_observations: Found observation 31135 at 2025:332:21:09:40.567 with 1 manvrs
2025-11-29 13:16:20,061 get_observations: Found observation 41923 at 2025:333:01:44:19.634 with 1 manvrs
2025-11-29 13:16:20,062 get_observations: Found observation 41922 at 2025:333:03:25:55.788 with 1 manvrs
2025-11-29 13:16:20,063 get_observations: Found observation 41921 at 2025:333:05:47:40.252 with 1 manvrs
2025-11-29 13:16:20,063 get_observations: Found observation 41920 at 2025:333:10:09:23.423 with 1 manvrs
2025-11-29 13:16:20,064 get_observations: Found observation 41919 at 2025:333:11:16:45.925 with 1 manvrs
2025-11-29 13:16:20,064 get_observations: Found observation 30174 at 2025:333:13:15:05.693 with 1 manvrs
2025-11-29 13:16:20,064 get_observations: Found observation 32020 at 2025:333:17:54:39.121 with 1 manvrs
2025-11-29 13:16:20,065 main: Found 41 observations
2025-11-29 13:16:20,065 main: ********************************************************************************
2025-11-29 13:16:20,065 main: Processing observation 29882
2025-11-29 13:16:20,065 main: ********************************************************************************
2025-11-29 13:16:20,102 obs_link_from_info: Found prev obsid 32007
2025-11-29 13:16:20,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,125 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV1425A/last.html
2025-11-29 13:16:20,128 process_obs: ObsID 29882 already processed, skipping
2025-11-29 13:16:20,128 main:
2025-11-29 13:16:20,128 main: ********************************************************************************
2025-11-29 13:16:20,128 main: Processing observation 30861
2025-11-29 13:16:20,128 main: ********************************************************************************
2025-11-29 13:16:20,129 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,130 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV1425A/last.html
2025-11-29 13:16:20,140 process_obs: ObsID 30861 already processed, skipping
2025-11-29 13:16:20,140 main:
2025-11-29 13:16:20,140 main: ********************************************************************************
2025-11-29 13:16:20,140 main: Processing observation 31443
2025-11-29 13:16:20,140 main: ********************************************************************************
2025-11-29 13:16:20,141 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,142 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV1425A/last.html
2025-11-29 13:16:20,160 process_obs: ObsID 31443 already processed, skipping
2025-11-29 13:16:20,160 main:
2025-11-29 13:16:20,160 main: ********************************************************************************
2025-11-29 13:16:20,160 main: Processing observation 30392
2025-11-29 13:16:20,160 main: ********************************************************************************
2025-11-29 13:16:20,161 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,162 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV1425A/last.html
2025-11-29 13:16:20,175 process_obs: ObsID 30392 already processed, skipping
2025-11-29 13:16:20,175 main:
2025-11-29 13:16:20,175 main: ********************************************************************************
2025-11-29 13:16:20,175 main: Processing observation 41933
2025-11-29 13:16:20,175 main: ********************************************************************************
2025-11-29 13:16:20,176 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,177 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV1425A/last.html
2025-11-29 13:16:20,186 process_obs: ObsID 41933 already processed, skipping
2025-11-29 13:16:20,186 main:
2025-11-29 13:16:20,186 main: ********************************************************************************
2025-11-29 13:16:20,186 main: Processing observation 41932
2025-11-29 13:16:20,186 main: ********************************************************************************
2025-11-29 13:16:20,187 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,188 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,204 process_obs: ObsID 41932 already processed, skipping
2025-11-29 13:16:20,204 main:
2025-11-29 13:16:20,204 main: ********************************************************************************
2025-11-29 13:16:20,204 main: Processing observation 41931
2025-11-29 13:16:20,204 main: ********************************************************************************
2025-11-29 13:16:20,205 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,206 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,218 process_obs: ObsID 41931 already processed, skipping
2025-11-29 13:16:20,219 main:
2025-11-29 13:16:20,219 main: ********************************************************************************
2025-11-29 13:16:20,219 main: Processing observation 41930
2025-11-29 13:16:20,219 main: ********************************************************************************
2025-11-29 13:16:20,220 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,221 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,233 process_obs: ObsID 41930 already processed, skipping
2025-11-29 13:16:20,233 main:
2025-11-29 13:16:20,233 main: ********************************************************************************
2025-11-29 13:16:20,233 main: Processing observation 31879
2025-11-29 13:16:20,233 main: ********************************************************************************
2025-11-29 13:16:20,234 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,235 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,251 process_obs: ObsID 31879 already processed, skipping
2025-11-29 13:16:20,251 main:
2025-11-29 13:16:20,251 main: ********************************************************************************
2025-11-29 13:16:20,251 main: Processing observation 30281
2025-11-29 13:16:20,251 main: ********************************************************************************
2025-11-29 13:16:20,252 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,253 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,268 process_obs: ObsID 30281 already processed, skipping
2025-11-29 13:16:20,268 main:
2025-11-29 13:16:20,268 main: ********************************************************************************
2025-11-29 13:16:20,268 main: Processing observation 29991
2025-11-29 13:16:20,268 main: ********************************************************************************
2025-11-29 13:16:20,269 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,270 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,285 process_obs: ObsID 29991 already processed, skipping
2025-11-29 13:16:20,286 main:
2025-11-29 13:16:20,286 main: ********************************************************************************
2025-11-29 13:16:20,286 main: Processing observation 32014
2025-11-29 13:16:20,286 main: ********************************************************************************
2025-11-29 13:16:20,287 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,288 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,294 process_obs: ObsID 32014 already processed, skipping
2025-11-29 13:16:20,294 main:
2025-11-29 13:16:20,294 main: ********************************************************************************
2025-11-29 13:16:20,294 main: Processing observation 32010
2025-11-29 13:16:20,294 main: ********************************************************************************
2025-11-29 13:16:20,295 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,296 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,311 process_obs: ObsID 32010 already processed, skipping
2025-11-29 13:16:20,311 main:
2025-11-29 13:16:20,311 main: ********************************************************************************
2025-11-29 13:16:20,311 main: Processing observation 32015
2025-11-29 13:16:20,311 main: ********************************************************************************
2025-11-29 13:16:20,312 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,313 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,328 process_obs: ObsID 32015 already processed, skipping
2025-11-29 13:16:20,328 main:
2025-11-29 13:16:20,328 main: ********************************************************************************
2025-11-29 13:16:20,328 main: Processing observation 41929
2025-11-29 13:16:20,328 main: ********************************************************************************
2025-11-29 13:16:20,329 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,330 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,340 process_obs: ObsID 41929 already processed, skipping
2025-11-29 13:16:20,340 main:
2025-11-29 13:16:20,340 main: ********************************************************************************
2025-11-29 13:16:20,340 main: Processing observation 32021
2025-11-29 13:16:20,340 main: ********************************************************************************
2025-11-29 13:16:20,341 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,342 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,358 process_obs: ObsID 32021 already processed, skipping
2025-11-29 13:16:20,358 main:
2025-11-29 13:16:20,358 main: ********************************************************************************
2025-11-29 13:16:20,358 main: Processing observation 30317
2025-11-29 13:16:20,358 main: ********************************************************************************
2025-11-29 13:16:20,359 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,360 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,373 process_obs: ObsID 30317 already processed, skipping
2025-11-29 13:16:20,373 main:
2025-11-29 13:16:20,373 main: ********************************************************************************
2025-11-29 13:16:20,373 main: Processing observation 30102
2025-11-29 13:16:20,373 main: ********************************************************************************
2025-11-29 13:16:20,374 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,375 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,386 process_obs: ObsID 30102 already processed, skipping
2025-11-29 13:16:20,386 main:
2025-11-29 13:16:20,386 main: ********************************************************************************
2025-11-29 13:16:20,386 main: Processing observation 32016
2025-11-29 13:16:20,386 main: ********************************************************************************
2025-11-29 13:16:20,387 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,388 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,404 process_obs: ObsID 32016 already processed, skipping
2025-11-29 13:16:20,404 main:
2025-11-29 13:16:20,404 main: ********************************************************************************
2025-11-29 13:16:20,404 main: Processing observation 41928
2025-11-29 13:16:20,404 main: ********************************************************************************
2025-11-29 13:16:20,405 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,406 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,420 process_obs: ObsID 41928 already processed, skipping
2025-11-29 13:16:20,420 main:
2025-11-29 13:16:20,420 main: ********************************************************************************
2025-11-29 13:16:20,420 main: Processing observation 41927
2025-11-29 13:16:20,420 main: ********************************************************************************
2025-11-29 13:16:20,421 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,422 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,442 process_obs: ObsID 41927 already processed, skipping
2025-11-29 13:16:20,442 main:
2025-11-29 13:16:20,442 main: ********************************************************************************
2025-11-29 13:16:20,442 main: Processing observation 41926
2025-11-29 13:16:20,442 main: ********************************************************************************
2025-11-29 13:16:20,443 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,444 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 13:16:20,464 process_obs: ObsID 41926 already processed, skipping
2025-11-29 13:16:20,464 main:
2025-11-29 13:16:20,464 main: ********************************************************************************
2025-11-29 13:16:20,464 main: Processing observation 30532
2025-11-29 13:16:20,464 main: ********************************************************************************
2025-11-29 13:16:20,465 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 13:16:20,466 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:16:23,311 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30532/centroid_resids.pkl
2025-11-29 12:16:24,301 write_centroid_resids: Centroid residuals file exists, skipping
2025-11-29 12:16:24,301 plot_crs_time: Plot file exists, skipping
2025-11-29 12:16:24,303 plot_crs_scatter: Plot file exists, skipping
2025-11-29 12:16:24,627 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-11-29 12:16:25,203 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30532/n_kalman_delta_roll.png
2025-11-29 12:16:33,389 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30532/index.html
2025-11-29 12:16:33,391 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30532/info.json
2025-11-29 12:16:33,392 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30532/index.html
2025-11-29 12:16:33,393 main:
2025-11-29 12:16:33,393 main: ********************************************************************************
2025-11-29 12:16:33,393 main: Processing observation 31987
2025-11-29 12:16:33,394 main: ********************************************************************************
2025-11-29 12:16:33,395 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:16:33,396 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:16:38,225 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31987/centroid_resids.pkl
2025-11-29 12:16:38,546 write_centroid_resids: Centroid residuals file exists, skipping
2025-11-29 12:16:38,546 plot_crs_time: Plot file exists, skipping
2025-11-29 12:16:38,546 plot_crs_scatter: Plot file exists, skipping
2025-11-29 12:16:38,570 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-11-29 12:16:38,726 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31987/n_kalman_delta_roll.png
2025-11-29 12:16:38,858 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31987/index.html
2025-11-29 12:16:38,860 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31987/info.json
2025-11-29 12:16:38,861 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31987/index.html
2025-11-29 12:16:38,862 main:
2025-11-29 12:16:38,863 main: ********************************************************************************
2025-11-29 12:16:38,863 main: Processing observation 41925
2025-11-29 12:16:38,863 main: ********************************************************************************
2025-11-29 12:16:38,864 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:16:38,865 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:16:38,880 process_obs: ObsID 41925 already processed, skipping
2025-11-29 12:16:38,880 main:
2025-11-29 12:16:38,880 main: ********************************************************************************
2025-11-29 12:16:38,880 main: Processing observation 30121
2025-11-29 12:16:38,880 main: ********************************************************************************
2025-11-29 12:16:38,881 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:16:38,882 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:16:38,897 process_obs: ObsID 30121 already processed, skipping
2025-11-29 12:16:38,897 main:
2025-11-29 12:16:38,897 main: ********************************************************************************
2025-11-29 12:16:38,897 main: Processing observation 30521
2025-11-29 12:16:38,897 main: ********************************************************************************
2025-11-29 12:16:38,898 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:16:38,899 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:16:41,816 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30521/centroid_resids.pkl
2025-11-29 12:16:42,352 write_centroid_resids: Centroid residuals file exists, skipping
2025-11-29 12:16:42,352 plot_crs_time: Plot file exists, skipping
2025-11-29 12:16:42,354 plot_crs_scatter: Plot file exists, skipping
2025-11-29 12:16:43,732 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30521/n_kalman_delta_roll.png
2025-11-29 12:16:50,246 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30521/index.html
2025-11-29 12:16:50,266 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30521/info.json
2025-11-29 12:16:50,310 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30521/index.html
2025-11-29 12:16:50,350 main:
2025-11-29 12:16:50,350 main: ********************************************************************************
2025-11-29 12:16:50,350 main: Processing observation 32011
2025-11-29 12:16:50,350 main: ********************************************************************************
2025-11-29 12:16:50,354 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:16:50,374 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:16:54,398 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32011/centroid_resids.pkl with 5 slots
2025-11-29 12:16:54,446 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32011/centroid_resids_time.png
2025-11-29 12:16:55,260 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32011/centroid_resids_scatter.png
2025-11-29 12:16:56,421 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32011/n_kalman_delta_roll.png
2025-11-29 12:16:56,577 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32011/index.html
2025-11-29 12:16:56,579 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32011/info.json
2025-11-29 12:16:56,594 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32011/index.html
2025-11-29 12:16:56,595 main:
2025-11-29 12:16:56,595 main: ********************************************************************************
2025-11-29 12:16:56,595 main: Processing observation 31482
2025-11-29 12:16:56,595 main: ********************************************************************************
2025-11-29 12:16:56,596 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:16:56,597 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:16:59,895 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31482/centroid_resids.pkl with 5 slots
2025-11-29 12:16:59,949 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31482/centroid_resids_time.png
2025-11-29 12:17:00,266 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31482/centroid_resids_scatter.png
2025-11-29 12:17:01,233 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31482/n_kalman_delta_roll.png
2025-11-29 12:17:01,435 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31482/index.html
2025-11-29 12:17:01,438 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31482/info.json
2025-11-29 12:17:01,440 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31482/index.html
2025-11-29 12:17:01,443 main:
2025-11-29 12:17:01,443 main: ********************************************************************************
2025-11-29 12:17:01,443 main: Processing observation 32018
2025-11-29 12:17:01,443 main: ********************************************************************************
2025-11-29 12:17:01,444 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:01,447 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:05,803 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32018/centroid_resids.pkl with 5 slots
2025-11-29 12:17:05,868 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32018/centroid_resids_time.png
2025-11-29 12:17:06,270 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32018/centroid_resids_scatter.png
2025-11-29 12:17:07,529 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32018/n_kalman_delta_roll.png
2025-11-29 12:17:07,820 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32018/index.html
2025-11-29 12:17:07,830 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32018/info.json
2025-11-29 12:17:07,838 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32018/index.html
2025-11-29 12:17:07,846 main:
2025-11-29 12:17:07,846 main: ********************************************************************************
2025-11-29 12:17:07,846 main: Processing observation 32012
2025-11-29 12:17:07,846 main: ********************************************************************************
2025-11-29 12:17:07,849 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:07,853 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:11,387 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32012/centroid_resids.pkl with 5 slots
2025-11-29 12:17:11,434 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32012/centroid_resids_time.png
2025-11-29 12:17:11,896 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32012/centroid_resids_scatter.png
2025-11-29 12:17:12,596 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32012/n_kalman_delta_roll.png
2025-11-29 12:17:12,763 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32012/index.html
2025-11-29 12:17:12,770 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32012/info.json
2025-11-29 12:17:12,772 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32012/index.html
2025-11-29 12:17:12,773 main:
2025-11-29 12:17:12,773 main: ********************************************************************************
2025-11-29 12:17:12,773 main: Processing observation 41924
2025-11-29 12:17:12,773 main: ********************************************************************************
2025-11-29 12:17:12,774 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:12,775 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:16,413 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41924/centroid_resids.pkl with 8 slots
2025-11-29 12:17:16,480 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41924/centroid_resids_time.png
2025-11-29 12:17:16,759 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41924/centroid_resids_scatter.png
2025-11-29 12:17:16,839 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-11-29 12:17:16,963 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41924/n_kalman_delta_roll.png
2025-11-29 12:17:17,102 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41924/index.html
2025-11-29 12:17:17,104 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41924/info.json
2025-11-29 12:17:17,113 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41924/index.html
2025-11-29 12:17:17,114 main:
2025-11-29 12:17:17,114 main: ********************************************************************************
2025-11-29 12:17:17,114 main: Processing observation 32019
2025-11-29 12:17:17,114 main: ********************************************************************************
2025-11-29 12:17:17,115 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:17,117 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:20,374 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32019/centroid_resids.pkl with 5 slots
2025-11-29 12:17:20,424 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32019/centroid_resids_time.png
2025-11-29 12:17:20,972 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32019/centroid_resids_scatter.png
2025-11-29 12:17:21,090 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-11-29 12:17:21,257 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32019/n_kalman_delta_roll.png
2025-11-29 12:17:21,416 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32019/index.html
2025-11-29 12:17:21,426 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32019/info.json
2025-11-29 12:17:21,428 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32019/index.html
2025-11-29 12:17:21,429 main:
2025-11-29 12:17:21,429 main: ********************************************************************************
2025-11-29 12:17:21,429 main: Processing observation 31135
2025-11-29 12:17:21,429 main: ********************************************************************************
2025-11-29 12:17:21,430 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:21,431 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:24,522 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31135/centroid_resids.pkl with 5 slots
2025-11-29 12:17:24,570 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31135/centroid_resids_time.png
2025-11-29 12:17:24,843 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31135/centroid_resids_scatter.png
2025-11-29 12:17:25,197 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-11-29 12:17:25,313 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31135/n_kalman_delta_roll.png
2025-11-29 12:17:25,442 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31135/index.html
2025-11-29 12:17:25,445 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/31135/info.json
2025-11-29 12:17:25,458 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31135/index.html
2025-11-29 12:17:25,459 main:
2025-11-29 12:17:25,459 main: ********************************************************************************
2025-11-29 12:17:25,459 main: Processing observation 41923
2025-11-29 12:17:25,459 main: ********************************************************************************
2025-11-29 12:17:25,461 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:25,462 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:28,008 __init__: ObsID 41923 has insufficient telemetry, skipping
2025-11-29 12:17:28,014 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41923/index.html
2025-11-29 12:17:28,026 main:
2025-11-29 12:17:28,026 main: ********************************************************************************
2025-11-29 12:17:28,026 main: Processing observation 41922
2025-11-29 12:17:28,026 main: ********************************************************************************
2025-11-29 12:17:28,046 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:28,069 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:30,650 __init__: ObsID 41922 has insufficient telemetry, skipping
2025-11-29 12:17:30,650 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41922/index.html
2025-11-29 12:17:30,653 main:
2025-11-29 12:17:30,653 main: ********************************************************************************
2025-11-29 12:17:30,653 main: Processing observation 41921
2025-11-29 12:17:30,653 main: ********************************************************************************
2025-11-29 12:17:30,657 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:30,660 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:33,330 __init__: ObsID 41921 has insufficient telemetry, skipping
2025-11-29 12:17:33,332 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41921/index.html
2025-11-29 12:17:33,338 main:
2025-11-29 12:17:33,338 main: ********************************************************************************
2025-11-29 12:17:33,338 main: Processing observation 41920
2025-11-29 12:17:33,338 main: ********************************************************************************
2025-11-29 12:17:33,366 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:33,398 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:36,055 __init__: ObsID 41920 has insufficient telemetry, skipping
2025-11-29 12:17:36,059 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41920/index.html
2025-11-29 12:17:36,074 main:
2025-11-29 12:17:36,074 main: ********************************************************************************
2025-11-29 12:17:36,074 main: Processing observation 41919
2025-11-29 12:17:36,074 main: ********************************************************************************
2025-11-29 12:17:36,082 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:36,106 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:38,670 __init__: ObsID 41919 has no maneuver event in telemetry, skipping
2025-11-29 12:17:38,671 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/41919/index.html
2025-11-29 12:17:38,674 main:
2025-11-29 12:17:38,674 main: ********************************************************************************
2025-11-29 12:17:38,674 main: Processing observation 30174
2025-11-29 12:17:38,674 main: ********************************************************************************
2025-11-29 12:17:38,675 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:38,677 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:41,154 __init__: ObsID 30174 has no maneuver event in telemetry, skipping
2025-11-29 12:17:41,155 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/30174/index.html
2025-11-29 12:17:41,156 main:
2025-11-29 12:17:41,156 main: ********************************************************************************
2025-11-29 12:17:41,156 main: Processing observation 32020
2025-11-29 12:17:41,156 main: ********************************************************************************
2025-11-29 12:17:41,170 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32020/info.json file found, obs=None
2025-11-29 12:17:41,171 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-11-29 12:17:41,172 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-11-29 12:17:43,894 __init__: ObsID 32020 has no maneuver event in telemetry, skipping
2025-11-29 12:17:43,895 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/32020/index.html
2025-11-29 12:17:43,901 main: