Prev
Index
Next
centroid_dashboard: Sun May 3 13:20:20 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Sun May 3 13:20:20 2026 |
No errors
File contents:
2026-05-03 13:16:19,847 main: Processing from 2026:116:17:16:19.846 to 2026:123:17:16:19.846
2026-05-03 13:16:32,398 get_observations: Found observation 32316 at 2026:116:22:28:40.593 with 1 manvrs
2026-05-03 13:16:32,398 get_observations: Found observation 30228 at 2026:117:01:55:38.939 with 1 manvrs
2026-05-03 13:16:32,399 get_observations: Found observation 30189 at 2026:117:05:58:23.023 with 1 manvrs
2026-05-03 13:16:32,399 get_observations: Found observation 32321 at 2026:117:09:52:53.399 with 1 manvrs
2026-05-03 13:16:32,400 get_observations: Found observation 30199 at 2026:117:15:35:45.774 with 1 manvrs
2026-05-03 13:16:32,400 get_observations: Found observation 30046 at 2026:117:20:36:56.590 with 1 manvrs
2026-05-03 13:16:32,401 get_observations: Found observation 32320 at 2026:118:03:28:14.369 with 1 manvrs
2026-05-03 13:16:32,401 get_observations: Found observation 32319 at 2026:118:08:23:07.028 with 1 manvrs
2026-05-03 13:16:32,401 get_observations: Found observation 29883 at 2026:118:15:21:04.757 with 1 manvrs
2026-05-03 13:16:32,402 get_observations: Found observation 41528 at 2026:118:18:50:19.464 with 1 manvrs
2026-05-03 13:16:32,402 get_observations: Found observation 41527 at 2026:118:20:55:40.252 with 1 manvrs
2026-05-03 13:16:32,403 get_observations: Found observation 41526 at 2026:118:23:55:40.252 with 1 manvrs
2026-05-03 13:16:32,403 get_observations: Found observation 41525 at 2026:119:01:55:40.252 with 1 manvrs
2026-05-03 13:16:32,403 get_observations: Found observation 41524 at 2026:119:03:55:40.252 with 1 manvrs
2026-05-03 13:16:32,404 get_observations: Found observation 41523 at 2026:119:05:55:40.252 with 1 manvrs
2026-05-03 13:16:32,404 get_observations: Found observation 31877 at 2026:119:07:27:52.176 with 1 manvrs
2026-05-03 13:16:32,405 get_observations: Found observation 31106 at 2026:119:11:50:14.616 with 1 manvrs
2026-05-03 13:16:32,405 get_observations: Found observation 31735 at 2026:120:04:56:27.922 with 1 manvrs
2026-05-03 13:16:32,405 get_observations: Found observation 32317 at 2026:120:13:44:14.591 with 1 manvrs
2026-05-03 13:16:32,406 get_observations: Found observation 30070 at 2026:120:17:50:58.106 with 1 manvrs
2026-05-03 13:16:32,406 get_observations: Found observation 32318 at 2026:121:05:38:02.108 with 1 manvrs
2026-05-03 13:16:32,407 get_observations: Found observation 41522 at 2026:121:11:17:26.474 with 1 manvrs
2026-05-03 13:16:32,407 get_observations: Found observation 41521 at 2026:121:13:55:40.252 with 1 manvrs
2026-05-03 13:16:32,408 get_observations: Found observation 41520 at 2026:121:15:55:40.252 with 1 manvrs
2026-05-03 13:16:32,408 get_observations: Found observation 41519 at 2026:121:17:55:40.252 with 1 manvrs
2026-05-03 13:16:32,408 get_observations: Found observation 41518 at 2026:121:19:10:40.252 with 1 manvrs
2026-05-03 13:16:32,409 get_observations: Found observation 41517 at 2026:121:20:45:40.252 with 1 manvrs
2026-05-03 13:16:32,409 get_observations: Found observation 32322 at 2026:121:22:25:41.491 with 1 manvrs
2026-05-03 13:16:32,410 get_observations: Found observation 26961 at 2026:122:02:57:58.117 with 1 manvrs
2026-05-03 13:16:32,410 get_observations: Found observation 31627 at 2026:122:18:07:50.491 with 1 manvrs
2026-05-03 13:16:32,410 get_observations: Found observation 32323 at 2026:123:03:38:55.561 with 1 manvrs
2026-05-03 13:16:32,411 get_observations: Found observation 31736 at 2026:123:07:48:08.429 with 1 manvrs
2026-05-03 13:16:32,411 main: Found 32 observations
2026-05-03 13:16:32,411 main: ********************************************************************************
2026-05-03 13:16:32,411 main: Processing observation 32316
2026-05-03 13:16:32,411 main: ********************************************************************************
2026-05-03 13:16:32,461 obs_link_from_info: Found prev obsid 32308
2026-05-03 13:16:32,489 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,506 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-05-03 13:16:32,539 process_obs: ObsID 32316 already processed, skipping
2026-05-03 13:16:32,539 main:
2026-05-03 13:16:32,539 main: ********************************************************************************
2026-05-03 13:16:32,539 main: Processing observation 30228
2026-05-03 13:16:32,539 main: ********************************************************************************
2026-05-03 13:16:32,552 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,560 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,604 process_obs: ObsID 30228 already processed, skipping
2026-05-03 13:16:32,604 main:
2026-05-03 13:16:32,604 main: ********************************************************************************
2026-05-03 13:16:32,604 main: Processing observation 30189
2026-05-03 13:16:32,604 main: ********************************************************************************
2026-05-03 13:16:32,616 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,618 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,638 process_obs: ObsID 30189 already processed, skipping
2026-05-03 13:16:32,638 main:
2026-05-03 13:16:32,638 main: ********************************************************************************
2026-05-03 13:16:32,638 main: Processing observation 32321
2026-05-03 13:16:32,638 main: ********************************************************************************
2026-05-03 13:16:32,640 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,647 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,678 process_obs: ObsID 32321 already processed, skipping
2026-05-03 13:16:32,678 main:
2026-05-03 13:16:32,678 main: ********************************************************************************
2026-05-03 13:16:32,678 main: Processing observation 30199
2026-05-03 13:16:32,679 main: ********************************************************************************
2026-05-03 13:16:32,690 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,700 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,721 process_obs: ObsID 30199 already processed, skipping
2026-05-03 13:16:32,721 main:
2026-05-03 13:16:32,721 main: ********************************************************************************
2026-05-03 13:16:32,721 main: Processing observation 30046
2026-05-03 13:16:32,721 main: ********************************************************************************
2026-05-03 13:16:32,724 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,730 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,761 process_obs: ObsID 30046 already processed, skipping
2026-05-03 13:16:32,761 main:
2026-05-03 13:16:32,761 main: ********************************************************************************
2026-05-03 13:16:32,761 main: Processing observation 32320
2026-05-03 13:16:32,761 main: ********************************************************************************
2026-05-03 13:16:32,772 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,780 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,794 process_obs: ObsID 32320 already processed, skipping
2026-05-03 13:16:32,794 main:
2026-05-03 13:16:32,794 main: ********************************************************************************
2026-05-03 13:16:32,794 main: Processing observation 32319
2026-05-03 13:16:32,794 main: ********************************************************************************
2026-05-03 13:16:32,796 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,799 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,805 process_obs: ObsID 32319 already processed, skipping
2026-05-03 13:16:32,805 main:
2026-05-03 13:16:32,805 main: ********************************************************************************
2026-05-03 13:16:32,805 main: Processing observation 29883
2026-05-03 13:16:32,805 main: ********************************************************************************
2026-05-03 13:16:32,806 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,807 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,817 process_obs: ObsID 29883 already processed, skipping
2026-05-03 13:16:32,817 main:
2026-05-03 13:16:32,817 main: ********************************************************************************
2026-05-03 13:16:32,817 main: Processing observation 41528
2026-05-03 13:16:32,817 main: ********************************************************************************
2026-05-03 13:16:32,820 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,828 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,876 process_obs: ObsID 41528 already processed, skipping
2026-05-03 13:16:32,876 main:
2026-05-03 13:16:32,876 main: ********************************************************************************
2026-05-03 13:16:32,876 main: Processing observation 41527
2026-05-03 13:16:32,876 main: ********************************************************************************
2026-05-03 13:16:32,881 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,883 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,946 process_obs: ObsID 41527 already processed, skipping
2026-05-03 13:16:32,946 main:
2026-05-03 13:16:32,946 main: ********************************************************************************
2026-05-03 13:16:32,946 main: Processing observation 41526
2026-05-03 13:16:32,946 main: ********************************************************************************
2026-05-03 13:16:32,947 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,949 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,959 process_obs: ObsID 41526 already processed, skipping
2026-05-03 13:16:32,959 main:
2026-05-03 13:16:32,959 main: ********************************************************************************
2026-05-03 13:16:32,959 main: Processing observation 41525
2026-05-03 13:16:32,959 main: ********************************************************************************
2026-05-03 13:16:32,960 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:32,969 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:32,996 process_obs: ObsID 41525 already processed, skipping
2026-05-03 13:16:32,996 main:
2026-05-03 13:16:32,996 main: ********************************************************************************
2026-05-03 13:16:32,996 main: Processing observation 41524
2026-05-03 13:16:32,996 main: ********************************************************************************
2026-05-03 13:16:33,011 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,016 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:33,025 process_obs: ObsID 41524 already processed, skipping
2026-05-03 13:16:33,025 main:
2026-05-03 13:16:33,025 main: ********************************************************************************
2026-05-03 13:16:33,025 main: Processing observation 41523
2026-05-03 13:16:33,025 main: ********************************************************************************
2026-05-03 13:16:33,028 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,031 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:33,040 process_obs: ObsID 41523 already processed, skipping
2026-05-03 13:16:33,040 main:
2026-05-03 13:16:33,040 main: ********************************************************************************
2026-05-03 13:16:33,040 main: Processing observation 31877
2026-05-03 13:16:33,040 main: ********************************************************************************
2026-05-03 13:16:33,044 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,048 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:33,069 process_obs: ObsID 31877 already processed, skipping
2026-05-03 13:16:33,069 main:
2026-05-03 13:16:33,069 main: ********************************************************************************
2026-05-03 13:16:33,069 main: Processing observation 31106
2026-05-03 13:16:33,069 main: ********************************************************************************
2026-05-03 13:16:33,071 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,073 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:33,116 process_obs: ObsID 31106 already processed, skipping
2026-05-03 13:16:33,116 main:
2026-05-03 13:16:33,116 main: ********************************************************************************
2026-05-03 13:16:33,116 main: Processing observation 31735
2026-05-03 13:16:33,116 main: ********************************************************************************
2026-05-03 13:16:33,118 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,121 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:33,135 process_obs: ObsID 31735 already processed, skipping
2026-05-03 13:16:33,135 main:
2026-05-03 13:16:33,135 main: ********************************************************************************
2026-05-03 13:16:33,135 main: Processing observation 32317
2026-05-03 13:16:33,135 main: ********************************************************************************
2026-05-03 13:16:33,137 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,140 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:33,172 process_obs: ObsID 32317 already processed, skipping
2026-05-03 13:16:33,172 main:
2026-05-03 13:16:33,172 main: ********************************************************************************
2026-05-03 13:16:33,172 main: Processing observation 30070
2026-05-03 13:16:33,172 main: ********************************************************************************
2026-05-03 13:16:33,180 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,182 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 13:16:33,220 process_obs: ObsID 30070 already processed, skipping
2026-05-03 13:16:33,220 main:
2026-05-03 13:16:33,220 main: ********************************************************************************
2026-05-03 13:16:33,220 main: Processing observation 32318
2026-05-03 13:16:33,220 main: ********************************************************************************
2026-05-03 13:16:33,223 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 13:16:33,225 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:16:37,308 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:16:38,168 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32318/centroid_resids.pkl with 5 slots
2026-05-03 12:16:38,241 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32318/centroid_resids_time.png
2026-05-03 12:16:39,028 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32318/centroid_resids_scatter.png
2026-05-03 12:16:40,767 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32318/n_kalman_delta_roll.png
2026-05-03 12:16:44,223 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32318/index.html
2026-05-03 12:16:44,225 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32318/info.json
2026-05-03 12:16:44,249 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32318/index.html
2026-05-03 12:16:44,250 main:
2026-05-03 12:16:44,250 main: ********************************************************************************
2026-05-03 12:16:44,250 main: Processing observation 41522
2026-05-03 12:16:44,250 main: ********************************************************************************
2026-05-03 12:16:44,251 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:16:44,252 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:16:46,672 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:16:47,247 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41522/centroid_resids.pkl with 8 slots
2026-05-03 12:16:47,316 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41522/centroid_resids_time.png
2026-05-03 12:16:47,664 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41522/centroid_resids_scatter.png
2026-05-03 12:16:47,974 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-03 12:16:48,112 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41522/n_kalman_delta_roll.png
2026-05-03 12:16:48,263 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41522/index.html
2026-05-03 12:16:48,265 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41522/info.json
2026-05-03 12:16:48,282 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41522/index.html
2026-05-03 12:16:48,283 main:
2026-05-03 12:16:48,283 main: ********************************************************************************
2026-05-03 12:16:48,283 main: Processing observation 41521
2026-05-03 12:16:48,283 main: ********************************************************************************
2026-05-03 12:16:48,285 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:16:48,286 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:16:50,596 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:16:51,444 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41521/centroid_resids.pkl with 8 slots
2026-05-03 12:16:51,514 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41521/centroid_resids_time.png
2026-05-03 12:16:51,825 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41521/centroid_resids_scatter.png
2026-05-03 12:16:51,916 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-03 12:16:52,027 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41521/n_kalman_delta_roll.png
2026-05-03 12:16:52,181 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41521/index.html
2026-05-03 12:16:52,183 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41521/info.json
2026-05-03 12:16:52,187 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41521/index.html
2026-05-03 12:16:52,189 main:
2026-05-03 12:16:52,189 main: ********************************************************************************
2026-05-03 12:16:52,189 main: Processing observation 41520
2026-05-03 12:16:52,189 main: ********************************************************************************
2026-05-03 12:16:52,190 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:16:52,192 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:16:54,695 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:16:55,445 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41520/centroid_resids.pkl with 8 slots
2026-05-03 12:16:55,513 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41520/centroid_resids_time.png
2026-05-03 12:16:55,830 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41520/centroid_resids_scatter.png
2026-05-03 12:16:55,923 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-03 12:16:56,042 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41520/n_kalman_delta_roll.png
2026-05-03 12:16:56,218 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41520/index.html
2026-05-03 12:16:56,219 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41520/info.json
2026-05-03 12:16:56,223 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41520/index.html
2026-05-03 12:16:56,224 main:
2026-05-03 12:16:56,224 main: ********************************************************************************
2026-05-03 12:16:56,224 main: Processing observation 41519
2026-05-03 12:16:56,224 main: ********************************************************************************
2026-05-03 12:16:56,226 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:16:56,227 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:16:58,633 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:16:59,519 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41519/centroid_resids.pkl with 8 slots
2026-05-03 12:16:59,583 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41519/centroid_resids_time.png
2026-05-03 12:16:59,864 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41519/centroid_resids_scatter.png
2026-05-03 12:16:59,936 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-03 12:17:00,091 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41519/n_kalman_delta_roll.png
2026-05-03 12:17:00,244 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41519/index.html
2026-05-03 12:17:00,246 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41519/info.json
2026-05-03 12:17:00,248 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41519/index.html
2026-05-03 12:17:00,249 main:
2026-05-03 12:17:00,249 main: ********************************************************************************
2026-05-03 12:17:00,249 main: Processing observation 41518
2026-05-03 12:17:00,249 main: ********************************************************************************
2026-05-03 12:17:00,250 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:17:00,252 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:17:02,910 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:17:03,396 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41518/centroid_resids.pkl with 8 slots
2026-05-03 12:17:03,475 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41518/centroid_resids_time.png
2026-05-03 12:17:03,859 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41518/centroid_resids_scatter.png
2026-05-03 12:17:03,942 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-03 12:17:04,112 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41518/n_kalman_delta_roll.png
2026-05-03 12:17:04,291 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41518/index.html
2026-05-03 12:17:04,293 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41518/info.json
2026-05-03 12:17:04,296 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41518/index.html
2026-05-03 12:17:04,297 main:
2026-05-03 12:17:04,297 main: ********************************************************************************
2026-05-03 12:17:04,297 main: Processing observation 41517
2026-05-03 12:17:04,297 main: ********************************************************************************
2026-05-03 12:17:04,298 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:17:04,299 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:17:06,618 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:17:07,390 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41517/centroid_resids.pkl with 8 slots
2026-05-03 12:17:07,454 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41517/centroid_resids_time.png
2026-05-03 12:17:07,795 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41517/centroid_resids_scatter.png
2026-05-03 12:17:07,883 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-03 12:17:08,338 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41517/n_kalman_delta_roll.png
2026-05-03 12:17:08,505 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41517/index.html
2026-05-03 12:17:08,507 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41517/info.json
2026-05-03 12:17:08,509 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41517/index.html
2026-05-03 12:17:08,510 main:
2026-05-03 12:17:08,510 main: ********************************************************************************
2026-05-03 12:17:08,510 main: Processing observation 32322
2026-05-03 12:17:08,510 main: ********************************************************************************
2026-05-03 12:17:08,511 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:17:08,512 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:17:10,597 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:17:10,939 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32322/centroid_resids.pkl with 5 slots
2026-05-03 12:17:10,990 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32322/centroid_resids_time.png
2026-05-03 12:17:11,257 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32322/centroid_resids_scatter.png
2026-05-03 12:17:12,241 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32322/n_kalman_delta_roll.png
2026-05-03 12:17:12,413 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32322/index.html
2026-05-03 12:17:12,415 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32322/info.json
2026-05-03 12:17:12,417 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32322/index.html
2026-05-03 12:17:12,418 main:
2026-05-03 12:17:12,418 main: ********************************************************************************
2026-05-03 12:17:12,418 main: Processing observation 26961
2026-05-03 12:17:12,418 main: ********************************************************************************
2026-05-03 12:17:12,419 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:17:12,420 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:17:14,558 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-03 12:17:15,447 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/centroid_resids.pkl with 4 slots
2026-05-03 12:17:15,512 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/centroid_resids_time.png
2026-05-03 12:17:15,783 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/centroid_resids_scatter.png
2026-05-03 12:17:16,051 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-03 12:17:16,179 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/n_kalman_delta_roll.png
2026-05-03 12:17:16,323 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/index.html
2026-05-03 12:17:16,325 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/info.json
2026-05-03 12:17:16,355 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/26/26961/index.html
2026-05-03 12:17:16,356 main:
2026-05-03 12:17:16,356 main: ********************************************************************************
2026-05-03 12:17:16,356 main: Processing observation 31627
2026-05-03 12:17:16,356 main: ********************************************************************************
2026-05-03 12:17:16,357 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:17:16,358 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:17:18,758 __init__: ObsID 31627 has insufficient telemetry, skipping
2026-05-03 12:17:18,759 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/index.html
2026-05-03 12:17:18,763 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/info.json
2026-05-03 12:17:18,764 main:
2026-05-03 12:17:18,764 main: ********************************************************************************
2026-05-03 12:17:18,764 main: Processing observation 32323
2026-05-03 12:17:18,764 main: ********************************************************************************
2026-05-03 12:17:18,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:17:18,766 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:17:21,239 __init__: ObsID 32323 has insufficient telemetry, skipping
2026-05-03 12:17:21,240 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/index.html
2026-05-03 12:17:21,244 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/info.json
2026-05-03 12:17:21,245 main:
2026-05-03 12:17:21,245 main: ********************************************************************************
2026-05-03 12:17:21,245 main: Processing observation 31736
2026-05-03 12:17:21,245 main: ********************************************************************************
2026-05-03 12:17:21,245 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/info.json file found, obs=None
2026-05-03 12:17:21,246 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-03 12:17:21,247 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-03 12:17:23,666 __init__: ObsID 31736 has no maneuver event in telemetry, skipping
2026-05-03 12:17:23,667 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/index.html
2026-05-03 12:17:23,688 info: could not get attribute kalman_start for obsid 31736
2026-05-03 12:17:23,688 info: could not get attribute kalman_stop for obsid 31736
2026-05-03 12:17:23,688 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/info.json
2026-05-03 12:17:23,689 main:
2026-05-03 13:17:25,672 run_check: Starting centroid dashboard continuity check
2026-05-03 13:17:25,672 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-03 13:17:25,672 collect_observations: Processing year 2020
2026-05-03 13:17:43,190 collect_observations: Processing year 2021
2026-05-03 13:18:09,003 collect_observations: Processing year 2022
2026-05-03 13:18:38,580 collect_observations: Processing year 2023
2026-05-03 13:19:11,521 collect_observations: Processing year 2024
2026-05-03 13:19:41,846 collect_observations: Processing year 2025
2026-05-03 13:20:10,764 collect_observations: Processing year 2026
2026-05-03 13:20:20,453 collect_observations: Collected 13801 observations from 4-digit years
2026-05-03 13:20:20,462 sort_observations_by_date: Sorted observations by date
2026-05-03 13:20:20,462 check_continuity: Starting continuity check from most recent: ObsID 31736 (APR2726A) at 2026:123:07:20:01.308
2026-05-03 13:20:20,482 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-03 13:20:20,482 check_continuity: Chain complete: visited 13801 observations out of 13801 total
2026-05-03 13:20:20,483 run_check: ✓ Observation chain continuity check PASSED
2026-05-03 13:20:20,483 run_check: Summary: 13801 observations from 4-digit years, all properly linked