Prev
Index
Next
centroid_dashboard: Tue Jun 30 13:17:41 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Tue Jun 30 13:17:41 2026 |
No errors
File contents:
2026-06-30 13:16:11,871 main: Processing from 2026:174:17:16:11.870 to 2026:181:17:16:11.870
2026-06-30 13:16:19,362 get_observations: Found observation 41391 at 2026:174:18:25:40.252 with 1 manvrs
2026-06-30 13:16:19,363 get_observations: Found observation 30061 at 2026:174:21:28:10.532 with 1 manvrs
2026-06-30 13:16:19,363 get_observations: Found observation 31402 at 2026:175:03:30:52.215 with 1 manvrs
2026-06-30 13:16:19,364 get_observations: Found observation 31403 at 2026:175:10:39:35.400 with 1 manvrs
2026-06-30 13:16:19,364 get_observations: Found observation 31405 at 2026:175:17:44:45.401 with 1 manvrs
2026-06-30 13:16:19,364 get_observations: Found observation 31406 at 2026:176:00:49:55.401 with 1 manvrs
2026-06-30 13:16:19,365 get_observations: Found observation 31611 at 2026:176:08:04:17.279 with 1 manvrs
2026-06-30 13:16:19,365 get_observations: Found observation 30512 at 2026:176:10:14:45.557 with 1 manvrs
2026-06-30 13:16:19,366 get_observations: Found observation 41390 at 2026:176:23:41:47.248 with 1 manvrs
2026-06-30 13:16:19,366 get_observations: Found observation 41389 at 2026:177:00:55:40.252 with 1 manvrs
2026-06-30 13:16:19,366 get_observations: Found observation 41388 at 2026:177:03:25:40.252 with 1 manvrs
2026-06-30 13:16:19,367 get_observations: Found observation 41387 at 2026:177:07:25:40.252 with 1 manvrs
2026-06-30 13:16:19,367 get_observations: Found observation 41386 at 2026:177:09:55:40.252 with 1 manvrs
2026-06-30 13:16:19,368 get_observations: Found observation 31483 at 2026:177:13:31:23.009 with 1 manvrs
2026-06-30 13:16:19,368 get_observations: Found observation 31384 at 2026:177:19:05:05.114 with 1 manvrs
2026-06-30 13:16:19,368 get_observations: Found observation 31385 at 2026:177:19:53:51.437 with 1 manvrs
2026-06-30 13:16:19,369 get_observations: Found observation 31596 at 2026:177:21:07:14.768 with 1 manvrs
2026-06-30 13:16:19,369 get_observations: Found observation 29829 at 2026:178:02:27:51.034 with 1 manvrs
2026-06-30 13:16:19,370 get_observations: Found observation 31597 at 2026:178:07:35:09.169 with 1 manvrs
2026-06-30 13:16:19,370 get_observations: Found observation 31408 at 2026:178:12:04:53.765 with 1 manvrs
2026-06-30 13:16:19,370 get_observations: Found observation 32335 at 2026:178:16:58:23.394 with 1 manvrs
2026-06-30 13:16:19,371 get_observations: Found observation 32403 at 2026:179:01:40:03.076 with 1 manvrs
2026-06-30 13:16:19,371 get_observations: Found observation 32404 at 2026:179:05:08:22.265 with 1 manvrs
2026-06-30 13:16:19,372 get_observations: Found observation 32406 at 2026:179:11:14:33.099 with 1 manvrs
2026-06-30 13:16:19,372 get_observations: Found observation 41385 at 2026:179:16:14:34.593 with 1 manvrs
2026-06-30 13:16:19,372 get_observations: Found observation 41384 at 2026:179:17:48:26.289 with 1 manvrs
2026-06-30 13:16:19,373 get_observations: Found observation 41383 at 2026:179:19:28:40.940 with 1 manvrs
2026-06-30 13:16:19,373 get_observations: Found observation 41382 at 2026:179:20:56:58.149 with 1 manvrs
2026-06-30 13:16:19,374 get_observations: Found observation 41381 at 2026:180:01:55:40.252 with 1 manvrs
2026-06-30 13:16:19,374 get_observations: Found observation 41380 at 2026:180:03:25:40.252 with 1 manvrs
2026-06-30 13:16:19,375 get_observations: Found observation 29996 at 2026:180:04:22:57.002 with 1 manvrs
2026-06-30 13:16:19,375 get_observations: Found observation 30123 at 2026:180:10:49:24.483 with 2 manvrs
2026-06-30 13:16:19,375 get_observations: Found observation 30118 at 2026:180:15:46:31.682 with 2 manvrs
2026-06-30 13:16:19,376 get_observations: Found observation 32410 at 2026:181:00:40:55.419 with 1 manvrs
2026-06-30 13:16:19,376 get_observations: Found observation 30261 at 2026:181:06:38:29.029 with 1 manvrs
2026-06-30 13:16:19,377 get_observations: Found observation 32411 at 2026:181:12:52:41.524 with 1 manvrs
2026-06-30 13:16:19,377 main: Found 36 observations
2026-06-30 13:16:19,377 main: ********************************************************************************
2026-06-30 13:16:19,377 main: Processing observation 41391
2026-06-30 13:16:19,377 main: ********************************************************************************
2026-06-30 13:16:19,380 obs_link_from_info: Found prev obsid 41392
2026-06-30 13:16:19,384 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,385 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 13:16:19,388 process_obs: ObsID 41391 already processed, skipping
2026-06-30 13:16:19,388 main:
2026-06-30 13:16:19,388 main: ********************************************************************************
2026-06-30 13:16:19,388 main: Processing observation 30061
2026-06-30 13:16:19,388 main: ********************************************************************************
2026-06-30 13:16:19,389 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,390 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 13:16:19,394 process_obs: ObsID 30061 already processed, skipping
2026-06-30 13:16:19,394 main:
2026-06-30 13:16:19,394 main: ********************************************************************************
2026-06-30 13:16:19,394 main: Processing observation 31402
2026-06-30 13:16:19,394 main: ********************************************************************************
2026-06-30 13:16:19,395 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,396 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 13:16:19,400 process_obs: ObsID 31402 already processed, skipping
2026-06-30 13:16:19,400 main:
2026-06-30 13:16:19,400 main: ********************************************************************************
2026-06-30 13:16:19,400 main: Processing observation 31403
2026-06-30 13:16:19,400 main: ********************************************************************************
2026-06-30 13:16:19,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,402 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 13:16:19,405 process_obs: ObsID 31403 already processed, skipping
2026-06-30 13:16:19,405 main:
2026-06-30 13:16:19,405 main: ********************************************************************************
2026-06-30 13:16:19,405 main: Processing observation 31405
2026-06-30 13:16:19,405 main: ********************************************************************************
2026-06-30 13:16:19,406 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,407 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 13:16:19,411 process_obs: ObsID 31405 already processed, skipping
2026-06-30 13:16:19,411 main:
2026-06-30 13:16:19,411 main: ********************************************************************************
2026-06-30 13:16:19,411 main: Processing observation 31406
2026-06-30 13:16:19,411 main: ********************************************************************************
2026-06-30 13:16:19,412 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,413 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 13:16:19,416 process_obs: ObsID 31406 already processed, skipping
2026-06-30 13:16:19,416 main:
2026-06-30 13:16:19,416 main: ********************************************************************************
2026-06-30 13:16:19,416 main: Processing observation 31611
2026-06-30 13:16:19,416 main: ********************************************************************************
2026-06-30 13:16:19,417 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,418 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 13:16:19,421 process_obs: ObsID 31611 already processed, skipping
2026-06-30 13:16:19,421 main:
2026-06-30 13:16:19,421 main: ********************************************************************************
2026-06-30 13:16:19,421 main: Processing observation 30512
2026-06-30 13:16:19,421 main: ********************************************************************************
2026-06-30 13:16:19,422 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 13:16:19,423 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:21,712 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30512/centroid_resids.pkl
2026-06-30 12:16:21,730 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-30 12:16:21,730 plot_crs_time: Plot file exists, skipping
2026-06-30 12:16:21,730 plot_crs_scatter: Plot file exists, skipping
2026-06-30 12:16:21,846 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:16:22,321 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30512/n_kalman_delta_roll.png
2026-06-30 12:16:30,141 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30512/index.html
2026-06-30 12:16:30,142 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30512/info.json
2026-06-30 12:16:30,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30512/index.html
2026-06-30 12:16:30,146 main:
2026-06-30 12:16:30,146 main: ********************************************************************************
2026-06-30 12:16:30,146 main: Processing observation 41390
2026-06-30 12:16:30,146 main: ********************************************************************************
2026-06-30 12:16:30,296 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,297 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,300 process_obs: ObsID 41390 already processed, skipping
2026-06-30 12:16:30,301 main:
2026-06-30 12:16:30,301 main: ********************************************************************************
2026-06-30 12:16:30,301 main: Processing observation 41389
2026-06-30 12:16:30,301 main: ********************************************************************************
2026-06-30 12:16:30,309 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,310 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,314 process_obs: ObsID 41389 already processed, skipping
2026-06-30 12:16:30,314 main:
2026-06-30 12:16:30,314 main: ********************************************************************************
2026-06-30 12:16:30,314 main: Processing observation 41388
2026-06-30 12:16:30,314 main: ********************************************************************************
2026-06-30 12:16:30,318 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,319 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,323 process_obs: ObsID 41388 already processed, skipping
2026-06-30 12:16:30,323 main:
2026-06-30 12:16:30,323 main: ********************************************************************************
2026-06-30 12:16:30,323 main: Processing observation 41387
2026-06-30 12:16:30,323 main: ********************************************************************************
2026-06-30 12:16:30,326 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,327 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,331 process_obs: ObsID 41387 already processed, skipping
2026-06-30 12:16:30,331 main:
2026-06-30 12:16:30,331 main: ********************************************************************************
2026-06-30 12:16:30,331 main: Processing observation 41386
2026-06-30 12:16:30,331 main: ********************************************************************************
2026-06-30 12:16:30,334 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,335 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,339 process_obs: ObsID 41386 already processed, skipping
2026-06-30 12:16:30,339 main:
2026-06-30 12:16:30,339 main: ********************************************************************************
2026-06-30 12:16:30,339 main: Processing observation 31483
2026-06-30 12:16:30,339 main: ********************************************************************************
2026-06-30 12:16:30,342 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,343 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,349 process_obs: ObsID 31483 already processed, skipping
2026-06-30 12:16:30,349 main:
2026-06-30 12:16:30,349 main: ********************************************************************************
2026-06-30 12:16:30,349 main: Processing observation 31384
2026-06-30 12:16:30,349 main: ********************************************************************************
2026-06-30 12:16:30,351 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,353 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,359 process_obs: ObsID 31384 already processed, skipping
2026-06-30 12:16:30,359 main:
2026-06-30 12:16:30,359 main: ********************************************************************************
2026-06-30 12:16:30,359 main: Processing observation 31385
2026-06-30 12:16:30,359 main: ********************************************************************************
2026-06-30 12:16:30,362 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,364 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,371 process_obs: ObsID 31385 already processed, skipping
2026-06-30 12:16:30,371 main:
2026-06-30 12:16:30,371 main: ********************************************************************************
2026-06-30 12:16:30,371 main: Processing observation 31596
2026-06-30 12:16:30,371 main: ********************************************************************************
2026-06-30 12:16:30,374 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,377 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,385 process_obs: ObsID 31596 already processed, skipping
2026-06-30 12:16:30,385 main:
2026-06-30 12:16:30,386 main: ********************************************************************************
2026-06-30 12:16:30,386 main: Processing observation 29829
2026-06-30 12:16:30,386 main: ********************************************************************************
2026-06-30 12:16:30,388 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,391 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,402 process_obs: ObsID 29829 already processed, skipping
2026-06-30 12:16:30,402 main:
2026-06-30 12:16:30,402 main: ********************************************************************************
2026-06-30 12:16:30,402 main: Processing observation 31597
2026-06-30 12:16:30,402 main: ********************************************************************************
2026-06-30 12:16:30,405 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,408 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,420 process_obs: ObsID 31597 already processed, skipping
2026-06-30 12:16:30,420 main:
2026-06-30 12:16:30,420 main: ********************************************************************************
2026-06-30 12:16:30,420 main: Processing observation 31408
2026-06-30 12:16:30,420 main: ********************************************************************************
2026-06-30 12:16:30,423 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,427 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:30,441 process_obs: ObsID 31408 already processed, skipping
2026-06-30 12:16:30,441 main:
2026-06-30 12:16:30,441 main: ********************************************************************************
2026-06-30 12:16:30,441 main: Processing observation 32335
2026-06-30 12:16:30,441 main: ********************************************************************************
2026-06-30 12:16:30,444 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:30,448 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:36,102 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32335/centroid_resids.pkl
2026-06-30 12:16:36,113 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-30 12:16:36,113 plot_crs_time: Plot file exists, skipping
2026-06-30 12:16:36,114 plot_crs_scatter: Plot file exists, skipping
2026-06-30 12:16:36,224 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:16:36,381 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32335/n_kalman_delta_roll.png
2026-06-30 12:16:40,775 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32335/index.html
2026-06-30 12:16:40,777 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32335/info.json
2026-06-30 12:16:40,781 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32335/index.html
2026-06-30 12:16:40,782 main:
2026-06-30 12:16:40,782 main: ********************************************************************************
2026-06-30 12:16:40,782 main: Processing observation 32403
2026-06-30 12:16:40,782 main: ********************************************************************************
2026-06-30 12:16:40,783 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:40,785 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:40,807 process_obs: ObsID 32403 already processed, skipping
2026-06-30 12:16:40,807 main:
2026-06-30 12:16:40,807 main: ********************************************************************************
2026-06-30 12:16:40,807 main: Processing observation 32404
2026-06-30 12:16:40,807 main: ********************************************************************************
2026-06-30 12:16:40,808 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:40,809 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:40,841 process_obs: ObsID 32404 already processed, skipping
2026-06-30 12:16:40,841 main:
2026-06-30 12:16:40,842 main: ********************************************************************************
2026-06-30 12:16:40,842 main: Processing observation 32406
2026-06-30 12:16:40,842 main: ********************************************************************************
2026-06-30 12:16:40,843 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:40,844 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:40,855 process_obs: ObsID 32406 already processed, skipping
2026-06-30 12:16:40,855 main:
2026-06-30 12:16:40,855 main: ********************************************************************************
2026-06-30 12:16:40,855 main: Processing observation 41385
2026-06-30 12:16:40,855 main: ********************************************************************************
2026-06-30 12:16:40,856 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:40,857 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-30 12:16:40,878 process_obs: ObsID 41385 already processed, skipping
2026-06-30 12:16:40,878 main:
2026-06-30 12:16:40,879 main: ********************************************************************************
2026-06-30 12:16:40,879 main: Processing observation 41384
2026-06-30 12:16:40,879 main: ********************************************************************************
2026-06-30 12:16:40,880 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:40,881 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:16:40,907 process_obs: ObsID 41384 already processed, skipping
2026-06-30 12:16:40,907 main:
2026-06-30 12:16:40,907 main: ********************************************************************************
2026-06-30 12:16:40,907 main: Processing observation 41383
2026-06-30 12:16:40,907 main: ********************************************************************************
2026-06-30 12:16:40,911 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:40,917 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:16:40,937 process_obs: ObsID 41383 already processed, skipping
2026-06-30 12:16:40,937 main:
2026-06-30 12:16:40,937 main: ********************************************************************************
2026-06-30 12:16:40,937 main: Processing observation 41382
2026-06-30 12:16:40,937 main: ********************************************************************************
2026-06-30 12:16:40,938 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:40,940 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:16:45,447 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-30 12:16:47,095 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41382/centroid_resids.pkl with 8 slots
2026-06-30 12:16:47,189 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41382/centroid_resids_time.png
2026-06-30 12:16:47,682 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41382/centroid_resids_scatter.png
2026-06-30 12:16:47,884 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:16:48,004 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41382/n_kalman_delta_roll.png
2026-06-30 12:16:51,586 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41382/index.html
2026-06-30 12:16:51,587 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41382/info.json
2026-06-30 12:16:51,590 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41382/index.html
2026-06-30 12:16:51,591 main:
2026-06-30 12:16:51,591 main: ********************************************************************************
2026-06-30 12:16:51,591 main: Processing observation 41381
2026-06-30 12:16:51,591 main: ********************************************************************************
2026-06-30 12:16:51,592 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:51,593 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:16:53,683 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-30 12:16:54,141 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41381/centroid_resids.pkl with 8 slots
2026-06-30 12:16:54,396 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41381/centroid_resids_time.png
2026-06-30 12:16:54,695 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41381/centroid_resids_scatter.png
2026-06-30 12:16:54,773 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:16:54,941 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41381/n_kalman_delta_roll.png
2026-06-30 12:16:55,278 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41381/index.html
2026-06-30 12:16:55,279 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41381/info.json
2026-06-30 12:16:55,282 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41381/index.html
2026-06-30 12:16:55,283 main:
2026-06-30 12:16:55,283 main: ********************************************************************************
2026-06-30 12:16:55,283 main: Processing observation 41380
2026-06-30 12:16:55,283 main: ********************************************************************************
2026-06-30 12:16:55,284 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:55,285 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:16:57,163 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-30 12:16:57,587 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41380/centroid_resids.pkl with 8 slots
2026-06-30 12:16:57,651 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41380/centroid_resids_time.png
2026-06-30 12:16:57,937 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41380/centroid_resids_scatter.png
2026-06-30 12:16:58,011 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:16:58,132 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41380/n_kalman_delta_roll.png
2026-06-30 12:16:58,271 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41380/index.html
2026-06-30 12:16:58,273 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/41380/info.json
2026-06-30 12:16:58,278 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41380/index.html
2026-06-30 12:16:58,279 main:
2026-06-30 12:16:58,279 main: ********************************************************************************
2026-06-30 12:16:58,279 main: Processing observation 29996
2026-06-30 12:16:58,279 main: ********************************************************************************
2026-06-30 12:16:58,281 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:16:58,282 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:17:00,480 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-30 12:17:00,873 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/29996/centroid_resids.pkl with 5 slots
2026-06-30 12:17:00,948 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/29996/centroid_resids_time.png
2026-06-30 12:17:01,265 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/29996/centroid_resids_scatter.png
2026-06-30 12:17:01,451 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:17:01,594 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/29996/n_kalman_delta_roll.png
2026-06-30 12:17:01,753 get_aberration_correction: More than one entry for 29996 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/JUN2926/oflsa/output/JUN2926A_ManErr.txt. Skipping aber correction
2026-06-30 12:17:01,764 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/29996/index.html
2026-06-30 12:17:01,766 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/29996/info.json
2026-06-30 12:17:01,771 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29996/index.html
2026-06-30 12:17:01,773 main:
2026-06-30 12:17:01,773 main: ********************************************************************************
2026-06-30 12:17:01,773 main: Processing observation 30123
2026-06-30 12:17:01,773 main: ********************************************************************************
2026-06-30 12:17:01,775 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:17:01,777 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:17:04,927 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-30 12:17:05,347 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30123/centroid_resids.pkl with 5 slots
2026-06-30 12:17:05,395 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30123/centroid_resids_time.png
2026-06-30 12:17:05,682 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30123/centroid_resids_scatter.png
2026-06-30 12:17:05,829 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:17:05,947 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30123/n_kalman_delta_roll.png
2026-06-30 12:17:06,076 get_aberration_correction: More than one entry for 30123 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/JUN2926/oflsa/output/JUN2926A_ManErr.txt. Skipping aber correction
2026-06-30 12:17:06,090 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30123/index.html
2026-06-30 12:17:06,093 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30123/info.json
2026-06-30 12:17:06,096 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30123/index.html
2026-06-30 12:17:06,097 main:
2026-06-30 12:17:06,097 main: ********************************************************************************
2026-06-30 12:17:06,097 main: Processing observation 30118
2026-06-30 12:17:06,097 main: ********************************************************************************
2026-06-30 12:17:06,100 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:17:06,104 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:17:10,128 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-30 12:17:10,513 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30118/centroid_resids.pkl with 5 slots
2026-06-30 12:17:10,574 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30118/centroid_resids_time.png
2026-06-30 12:17:10,953 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30118/centroid_resids_scatter.png
2026-06-30 12:17:11,321 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-30 12:17:11,421 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30118/n_kalman_delta_roll.png
2026-06-30 12:17:11,561 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30118/index.html
2026-06-30 12:17:11,565 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30118/info.json
2026-06-30 12:17:11,574 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30118/index.html
2026-06-30 12:17:11,575 main:
2026-06-30 12:17:11,575 main: ********************************************************************************
2026-06-30 12:17:11,575 main: Processing observation 32410
2026-06-30 12:17:11,575 main: ********************************************************************************
2026-06-30 12:17:11,578 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:17:11,581 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:17:13,478 __init__: ObsID 32410 has insufficient telemetry, skipping
2026-06-30 12:17:13,479 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/32410/index.html
2026-06-30 12:17:13,484 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/32410/info.json
2026-06-30 12:17:13,485 main:
2026-06-30 12:17:13,485 main: ********************************************************************************
2026-06-30 12:17:13,485 main: Processing observation 30261
2026-06-30 12:17:13,485 main: ********************************************************************************
2026-06-30 12:17:13,486 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:17:13,487 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:17:15,306 __init__: ObsID 30261 has no maneuver event in telemetry, skipping
2026-06-30 12:17:15,306 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30261/index.html
2026-06-30 12:17:15,311 info: could not get attribute kalman_start for obsid 30261
2026-06-30 12:17:15,311 info: could not get attribute kalman_stop for obsid 30261
2026-06-30 12:17:15,311 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/30261/info.json
2026-06-30 12:17:15,312 main:
2026-06-30 12:17:15,312 main: ********************************************************************************
2026-06-30 12:17:15,312 main: Processing observation 32411
2026-06-30 12:17:15,312 main: ********************************************************************************
2026-06-30 12:17:15,312 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/32411/info.json file found, obs=None
2026-06-30 12:17:15,313 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-30 12:17:15,314 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/last.html
2026-06-30 12:17:17,138 __init__: ObsID 32411 has no maneuver event in telemetry, skipping
2026-06-30 12:17:17,139 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/32411/index.html
2026-06-30 12:17:17,143 get_aberration_correction: More than one entry for 32411 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/JUN2926/oflsa/output/JUN2926A_ManErr.txt. Skipping aber correction
2026-06-30 12:17:17,143 info: could not get attribute kalman_start for obsid 32411
2026-06-30 12:17:17,143 info: could not get attribute kalman_stop for obsid 32411
2026-06-30 12:17:17,143 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2926A/32411/info.json
2026-06-30 12:17:17,144 main:
2026-06-30 13:17:18,618 run_check: Starting centroid dashboard continuity check
2026-06-30 13:17:18,618 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-06-30 13:17:18,619 collect_observations: Processing year 2020
2026-06-30 13:17:20,676 collect_observations: Processing year 2021
2026-06-30 13:17:23,786 collect_observations: Processing year 2022
2026-06-30 13:17:27,288 collect_observations: Processing year 2023
2026-06-30 13:17:31,593 collect_observations: Processing year 2024
2026-06-30 13:17:35,451 collect_observations: Processing year 2025
2026-06-30 13:17:39,448 collect_observations: Processing year 2026
2026-06-30 13:17:41,839 collect_observations: Collected 14122 observations from 4-digit years
2026-06-30 13:17:41,842 sort_observations_by_date: Sorted observations by date
2026-06-30 13:17:41,843 check_continuity: Starting continuity check from most recent: ObsID 32411 (JUN2926A) at 2026:181:12:16:14.777
2026-06-30 13:17:41,861 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-06-30 13:17:41,862 check_continuity: Chain complete: visited 14122 observations out of 14122 total
2026-06-30 13:17:41,862 run_check: ✓ Observation chain continuity check PASSED
2026-06-30 13:17:41,862 run_check: Summary: 14122 observations from 4-digit years, all properly linked