Prev
Index
Next
centroid_dashboard: Wed Jun 24 13:18:36 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Wed Jun 24 13:18:36 2026 |
No errors
File contents:
2026-06-24 13:16:10,070 main: Processing from 2026:168:17:16:10.069 to 2026:175:17:16:10.069
2026-06-24 13:16:17,334 get_observations: Found observation 41410 at 2026:168:19:06:12.165 with 1 manvrs
2026-06-24 13:16:17,334 get_observations: Found observation 32367 at 2026:168:20:00:06.268 with 1 manvrs
2026-06-24 13:16:17,335 get_observations: Found observation 41409 at 2026:169:02:11:43.746 with 1 manvrs
2026-06-24 13:16:17,335 get_observations: Found observation 41408 at 2026:169:03:50:17.215 with 1 manvrs
2026-06-24 13:16:17,336 get_observations: Found observation 41407 at 2026:169:05:21:40.453 with 1 manvrs
2026-06-24 13:16:17,336 get_observations: Found observation 41406 at 2026:169:06:13:17.433 with 1 manvrs
2026-06-24 13:16:17,336 get_observations: Found observation 41405 at 2026:169:07:34:14.852 with 1 manvrs
2026-06-24 13:16:17,337 get_observations: Found observation 41403 at 2026:169:09:39:40.252 with 2 manvrs
2026-06-24 13:16:17,337 get_observations: Found observation 41402 at 2026:169:11:55:40.252 with 1 manvrs
2026-06-24 13:16:17,338 get_observations: Found observation 41401 at 2026:169:12:52:31.548 with 1 manvrs
2026-06-24 13:16:17,338 get_observations: Found observation 41400 at 2026:169:13:44:49.913 with 1 manvrs
2026-06-24 13:16:17,338 get_observations: Found observation 32395 at 2026:169:15:05:25.354 with 1 manvrs
2026-06-24 13:16:17,339 get_observations: Found observation 29868 at 2026:169:19:23:15.342 with 1 manvrs
2026-06-24 13:16:17,339 get_observations: Found observation 32394 at 2026:170:12:39:51.495 with 1 manvrs
2026-06-24 13:16:17,340 get_observations: Found observation 30246 at 2026:170:18:40:30.716 with 1 manvrs
2026-06-24 13:16:17,340 get_observations: Found observation 31401 at 2026:171:01:07:52.870 with 1 manvrs
2026-06-24 13:16:17,340 get_observations: Found observation 32393 at 2026:171:07:42:25.675 with 1 manvrs
2026-06-24 13:16:17,341 get_observations: Found observation 30005 at 2026:171:13:33:00.443 with 1 manvrs
2026-06-24 13:16:17,341 get_observations: Found observation 41399 at 2026:171:18:08:30.037 with 1 manvrs
2026-06-24 13:16:17,342 get_observations: Found observation 41398 at 2026:171:19:52:48.715 with 1 manvrs
2026-06-24 13:16:17,342 get_observations: Found observation 41397 at 2026:171:21:35:55.221 with 1 manvrs
2026-06-24 13:16:17,343 get_observations: Found observation 41396 at 2026:172:03:55:40.252 with 1 manvrs
2026-06-24 13:16:17,343 get_observations: Found observation 41395 at 2026:172:05:00:25.498 with 1 manvrs
2026-06-24 13:16:17,343 get_observations: Found observation 30251 at 2026:172:06:10:51.305 with 1 manvrs
2026-06-24 13:16:17,344 get_observations: Found observation 32392 at 2026:172:11:33:00.045 with 1 manvrs
2026-06-24 13:16:17,344 get_observations: Found observation 32396 at 2026:172:14:58:16.569 with 1 manvrs
2026-06-24 13:16:17,345 get_observations: Found observation 30428 at 2026:172:19:12:27.108 with 1 manvrs
2026-06-24 13:16:17,345 get_observations: Found observation 30223 at 2026:173:00:44:32.920 with 1 manvrs
2026-06-24 13:16:17,345 get_observations: Found observation 30132 at 2026:173:09:40:25.170 with 1 manvrs
2026-06-24 13:16:17,346 get_observations: Found observation 30249 at 2026:173:14:32:01.834 with 1 manvrs
2026-06-24 13:16:17,346 get_observations: Found observation 32405 at 2026:173:19:23:39.816 with 1 manvrs
2026-06-24 13:16:17,347 get_observations: Found observation 32407 at 2026:174:00:15:18.040 with 1 manvrs
2026-06-24 13:16:17,347 get_observations: Found observation 30134 at 2026:174:04:50:09.625 with 1 manvrs
2026-06-24 13:16:17,347 get_observations: Found observation 41394 at 2026:174:09:34:39.704 with 1 manvrs
2026-06-24 13:16:17,348 get_observations: Found observation 41393 at 2026:174:12:55:40.252 with 1 manvrs
2026-06-24 13:16:17,348 get_observations: Found observation 41392 at 2026:174:14:55:40.252 with 1 manvrs
2026-06-24 13:16:17,349 get_observations: Found observation 41391 at 2026:174:18:25:40.252 with 1 manvrs
2026-06-24 13:16:17,349 get_observations: Found observation 30061 at 2026:174:21:28:10.532 with 1 manvrs
2026-06-24 13:16:17,349 get_observations: Found observation 31402 at 2026:175:03:30:52.215 with 1 manvrs
2026-06-24 13:16:17,350 get_observations: Found observation 31403 at 2026:175:10:39:35.400 with 1 manvrs
2026-06-24 13:16:17,350 main: Found 40 observations
2026-06-24 13:16:17,350 main: ********************************************************************************
2026-06-24 13:16:17,350 main: Processing observation 41410
2026-06-24 13:16:17,350 main: ********************************************************************************
2026-06-24 13:16:17,355 obs_link_from_info: Found prev obsid 32399
2026-06-24 13:16:17,358 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,360 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,363 process_obs: ObsID 41410 already processed, skipping
2026-06-24 13:16:17,363 main:
2026-06-24 13:16:17,363 main: ********************************************************************************
2026-06-24 13:16:17,363 main: Processing observation 32367
2026-06-24 13:16:17,363 main: ********************************************************************************
2026-06-24 13:16:17,364 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,365 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,369 process_obs: ObsID 32367 already processed, skipping
2026-06-24 13:16:17,369 main:
2026-06-24 13:16:17,369 main: ********************************************************************************
2026-06-24 13:16:17,369 main: Processing observation 41409
2026-06-24 13:16:17,369 main: ********************************************************************************
2026-06-24 13:16:17,370 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,371 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,374 process_obs: ObsID 41409 already processed, skipping
2026-06-24 13:16:17,374 main:
2026-06-24 13:16:17,374 main: ********************************************************************************
2026-06-24 13:16:17,374 main: Processing observation 41408
2026-06-24 13:16:17,374 main: ********************************************************************************
2026-06-24 13:16:17,375 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,376 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,380 process_obs: ObsID 41408 already processed, skipping
2026-06-24 13:16:17,380 main:
2026-06-24 13:16:17,380 main: ********************************************************************************
2026-06-24 13:16:17,380 main: Processing observation 41407
2026-06-24 13:16:17,380 main: ********************************************************************************
2026-06-24 13:16:17,381 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,382 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,385 process_obs: ObsID 41407 already processed, skipping
2026-06-24 13:16:17,385 main:
2026-06-24 13:16:17,385 main: ********************************************************************************
2026-06-24 13:16:17,385 main: Processing observation 41406
2026-06-24 13:16:17,385 main: ********************************************************************************
2026-06-24 13:16:17,386 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,387 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,391 process_obs: ObsID 41406 already processed, skipping
2026-06-24 13:16:17,391 main:
2026-06-24 13:16:17,391 main: ********************************************************************************
2026-06-24 13:16:17,391 main: Processing observation 41405
2026-06-24 13:16:17,391 main: ********************************************************************************
2026-06-24 13:16:17,392 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,393 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,396 process_obs: ObsID 41405 already processed, skipping
2026-06-24 13:16:17,396 main:
2026-06-24 13:16:17,396 main: ********************************************************************************
2026-06-24 13:16:17,396 main: Processing observation 41403
2026-06-24 13:16:17,396 main: ********************************************************************************
2026-06-24 13:16:17,397 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,398 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,402 process_obs: ObsID 41403 already processed, skipping
2026-06-24 13:16:17,402 main:
2026-06-24 13:16:17,402 main: ********************************************************************************
2026-06-24 13:16:17,402 main: Processing observation 41402
2026-06-24 13:16:17,402 main: ********************************************************************************
2026-06-24 13:16:17,403 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,404 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,407 process_obs: ObsID 41402 already processed, skipping
2026-06-24 13:16:17,407 main:
2026-06-24 13:16:17,407 main: ********************************************************************************
2026-06-24 13:16:17,407 main: Processing observation 41401
2026-06-24 13:16:17,407 main: ********************************************************************************
2026-06-24 13:16:17,408 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,409 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,413 process_obs: ObsID 41401 already processed, skipping
2026-06-24 13:16:17,413 main:
2026-06-24 13:16:17,413 main: ********************************************************************************
2026-06-24 13:16:17,413 main: Processing observation 41400
2026-06-24 13:16:17,413 main: ********************************************************************************
2026-06-24 13:16:17,414 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,415 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,418 process_obs: ObsID 41400 already processed, skipping
2026-06-24 13:16:17,418 main:
2026-06-24 13:16:17,418 main: ********************************************************************************
2026-06-24 13:16:17,418 main: Processing observation 32395
2026-06-24 13:16:17,418 main: ********************************************************************************
2026-06-24 13:16:17,419 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,420 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 13:16:17,424 process_obs: ObsID 32395 already processed, skipping
2026-06-24 13:16:17,424 main:
2026-06-24 13:16:17,424 main: ********************************************************************************
2026-06-24 13:16:17,424 main: Processing observation 29868
2026-06-24 13:16:17,424 main: ********************************************************************************
2026-06-24 13:16:17,425 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 13:16:17,426 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:19,942 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29868/centroid_resids.pkl
2026-06-24 12:16:20,002 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-24 12:16:20,002 plot_crs_time: Plot file exists, skipping
2026-06-24 12:16:20,002 plot_crs_scatter: Plot file exists, skipping
2026-06-24 12:16:23,434 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29868/n_kalman_delta_roll.png
2026-06-24 12:16:27,109 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29868/index.html
2026-06-24 12:16:27,112 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29868/info.json
2026-06-24 12:16:27,120 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29868/index.html
2026-06-24 12:16:27,124 main:
2026-06-24 12:16:27,124 main: ********************************************************************************
2026-06-24 12:16:27,125 main: Processing observation 32394
2026-06-24 12:16:27,125 main: ********************************************************************************
2026-06-24 12:16:27,126 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,127 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,130 process_obs: ObsID 32394 already processed, skipping
2026-06-24 12:16:27,131 main:
2026-06-24 12:16:27,131 main: ********************************************************************************
2026-06-24 12:16:27,131 main: Processing observation 30246
2026-06-24 12:16:27,131 main: ********************************************************************************
2026-06-24 12:16:27,132 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,133 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,145 process_obs: ObsID 30246 already processed, skipping
2026-06-24 12:16:27,145 main:
2026-06-24 12:16:27,146 main: ********************************************************************************
2026-06-24 12:16:27,146 main: Processing observation 31401
2026-06-24 12:16:27,146 main: ********************************************************************************
2026-06-24 12:16:27,147 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,148 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,152 process_obs: ObsID 31401 already processed, skipping
2026-06-24 12:16:27,152 main:
2026-06-24 12:16:27,152 main: ********************************************************************************
2026-06-24 12:16:27,152 main: Processing observation 32393
2026-06-24 12:16:27,152 main: ********************************************************************************
2026-06-24 12:16:27,153 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,154 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,158 process_obs: ObsID 32393 already processed, skipping
2026-06-24 12:16:27,158 main:
2026-06-24 12:16:27,158 main: ********************************************************************************
2026-06-24 12:16:27,158 main: Processing observation 30005
2026-06-24 12:16:27,158 main: ********************************************************************************
2026-06-24 12:16:27,159 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,161 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,262 process_obs: ObsID 30005 already processed, skipping
2026-06-24 12:16:27,262 main:
2026-06-24 12:16:27,262 main: ********************************************************************************
2026-06-24 12:16:27,262 main: Processing observation 41399
2026-06-24 12:16:27,262 main: ********************************************************************************
2026-06-24 12:16:27,286 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,318 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,450 process_obs: ObsID 41399 already processed, skipping
2026-06-24 12:16:27,450 main:
2026-06-24 12:16:27,450 main: ********************************************************************************
2026-06-24 12:16:27,450 main: Processing observation 41398
2026-06-24 12:16:27,450 main: ********************************************************************************
2026-06-24 12:16:27,474 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,557 process_obs: ObsID 41398 already processed, skipping
2026-06-24 12:16:27,557 main:
2026-06-24 12:16:27,557 main: ********************************************************************************
2026-06-24 12:16:27,557 main: Processing observation 41397
2026-06-24 12:16:27,557 main: ********************************************************************************
2026-06-24 12:16:27,563 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,566 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,601 process_obs: ObsID 41397 already processed, skipping
2026-06-24 12:16:27,601 main:
2026-06-24 12:16:27,601 main: ********************************************************************************
2026-06-24 12:16:27,601 main: Processing observation 41396
2026-06-24 12:16:27,601 main: ********************************************************************************
2026-06-24 12:16:27,605 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,608 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,621 process_obs: ObsID 41396 already processed, skipping
2026-06-24 12:16:27,621 main:
2026-06-24 12:16:27,621 main: ********************************************************************************
2026-06-24 12:16:27,621 main: Processing observation 41395
2026-06-24 12:16:27,621 main: ********************************************************************************
2026-06-24 12:16:27,623 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,625 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,649 process_obs: ObsID 41395 already processed, skipping
2026-06-24 12:16:27,649 main:
2026-06-24 12:16:27,649 main: ********************************************************************************
2026-06-24 12:16:27,649 main: Processing observation 30251
2026-06-24 12:16:27,649 main: ********************************************************************************
2026-06-24 12:16:27,654 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,660 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,683 process_obs: ObsID 30251 already processed, skipping
2026-06-24 12:16:27,684 main:
2026-06-24 12:16:27,684 main: ********************************************************************************
2026-06-24 12:16:27,684 main: Processing observation 32392
2026-06-24 12:16:27,684 main: ********************************************************************************
2026-06-24 12:16:27,690 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,696 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,710 process_obs: ObsID 32392 already processed, skipping
2026-06-24 12:16:27,710 main:
2026-06-24 12:16:27,710 main: ********************************************************************************
2026-06-24 12:16:27,710 main: Processing observation 32396
2026-06-24 12:16:27,710 main: ********************************************************************************
2026-06-24 12:16:27,713 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,715 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,740 process_obs: ObsID 32396 already processed, skipping
2026-06-24 12:16:27,740 main:
2026-06-24 12:16:27,740 main: ********************************************************************************
2026-06-24 12:16:27,740 main: Processing observation 30428
2026-06-24 12:16:27,740 main: ********************************************************************************
2026-06-24 12:16:27,744 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,747 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-24 12:16:27,786 process_obs: ObsID 30428 already processed, skipping
2026-06-24 12:16:27,786 main:
2026-06-24 12:16:27,786 main: ********************************************************************************
2026-06-24 12:16:27,786 main: Processing observation 30223
2026-06-24 12:16:27,786 main: ********************************************************************************
2026-06-24 12:16:27,791 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,800 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:27,838 process_obs: ObsID 30223 already processed, skipping
2026-06-24 12:16:27,838 main:
2026-06-24 12:16:27,838 main: ********************************************************************************
2026-06-24 12:16:27,838 main: Processing observation 30132
2026-06-24 12:16:27,838 main: ********************************************************************************
2026-06-24 12:16:27,843 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:27,855 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:28,006 process_obs: ObsID 30132 already processed, skipping
2026-06-24 12:16:28,006 main:
2026-06-24 12:16:28,006 main: ********************************************************************************
2026-06-24 12:16:28,006 main: Processing observation 30249
2026-06-24 12:16:28,006 main: ********************************************************************************
2026-06-24 12:16:28,030 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:28,058 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:28,072 process_obs: ObsID 30249 already processed, skipping
2026-06-24 12:16:28,073 main:
2026-06-24 12:16:28,073 main: ********************************************************************************
2026-06-24 12:16:28,073 main: Processing observation 32405
2026-06-24 12:16:28,073 main: ********************************************************************************
2026-06-24 12:16:28,074 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:28,075 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:28,097 process_obs: ObsID 32405 already processed, skipping
2026-06-24 12:16:28,097 main:
2026-06-24 12:16:28,097 main: ********************************************************************************
2026-06-24 12:16:28,097 main: Processing observation 32407
2026-06-24 12:16:28,097 main: ********************************************************************************
2026-06-24 12:16:28,098 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:28,100 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:30,358 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-24 12:16:31,642 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32407/centroid_resids.pkl with 5 slots
2026-06-24 12:16:31,706 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32407/centroid_resids_time.png
2026-06-24 12:16:32,030 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32407/centroid_resids_scatter.png
2026-06-24 12:16:33,235 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32407/n_kalman_delta_roll.png
2026-06-24 12:16:36,267 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32407/index.html
2026-06-24 12:16:36,269 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/32407/info.json
2026-06-24 12:16:36,274 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32407/index.html
2026-06-24 12:16:36,275 main:
2026-06-24 12:16:36,275 main: ********************************************************************************
2026-06-24 12:16:36,275 main: Processing observation 30134
2026-06-24 12:16:36,275 main: ********************************************************************************
2026-06-24 12:16:36,276 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:36,279 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:38,131 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-24 12:16:38,420 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30134/centroid_resids.pkl with 5 slots
2026-06-24 12:16:38,689 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30134/centroid_resids_time.png
2026-06-24 12:16:38,958 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30134/centroid_resids_scatter.png
2026-06-24 12:16:40,080 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30134/n_kalman_delta_roll.png
2026-06-24 12:16:40,214 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30134/index.html
2026-06-24 12:16:40,216 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30134/info.json
2026-06-24 12:16:40,219 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30134/index.html
2026-06-24 12:16:40,220 main:
2026-06-24 12:16:40,220 main: ********************************************************************************
2026-06-24 12:16:40,220 main: Processing observation 41394
2026-06-24 12:16:40,220 main: ********************************************************************************
2026-06-24 12:16:40,221 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:40,222 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:42,043 __init__: ObsID 41394 has insufficient telemetry, skipping
2026-06-24 12:16:42,044 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41394/index.html
2026-06-24 12:16:42,048 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41394/info.json
2026-06-24 12:16:42,049 main:
2026-06-24 12:16:42,049 main: ********************************************************************************
2026-06-24 12:16:42,049 main: Processing observation 41393
2026-06-24 12:16:42,049 main: ********************************************************************************
2026-06-24 12:16:42,050 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:42,052 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:43,884 __init__: ObsID 41393 has insufficient telemetry, skipping
2026-06-24 12:16:43,885 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41393/index.html
2026-06-24 12:16:43,889 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41393/info.json
2026-06-24 12:16:43,891 main:
2026-06-24 12:16:43,891 main: ********************************************************************************
2026-06-24 12:16:43,891 main: Processing observation 41392
2026-06-24 12:16:43,891 main: ********************************************************************************
2026-06-24 12:16:43,892 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:43,893 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:45,713 __init__: ObsID 41392 has insufficient telemetry, skipping
2026-06-24 12:16:45,713 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41392/index.html
2026-06-24 12:16:45,717 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41392/info.json
2026-06-24 12:16:45,719 main:
2026-06-24 12:16:45,719 main: ********************************************************************************
2026-06-24 12:16:45,719 main: Processing observation 41391
2026-06-24 12:16:45,719 main: ********************************************************************************
2026-06-24 12:16:45,732 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:45,733 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:47,534 __init__: ObsID 41391 has insufficient telemetry, skipping
2026-06-24 12:16:47,535 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41391/index.html
2026-06-24 12:16:47,539 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41391/info.json
2026-06-24 12:16:47,540 main:
2026-06-24 12:16:47,540 main: ********************************************************************************
2026-06-24 12:16:47,540 main: Processing observation 30061
2026-06-24 12:16:47,540 main: ********************************************************************************
2026-06-24 12:16:47,542 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:47,543 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:49,347 __init__: ObsID 30061 has insufficient telemetry, skipping
2026-06-24 12:16:49,347 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30061/index.html
2026-06-24 12:16:49,352 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30061/info.json
2026-06-24 12:16:49,353 main:
2026-06-24 12:16:49,353 main: ********************************************************************************
2026-06-24 12:16:49,353 main: Processing observation 31402
2026-06-24 12:16:49,353 main: ********************************************************************************
2026-06-24 12:16:49,354 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:49,355 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:51,213 __init__: ObsID 31402 has insufficient telemetry, skipping
2026-06-24 12:16:51,213 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31402/index.html
2026-06-24 12:16:51,217 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31402/info.json
2026-06-24 12:16:51,218 main:
2026-06-24 12:16:51,218 main: ********************************************************************************
2026-06-24 12:16:51,218 main: Processing observation 31403
2026-06-24 12:16:51,218 main: ********************************************************************************
2026-06-24 12:16:51,219 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31403/info.json file found, obs=None
2026-06-24 12:16:51,220 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-24 12:16:51,221 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-24 12:16:52,984 __init__: ObsID 31403 has no maneuver event in telemetry, skipping
2026-06-24 12:16:52,985 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31403/index.html
2026-06-24 12:16:52,989 info: could not get attribute kalman_start for obsid 31403
2026-06-24 12:16:52,989 info: could not get attribute kalman_stop for obsid 31403
2026-06-24 12:16:52,989 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31403/info.json
2026-06-24 12:16:52,990 main:
2026-06-24 13:16:54,661 run_check: Starting centroid dashboard continuity check
2026-06-24 13:16:54,661 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-06-24 13:16:54,662 collect_observations: Processing year 2020
2026-06-24 13:17:10,469 collect_observations: Processing year 2021
2026-06-24 13:17:13,415 collect_observations: Processing year 2022
2026-06-24 13:17:17,519 collect_observations: Processing year 2023
2026-06-24 13:17:49,728 collect_observations: Processing year 2024
2026-06-24 13:18:09,022 collect_observations: Processing year 2025
2026-06-24 13:18:35,317 collect_observations: Processing year 2026
2026-06-24 13:18:36,624 collect_observations: Collected 14090 observations from 4-digit years
2026-06-24 13:18:36,634 sort_observations_by_date: Sorted observations by date
2026-06-24 13:18:36,634 check_continuity: Starting continuity check from most recent: ObsID 31403 (JUN2226A) at 2026:175:10:31:57.963
2026-06-24 13:18:36,659 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-06-24 13:18:36,659 check_continuity: Chain complete: visited 14090 observations out of 14090 total
2026-06-24 13:18:36,659 run_check: ✓ Observation chain continuity check PASSED
2026-06-24 13:18:36,659 run_check: Summary: 14090 observations from 4-digit years, all properly linked