Prev
Index
Next
centroid_dashboard: Mon May 4 13:17:18 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Mon May 4 13:17:18 2026 |
No errors
File contents:
2026-05-04 13:16:08,011 main: Processing from 2026:117:17:16:08.011 to 2026:124:17:16:08.011
2026-05-04 13:16:15,380 get_observations: Found observation 30046 at 2026:117:20:36:56.590 with 1 manvrs
2026-05-04 13:16:15,380 get_observations: Found observation 32320 at 2026:118:03:28:14.369 with 1 manvrs
2026-05-04 13:16:15,381 get_observations: Found observation 32319 at 2026:118:08:23:07.028 with 1 manvrs
2026-05-04 13:16:15,381 get_observations: Found observation 29883 at 2026:118:15:21:04.757 with 1 manvrs
2026-05-04 13:16:15,381 get_observations: Found observation 41528 at 2026:118:18:50:19.464 with 1 manvrs
2026-05-04 13:16:15,382 get_observations: Found observation 41527 at 2026:118:20:55:40.252 with 1 manvrs
2026-05-04 13:16:15,382 get_observations: Found observation 41526 at 2026:118:23:55:40.252 with 1 manvrs
2026-05-04 13:16:15,383 get_observations: Found observation 41525 at 2026:119:01:55:40.252 with 1 manvrs
2026-05-04 13:16:15,383 get_observations: Found observation 41524 at 2026:119:03:55:40.252 with 1 manvrs
2026-05-04 13:16:15,383 get_observations: Found observation 41523 at 2026:119:05:55:40.252 with 1 manvrs
2026-05-04 13:16:15,384 get_observations: Found observation 31877 at 2026:119:07:27:52.176 with 1 manvrs
2026-05-04 13:16:15,384 get_observations: Found observation 31106 at 2026:119:11:50:14.616 with 1 manvrs
2026-05-04 13:16:15,385 get_observations: Found observation 31735 at 2026:120:04:56:27.922 with 1 manvrs
2026-05-04 13:16:15,385 get_observations: Found observation 32317 at 2026:120:13:44:14.591 with 1 manvrs
2026-05-04 13:16:15,385 get_observations: Found observation 30070 at 2026:120:17:50:58.106 with 1 manvrs
2026-05-04 13:16:15,386 get_observations: Found observation 32318 at 2026:121:05:38:02.108 with 1 manvrs
2026-05-04 13:16:15,386 get_observations: Found observation 41522 at 2026:121:11:17:26.474 with 1 manvrs
2026-05-04 13:16:15,387 get_observations: Found observation 41521 at 2026:121:13:55:40.252 with 1 manvrs
2026-05-04 13:16:15,387 get_observations: Found observation 41520 at 2026:121:15:55:40.252 with 1 manvrs
2026-05-04 13:16:15,387 get_observations: Found observation 41519 at 2026:121:17:55:40.252 with 1 manvrs
2026-05-04 13:16:15,388 get_observations: Found observation 41518 at 2026:121:19:10:40.252 with 1 manvrs
2026-05-04 13:16:15,389 get_observations: Found observation 41517 at 2026:121:20:45:40.252 with 1 manvrs
2026-05-04 13:16:15,389 get_observations: Found observation 32322 at 2026:121:22:25:41.491 with 1 manvrs
2026-05-04 13:16:15,389 get_observations: Found observation 26961 at 2026:122:02:57:58.117 with 1 manvrs
2026-05-04 13:16:15,390 get_observations: Found observation 31627 at 2026:122:18:07:50.491 with 1 manvrs
2026-05-04 13:16:15,390 get_observations: Found observation 32323 at 2026:123:03:38:55.561 with 1 manvrs
2026-05-04 13:16:15,391 get_observations: Found observation 31736 at 2026:123:07:48:08.429 with 1 manvrs
2026-05-04 13:16:15,391 get_observations: Found observation 32324 at 2026:123:19:50:36.292 with 1 manvrs
2026-05-04 13:16:15,391 get_observations: Found observation 30101 at 2026:123:23:52:41.275 with 1 manvrs
2026-05-04 13:16:15,392 get_observations: Found observation 41516 at 2026:124:03:17:31.114 with 1 manvrs
2026-05-04 13:16:15,392 get_observations: Found observation 41515 at 2026:124:06:55:40.252 with 1 manvrs
2026-05-04 13:16:15,393 get_observations: Found observation 41514 at 2026:124:08:55:40.252 with 1 manvrs
2026-05-04 13:16:15,393 get_observations: Found observation 41513 at 2026:124:11:55:40.252 with 1 manvrs
2026-05-04 13:16:15,393 get_observations: Found observation 32328 at 2026:124:14:25:15.614 with 1 manvrs
2026-05-04 13:16:15,394 main: Found 34 observations
2026-05-04 13:16:15,394 main: ********************************************************************************
2026-05-04 13:16:15,394 main: Processing observation 30046
2026-05-04 13:16:15,394 main: ********************************************************************************
2026-05-04 13:16:15,397 obs_link_from_info: Found prev obsid 30199
2026-05-04 13:16:15,400 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,402 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,404 process_obs: ObsID 30046 already processed, skipping
2026-05-04 13:16:15,404 main:
2026-05-04 13:16:15,404 main: ********************************************************************************
2026-05-04 13:16:15,404 main: Processing observation 32320
2026-05-04 13:16:15,404 main: ********************************************************************************
2026-05-04 13:16:15,405 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,406 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,410 process_obs: ObsID 32320 already processed, skipping
2026-05-04 13:16:15,410 main:
2026-05-04 13:16:15,410 main: ********************************************************************************
2026-05-04 13:16:15,410 main: Processing observation 32319
2026-05-04 13:16:15,410 main: ********************************************************************************
2026-05-04 13:16:15,411 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,412 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,415 process_obs: ObsID 32319 already processed, skipping
2026-05-04 13:16:15,415 main:
2026-05-04 13:16:15,415 main: ********************************************************************************
2026-05-04 13:16:15,415 main: Processing observation 29883
2026-05-04 13:16:15,415 main: ********************************************************************************
2026-05-04 13:16:15,416 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,417 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,420 process_obs: ObsID 29883 already processed, skipping
2026-05-04 13:16:15,420 main:
2026-05-04 13:16:15,420 main: ********************************************************************************
2026-05-04 13:16:15,420 main: Processing observation 41528
2026-05-04 13:16:15,420 main: ********************************************************************************
2026-05-04 13:16:15,421 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,422 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,425 process_obs: ObsID 41528 already processed, skipping
2026-05-04 13:16:15,425 main:
2026-05-04 13:16:15,425 main: ********************************************************************************
2026-05-04 13:16:15,425 main: Processing observation 41527
2026-05-04 13:16:15,425 main: ********************************************************************************
2026-05-04 13:16:15,426 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,427 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,431 process_obs: ObsID 41527 already processed, skipping
2026-05-04 13:16:15,431 main:
2026-05-04 13:16:15,431 main: ********************************************************************************
2026-05-04 13:16:15,431 main: Processing observation 41526
2026-05-04 13:16:15,431 main: ********************************************************************************
2026-05-04 13:16:15,432 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,433 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,436 process_obs: ObsID 41526 already processed, skipping
2026-05-04 13:16:15,436 main:
2026-05-04 13:16:15,436 main: ********************************************************************************
2026-05-04 13:16:15,436 main: Processing observation 41525
2026-05-04 13:16:15,436 main: ********************************************************************************
2026-05-04 13:16:15,437 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,438 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,441 process_obs: ObsID 41525 already processed, skipping
2026-05-04 13:16:15,441 main:
2026-05-04 13:16:15,441 main: ********************************************************************************
2026-05-04 13:16:15,441 main: Processing observation 41524
2026-05-04 13:16:15,441 main: ********************************************************************************
2026-05-04 13:16:15,442 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,443 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,446 process_obs: ObsID 41524 already processed, skipping
2026-05-04 13:16:15,446 main:
2026-05-04 13:16:15,446 main: ********************************************************************************
2026-05-04 13:16:15,446 main: Processing observation 41523
2026-05-04 13:16:15,446 main: ********************************************************************************
2026-05-04 13:16:15,447 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,448 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,451 process_obs: ObsID 41523 already processed, skipping
2026-05-04 13:16:15,451 main:
2026-05-04 13:16:15,451 main: ********************************************************************************
2026-05-04 13:16:15,451 main: Processing observation 31877
2026-05-04 13:16:15,451 main: ********************************************************************************
2026-05-04 13:16:15,452 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,453 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,456 process_obs: ObsID 31877 already processed, skipping
2026-05-04 13:16:15,456 main:
2026-05-04 13:16:15,456 main: ********************************************************************************
2026-05-04 13:16:15,456 main: Processing observation 31106
2026-05-04 13:16:15,456 main: ********************************************************************************
2026-05-04 13:16:15,457 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,458 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,462 process_obs: ObsID 31106 already processed, skipping
2026-05-04 13:16:15,462 main:
2026-05-04 13:16:15,462 main: ********************************************************************************
2026-05-04 13:16:15,462 main: Processing observation 31735
2026-05-04 13:16:15,462 main: ********************************************************************************
2026-05-04 13:16:15,463 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,464 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,467 process_obs: ObsID 31735 already processed, skipping
2026-05-04 13:16:15,467 main:
2026-05-04 13:16:15,467 main: ********************************************************************************
2026-05-04 13:16:15,467 main: Processing observation 32317
2026-05-04 13:16:15,467 main: ********************************************************************************
2026-05-04 13:16:15,468 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,469 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,472 process_obs: ObsID 32317 already processed, skipping
2026-05-04 13:16:15,472 main:
2026-05-04 13:16:15,472 main: ********************************************************************************
2026-05-04 13:16:15,472 main: Processing observation 30070
2026-05-04 13:16:15,472 main: ********************************************************************************
2026-05-04 13:16:15,473 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,474 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,477 process_obs: ObsID 30070 already processed, skipping
2026-05-04 13:16:15,477 main:
2026-05-04 13:16:15,477 main: ********************************************************************************
2026-05-04 13:16:15,477 main: Processing observation 32318
2026-05-04 13:16:15,477 main: ********************************************************************************
2026-05-04 13:16:15,478 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,479 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,493 process_obs: ObsID 32318 already processed, skipping
2026-05-04 13:16:15,493 main:
2026-05-04 13:16:15,493 main: ********************************************************************************
2026-05-04 13:16:15,493 main: Processing observation 41522
2026-05-04 13:16:15,493 main: ********************************************************************************
2026-05-04 13:16:15,494 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,495 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,498 process_obs: ObsID 41522 already processed, skipping
2026-05-04 13:16:15,498 main:
2026-05-04 13:16:15,498 main: ********************************************************************************
2026-05-04 13:16:15,498 main: Processing observation 41521
2026-05-04 13:16:15,498 main: ********************************************************************************
2026-05-04 13:16:15,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,516 process_obs: ObsID 41521 already processed, skipping
2026-05-04 13:16:15,517 main:
2026-05-04 13:16:15,517 main: ********************************************************************************
2026-05-04 13:16:15,517 main: Processing observation 41520
2026-05-04 13:16:15,517 main: ********************************************************************************
2026-05-04 13:16:15,518 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,519 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,584 process_obs: ObsID 41520 already processed, skipping
2026-05-04 13:16:15,584 main:
2026-05-04 13:16:15,584 main: ********************************************************************************
2026-05-04 13:16:15,585 main: Processing observation 41519
2026-05-04 13:16:15,585 main: ********************************************************************************
2026-05-04 13:16:15,586 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,587 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,598 process_obs: ObsID 41519 already processed, skipping
2026-05-04 13:16:15,598 main:
2026-05-04 13:16:15,598 main: ********************************************************************************
2026-05-04 13:16:15,598 main: Processing observation 41518
2026-05-04 13:16:15,598 main: ********************************************************************************
2026-05-04 13:16:15,599 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,600 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,612 process_obs: ObsID 41518 already processed, skipping
2026-05-04 13:16:15,612 main:
2026-05-04 13:16:15,612 main: ********************************************************************************
2026-05-04 13:16:15,612 main: Processing observation 41517
2026-05-04 13:16:15,612 main: ********************************************************************************
2026-05-04 13:16:15,613 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,614 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,632 process_obs: ObsID 41517 already processed, skipping
2026-05-04 13:16:15,632 main:
2026-05-04 13:16:15,632 main: ********************************************************************************
2026-05-04 13:16:15,632 main: Processing observation 32322
2026-05-04 13:16:15,632 main: ********************************************************************************
2026-05-04 13:16:15,633 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,634 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 13:16:15,654 process_obs: ObsID 32322 already processed, skipping
2026-05-04 13:16:15,654 main:
2026-05-04 13:16:15,654 main: ********************************************************************************
2026-05-04 13:16:15,654 main: Processing observation 26961
2026-05-04 13:16:15,654 main: ********************************************************************************
2026-05-04 13:16:15,655 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 13:16:15,656 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 12:16:18,460 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/centroid_resids.pkl
2026-05-04 12:16:18,519 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-04 12:16:18,520 plot_crs_time: Plot file exists, skipping
2026-05-04 12:16:18,520 plot_crs_scatter: Plot file exists, skipping
2026-05-04 12:16:18,785 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-04 12:16:18,961 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/n_kalman_delta_roll.png
2026-05-04 12:16:21,959 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/index.html
2026-05-04 12:16:21,961 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/26961/info.json
2026-05-04 12:16:21,975 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/26/26961/index.html
2026-05-04 12:16:21,976 main:
2026-05-04 12:16:21,976 main: ********************************************************************************
2026-05-04 12:16:21,976 main: Processing observation 31627
2026-05-04 12:16:21,976 main: ********************************************************************************
2026-05-04 12:16:21,977 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:21,979 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 12:16:24,119 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-04 12:16:24,462 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/centroid_resids.pkl with 5 slots
2026-05-04 12:16:24,522 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/centroid_resids_time.png
2026-05-04 12:16:24,858 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/centroid_resids_scatter.png
2026-05-04 12:16:27,119 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/n_kalman_delta_roll.png
2026-05-04 12:16:27,275 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/index.html
2026-05-04 12:16:27,277 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31627/info.json
2026-05-04 12:16:27,291 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31627/index.html
2026-05-04 12:16:27,292 main:
2026-05-04 12:16:27,292 main: ********************************************************************************
2026-05-04 12:16:27,292 main: Processing observation 32323
2026-05-04 12:16:27,292 main: ********************************************************************************
2026-05-04 12:16:27,293 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:27,294 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 12:16:29,664 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-04 12:16:30,334 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/centroid_resids.pkl with 5 slots
2026-05-04 12:16:30,399 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/centroid_resids_time.png
2026-05-04 12:16:30,703 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/centroid_resids_scatter.png
2026-05-04 12:16:32,692 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/n_kalman_delta_roll.png
2026-05-04 12:16:32,837 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/index.html
2026-05-04 12:16:32,839 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32323/info.json
2026-05-04 12:16:32,841 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32323/index.html
2026-05-04 12:16:32,842 main:
2026-05-04 12:16:32,842 main: ********************************************************************************
2026-05-04 12:16:32,842 main: Processing observation 31736
2026-05-04 12:16:32,842 main: ********************************************************************************
2026-05-04 12:16:32,843 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:32,844 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 12:16:35,374 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-04 12:16:36,216 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/centroid_resids.pkl with 5 slots
2026-05-04 12:16:36,285 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/centroid_resids_time.png
2026-05-04 12:16:36,599 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/centroid_resids_scatter.png
2026-05-04 12:16:36,889 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-04 12:16:37,010 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/n_kalman_delta_roll.png
2026-05-04 12:16:37,134 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/index.html
2026-05-04 12:16:37,136 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31736/info.json
2026-05-04 12:16:37,138 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31736/index.html
2026-05-04 12:16:37,139 main:
2026-05-04 12:16:37,139 main: ********************************************************************************
2026-05-04 12:16:37,139 main: Processing observation 32324
2026-05-04 12:16:37,139 main: ********************************************************************************
2026-05-04 12:16:37,148 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:37,149 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-04 12:16:39,632 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-04 12:16:40,148 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32324/centroid_resids.pkl with 5 slots
2026-05-04 12:16:40,199 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32324/centroid_resids_time.png
2026-05-04 12:16:40,457 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32324/centroid_resids_scatter.png
2026-05-04 12:16:41,797 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32324/n_kalman_delta_roll.png
2026-05-04 12:16:41,942 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32324/index.html
2026-05-04 12:16:41,944 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32324/info.json
2026-05-04 12:16:41,946 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32324/index.html
2026-05-04 12:16:41,947 main:
2026-05-04 12:16:41,947 main: ********************************************************************************
2026-05-04 12:16:41,947 main: Processing observation 30101
2026-05-04 12:16:41,947 main: ********************************************************************************
2026-05-04 12:16:41,949 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:41,950 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-04 12:16:44,105 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-04 12:16:44,446 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30101/centroid_resids.pkl with 5 slots
2026-05-04 12:16:44,491 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30101/centroid_resids_time.png
2026-05-04 12:16:44,729 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30101/centroid_resids_scatter.png
2026-05-04 12:16:44,880 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-04 12:16:45,021 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30101/n_kalman_delta_roll.png
2026-05-04 12:16:45,147 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30101/index.html
2026-05-04 12:16:45,148 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30101/info.json
2026-05-04 12:16:45,173 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30101/index.html
2026-05-04 12:16:45,174 main:
2026-05-04 12:16:45,174 main: ********************************************************************************
2026-05-04 12:16:45,174 main: Processing observation 41516
2026-05-04 12:16:45,174 main: ********************************************************************************
2026-05-04 12:16:45,176 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:45,177 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-04 12:16:47,250 __init__: ObsID 41516 has insufficient telemetry, skipping
2026-05-04 12:16:47,250 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41516/index.html
2026-05-04 12:16:47,255 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41516/info.json
2026-05-04 12:16:47,256 main:
2026-05-04 12:16:47,256 main: ********************************************************************************
2026-05-04 12:16:47,256 main: Processing observation 41515
2026-05-04 12:16:47,256 main: ********************************************************************************
2026-05-04 12:16:47,257 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:47,258 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-04 12:16:49,256 __init__: ObsID 41515 has insufficient telemetry, skipping
2026-05-04 12:16:49,256 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41515/index.html
2026-05-04 12:16:49,262 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41515/info.json
2026-05-04 12:16:49,263 main:
2026-05-04 12:16:49,263 main: ********************************************************************************
2026-05-04 12:16:49,263 main: Processing observation 41514
2026-05-04 12:16:49,263 main: ********************************************************************************
2026-05-04 12:16:49,264 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:49,265 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-04 12:16:51,320 __init__: ObsID 41514 has insufficient telemetry, skipping
2026-05-04 12:16:51,321 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41514/index.html
2026-05-04 12:16:51,325 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41514/info.json
2026-05-04 12:16:51,326 main:
2026-05-04 12:16:51,326 main: ********************************************************************************
2026-05-04 12:16:51,326 main: Processing observation 41513
2026-05-04 12:16:51,326 main: ********************************************************************************
2026-05-04 12:16:51,327 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:51,328 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-04 12:16:53,356 __init__: ObsID 41513 has insufficient telemetry, skipping
2026-05-04 12:16:53,357 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41513/index.html
2026-05-04 12:16:53,361 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41513/info.json
2026-05-04 12:16:53,362 main:
2026-05-04 12:16:53,362 main: ********************************************************************************
2026-05-04 12:16:53,362 main: Processing observation 32328
2026-05-04 12:16:53,362 main: ********************************************************************************
2026-05-04 12:16:53,362 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32328/info.json file found, obs=None
2026-05-04 12:16:53,364 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-04 12:16:53,365 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-04 12:16:55,344 __init__: ObsID 32328 has no maneuver event in telemetry, skipping
2026-05-04 12:16:55,345 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32328/index.html
2026-05-04 12:16:55,349 info: could not get attribute kalman_start for obsid 32328
2026-05-04 12:16:55,349 info: could not get attribute kalman_stop for obsid 32328
2026-05-04 12:16:55,349 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32328/info.json
2026-05-04 12:16:55,350 main:
2026-05-04 13:16:56,723 run_check: Starting centroid dashboard continuity check
2026-05-04 13:16:56,724 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-04 13:16:56,725 collect_observations: Processing year 2020
2026-05-04 13:16:58,501 collect_observations: Processing year 2021
2026-05-04 13:17:01,491 collect_observations: Processing year 2022
2026-05-04 13:17:08,537 collect_observations: Processing year 2023
2026-05-04 13:17:11,601 collect_observations: Processing year 2024
2026-05-04 13:17:14,390 collect_observations: Processing year 2025
2026-05-04 13:17:17,255 collect_observations: Processing year 2026
2026-05-04 13:17:18,085 collect_observations: Collected 13808 observations from 4-digit years
2026-05-04 13:17:18,089 sort_observations_by_date: Sorted observations by date
2026-05-04 13:17:18,089 check_continuity: Starting continuity check from most recent: ObsID 32328 (MAY0426A) at 2026:124:13:58:39.360
2026-05-04 13:17:18,106 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-04 13:17:18,106 check_continuity: Chain complete: visited 13808 observations out of 13808 total
2026-05-04 13:17:18,106 run_check: ✓ Observation chain continuity check PASSED
2026-05-04 13:17:18,106 run_check: Summary: 13808 observations from 4-digit years, all properly linked