Prev
Index
Next
centroid_dashboard: Mon Apr 27 13:17:45 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Mon Apr 27 13:17:45 2026 |
No errors
File contents:
2026-04-27 13:16:11,750 main: Processing from 2026:110:17:16:11.748 to 2026:117:17:16:11.748
2026-04-27 13:16:20,371 get_observations: Found observation 41541 at 2026:110:21:54:48.530 with 1 manvrs
2026-04-27 13:16:20,372 get_observations: Found observation 41540 at 2026:110:23:26:21.224 with 1 manvrs
2026-04-27 13:16:20,372 get_observations: Found observation 41539 at 2026:111:02:55:40.252 with 1 manvrs
2026-04-27 13:16:20,373 get_observations: Found observation 41538 at 2026:111:06:10:40.252 with 1 manvrs
2026-04-27 13:16:20,373 get_observations: Found observation 41537 at 2026:111:07:15:19.088 with 1 manvrs
2026-04-27 13:16:20,374 get_observations: Found observation 31864 at 2026:111:08:27:40.800 with 1 manvrs
2026-04-27 13:16:20,374 get_observations: Found observation 30180 at 2026:111:13:00:22.836 with 1 manvrs
2026-04-27 13:16:20,374 get_observations: Found observation 30026 at 2026:111:16:58:43.849 with 1 manvrs
2026-04-27 13:16:20,375 get_observations: Found observation 29863 at 2026:111:23:05:39.794 with 1 manvrs
2026-04-27 13:16:20,375 get_observations: Found observation 32311 at 2026:112:12:54:20.449 with 1 manvrs
2026-04-27 13:16:20,376 get_observations: Found observation 32309 at 2026:112:19:51:48.037 with 1 manvrs
2026-04-27 13:16:20,376 get_observations: Found observation 31516 at 2026:113:00:40:53.146 with 1 manvrs
2026-04-27 13:16:20,376 get_observations: Found observation 32310 at 2026:113:05:13:20.917 with 1 manvrs
2026-04-27 13:16:20,377 get_observations: Found observation 31399 at 2026:113:08:30:22.198 with 1 manvrs
2026-04-27 13:16:20,377 get_observations: Found observation 41536 at 2026:113:11:56:08.483 with 1 manvrs
2026-04-27 13:16:20,378 get_observations: Found observation 41535 at 2026:113:12:59:34.314 with 1 manvrs
2026-04-27 13:16:20,378 get_observations: Found observation 41534 at 2026:113:17:55:40.252 with 1 manvrs
2026-04-27 13:16:20,378 get_observations: Found observation 41533 at 2026:113:21:54:40.252 with 1 manvrs
2026-04-27 13:16:20,379 get_observations: Found observation 32312 at 2026:113:23:35:50.205 with 1 manvrs
2026-04-27 13:16:20,379 get_observations: Found observation 30024 at 2026:114:05:27:29.527 with 1 manvrs
2026-04-27 13:16:20,380 get_observations: Found observation 32313 at 2026:114:09:39:12.814 with 1 manvrs
2026-04-27 13:16:20,380 get_observations: Found observation 31734 at 2026:114:15:17:19.167 with 1 manvrs
2026-04-27 13:16:20,380 get_observations: Found observation 32307 at 2026:115:02:41:28.729 with 1 manvrs
2026-04-27 13:16:20,381 get_observations: Found observation 32314 at 2026:115:06:06:59.496 with 1 manvrs
2026-04-27 13:16:20,381 get_observations: Found observation 31083 at 2026:115:09:26:38.721 with 1 manvrs
2026-04-27 13:16:20,382 get_observations: Found observation 32315 at 2026:115:14:42:57.679 with 1 manvrs
2026-04-27 13:16:20,382 get_observations: Found observation 29530 at 2026:115:17:58:03.618 with 1 manvrs
2026-04-27 13:16:20,382 get_observations: Found observation 29867 at 2026:115:19:25:52.373 with 1 manvrs
2026-04-27 13:16:20,383 get_observations: Found observation 41532 at 2026:116:03:09:33.391 with 1 manvrs
2026-04-27 13:16:20,383 get_observations: Found observation 41531 at 2026:116:06:55:40.252 with 1 manvrs
2026-04-27 13:16:20,384 get_observations: Found observation 41530 at 2026:116:10:25:40.252 with 1 manvrs
2026-04-27 13:16:20,384 get_observations: Found observation 41529 at 2026:116:12:55:40.252 with 1 manvrs
2026-04-27 13:16:20,384 get_observations: Found observation 32308 at 2026:116:15:53:31.989 with 1 manvrs
2026-04-27 13:16:20,385 get_observations: Found observation 32316 at 2026:116:22:28:40.593 with 1 manvrs
2026-04-27 13:16:20,385 get_observations: Found observation 30228 at 2026:117:01:55:38.939 with 1 manvrs
2026-04-27 13:16:20,386 get_observations: Found observation 30189 at 2026:117:05:58:23.023 with 1 manvrs
2026-04-27 13:16:20,386 get_observations: Found observation 32321 at 2026:117:09:52:53.399 with 1 manvrs
2026-04-27 13:16:20,386 get_observations: Found observation 30199 at 2026:117:15:35:45.774 with 1 manvrs
2026-04-27 13:16:20,387 main: Found 38 observations
2026-04-27 13:16:20,387 main: ********************************************************************************
2026-04-27 13:16:20,387 main: Processing observation 41541
2026-04-27 13:16:20,387 main: ********************************************************************************
2026-04-27 13:16:20,391 obs_link_from_info: Found prev obsid 29880
2026-04-27 13:16:20,394 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,395 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 13:16:20,398 process_obs: ObsID 41541 already processed, skipping
2026-04-27 13:16:20,398 main:
2026-04-27 13:16:20,398 main: ********************************************************************************
2026-04-27 13:16:20,398 main: Processing observation 41540
2026-04-27 13:16:20,398 main: ********************************************************************************
2026-04-27 13:16:20,399 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,400 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 13:16:20,404 process_obs: ObsID 41540 already processed, skipping
2026-04-27 13:16:20,404 main:
2026-04-27 13:16:20,404 main: ********************************************************************************
2026-04-27 13:16:20,404 main: Processing observation 41539
2026-04-27 13:16:20,404 main: ********************************************************************************
2026-04-27 13:16:20,405 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,406 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 13:16:20,409 process_obs: ObsID 41539 already processed, skipping
2026-04-27 13:16:20,409 main:
2026-04-27 13:16:20,409 main: ********************************************************************************
2026-04-27 13:16:20,409 main: Processing observation 41538
2026-04-27 13:16:20,409 main: ********************************************************************************
2026-04-27 13:16:20,410 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,411 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 13:16:20,414 process_obs: ObsID 41538 already processed, skipping
2026-04-27 13:16:20,414 main:
2026-04-27 13:16:20,414 main: ********************************************************************************
2026-04-27 13:16:20,414 main: Processing observation 41537
2026-04-27 13:16:20,414 main: ********************************************************************************
2026-04-27 13:16:20,415 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,416 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 13:16:20,420 process_obs: ObsID 41537 already processed, skipping
2026-04-27 13:16:20,420 main:
2026-04-27 13:16:20,420 main: ********************************************************************************
2026-04-27 13:16:20,420 main: Processing observation 31864
2026-04-27 13:16:20,420 main: ********************************************************************************
2026-04-27 13:16:20,421 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,422 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 13:16:20,425 process_obs: ObsID 31864 already processed, skipping
2026-04-27 13:16:20,425 main:
2026-04-27 13:16:20,425 main: ********************************************************************************
2026-04-27 13:16:20,425 main: Processing observation 30180
2026-04-27 13:16:20,425 main: ********************************************************************************
2026-04-27 13:16:20,426 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,427 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 13:16:20,431 process_obs: ObsID 30180 already processed, skipping
2026-04-27 13:16:20,431 main:
2026-04-27 13:16:20,431 main: ********************************************************************************
2026-04-27 13:16:20,431 main: Processing observation 30026
2026-04-27 13:16:20,431 main: ********************************************************************************
2026-04-27 13:16:20,432 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 13:16:20,433 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:22,897 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/centroid_resids.pkl
2026-04-27 12:16:22,903 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-27 12:16:22,903 plot_crs_time: Plot file exists, skipping
2026-04-27 12:16:22,903 plot_crs_scatter: Plot file exists, skipping
2026-04-27 12:16:23,058 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-27 12:16:24,067 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/n_kalman_delta_roll.png
2026-04-27 12:16:27,241 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/index.html
2026-04-27 12:16:27,245 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/info.json
2026-04-27 12:16:27,250 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30026/index.html
2026-04-27 12:16:27,251 main:
2026-04-27 12:16:27,251 main: ********************************************************************************
2026-04-27 12:16:27,251 main: Processing observation 29863
2026-04-27 12:16:27,251 main: ********************************************************************************
2026-04-27 12:16:27,252 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,253 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,263 process_obs: ObsID 29863 already processed, skipping
2026-04-27 12:16:27,263 main:
2026-04-27 12:16:27,263 main: ********************************************************************************
2026-04-27 12:16:27,263 main: Processing observation 32311
2026-04-27 12:16:27,263 main: ********************************************************************************
2026-04-27 12:16:27,267 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,272 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,279 process_obs: ObsID 32311 already processed, skipping
2026-04-27 12:16:27,279 main:
2026-04-27 12:16:27,279 main: ********************************************************************************
2026-04-27 12:16:27,279 main: Processing observation 32309
2026-04-27 12:16:27,279 main: ********************************************************************************
2026-04-27 12:16:27,280 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,281 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,293 process_obs: ObsID 32309 already processed, skipping
2026-04-27 12:16:27,293 main:
2026-04-27 12:16:27,293 main: ********************************************************************************
2026-04-27 12:16:27,293 main: Processing observation 31516
2026-04-27 12:16:27,293 main: ********************************************************************************
2026-04-27 12:16:27,296 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,299 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,312 process_obs: ObsID 31516 already processed, skipping
2026-04-27 12:16:27,312 main:
2026-04-27 12:16:27,312 main: ********************************************************************************
2026-04-27 12:16:27,312 main: Processing observation 32310
2026-04-27 12:16:27,312 main: ********************************************************************************
2026-04-27 12:16:27,316 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,319 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,332 process_obs: ObsID 32310 already processed, skipping
2026-04-27 12:16:27,332 main:
2026-04-27 12:16:27,332 main: ********************************************************************************
2026-04-27 12:16:27,332 main: Processing observation 31399
2026-04-27 12:16:27,332 main: ********************************************************************************
2026-04-27 12:16:27,344 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,348 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,364 process_obs: ObsID 31399 already processed, skipping
2026-04-27 12:16:27,364 main:
2026-04-27 12:16:27,364 main: ********************************************************************************
2026-04-27 12:16:27,364 main: Processing observation 41536
2026-04-27 12:16:27,364 main: ********************************************************************************
2026-04-27 12:16:27,367 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,372 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,386 process_obs: ObsID 41536 already processed, skipping
2026-04-27 12:16:27,386 main:
2026-04-27 12:16:27,386 main: ********************************************************************************
2026-04-27 12:16:27,386 main: Processing observation 41535
2026-04-27 12:16:27,386 main: ********************************************************************************
2026-04-27 12:16:27,388 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,389 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,392 process_obs: ObsID 41535 already processed, skipping
2026-04-27 12:16:27,392 main:
2026-04-27 12:16:27,392 main: ********************************************************************************
2026-04-27 12:16:27,392 main: Processing observation 41534
2026-04-27 12:16:27,392 main: ********************************************************************************
2026-04-27 12:16:27,393 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,394 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,397 process_obs: ObsID 41534 already processed, skipping
2026-04-27 12:16:27,398 main:
2026-04-27 12:16:27,398 main: ********************************************************************************
2026-04-27 12:16:27,398 main: Processing observation 41533
2026-04-27 12:16:27,398 main: ********************************************************************************
2026-04-27 12:16:27,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,405 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,435 process_obs: ObsID 41533 already processed, skipping
2026-04-27 12:16:27,435 main:
2026-04-27 12:16:27,435 main: ********************************************************************************
2026-04-27 12:16:27,436 main: Processing observation 32312
2026-04-27 12:16:27,436 main: ********************************************************************************
2026-04-27 12:16:27,441 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,444 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,458 process_obs: ObsID 32312 already processed, skipping
2026-04-27 12:16:27,458 main:
2026-04-27 12:16:27,458 main: ********************************************************************************
2026-04-27 12:16:27,458 main: Processing observation 30024
2026-04-27 12:16:27,458 main: ********************************************************************************
2026-04-27 12:16:27,462 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,466 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,482 process_obs: ObsID 30024 already processed, skipping
2026-04-27 12:16:27,482 main:
2026-04-27 12:16:27,482 main: ********************************************************************************
2026-04-27 12:16:27,482 main: Processing observation 32313
2026-04-27 12:16:27,482 main: ********************************************************************************
2026-04-27 12:16:27,488 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:27,513 process_obs: ObsID 32313 already processed, skipping
2026-04-27 12:16:27,513 main:
2026-04-27 12:16:27,513 main: ********************************************************************************
2026-04-27 12:16:27,513 main: Processing observation 31734
2026-04-27 12:16:27,513 main: ********************************************************************************
2026-04-27 12:16:27,521 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:27,526 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:34,841 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/centroid_resids.pkl
2026-04-27 12:16:34,864 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-27 12:16:34,864 plot_crs_time: Plot file exists, skipping
2026-04-27 12:16:34,865 plot_crs_scatter: Plot file exists, skipping
2026-04-27 12:16:34,992 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-27 12:16:35,099 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/n_kalman_delta_roll.png
2026-04-27 12:16:41,083 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/index.html
2026-04-27 12:16:41,087 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/info.json
2026-04-27 12:16:41,095 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31734/index.html
2026-04-27 12:16:41,099 main:
2026-04-27 12:16:41,099 main: ********************************************************************************
2026-04-27 12:16:41,099 main: Processing observation 32307
2026-04-27 12:16:41,099 main: ********************************************************************************
2026-04-27 12:16:41,104 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:41,110 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:41,138 process_obs: ObsID 32307 already processed, skipping
2026-04-27 12:16:41,138 main:
2026-04-27 12:16:41,138 main: ********************************************************************************
2026-04-27 12:16:41,138 main: Processing observation 32314
2026-04-27 12:16:41,138 main: ********************************************************************************
2026-04-27 12:16:41,142 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:41,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:41,169 process_obs: ObsID 32314 already processed, skipping
2026-04-27 12:16:41,169 main:
2026-04-27 12:16:41,169 main: ********************************************************************************
2026-04-27 12:16:41,169 main: Processing observation 31083
2026-04-27 12:16:41,169 main: ********************************************************************************
2026-04-27 12:16:41,173 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:41,178 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:45,426 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/centroid_resids.pkl
2026-04-27 12:16:45,466 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-27 12:16:45,467 plot_crs_time: Plot file exists, skipping
2026-04-27 12:16:45,469 plot_crs_scatter: Plot file exists, skipping
2026-04-27 12:16:46,179 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/n_kalman_delta_roll.png
2026-04-27 12:16:53,195 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/index.html
2026-04-27 12:16:53,197 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/info.json
2026-04-27 12:16:53,211 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31083/index.html
2026-04-27 12:16:53,213 main:
2026-04-27 12:16:53,213 main: ********************************************************************************
2026-04-27 12:16:53,213 main: Processing observation 32315
2026-04-27 12:16:53,213 main: ********************************************************************************
2026-04-27 12:16:53,214 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:53,215 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:55,352 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/centroid_resids.pkl
2026-04-27 12:16:55,366 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-27 12:16:55,366 plot_crs_time: Plot file exists, skipping
2026-04-27 12:16:55,366 plot_crs_scatter: Plot file exists, skipping
2026-04-27 12:16:55,929 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/n_kalman_delta_roll.png
2026-04-27 12:16:56,072 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/index.html
2026-04-27 12:16:56,073 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/info.json
2026-04-27 12:16:56,089 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32315/index.html
2026-04-27 12:16:56,089 main:
2026-04-27 12:16:56,090 main: ********************************************************************************
2026-04-27 12:16:56,090 main: Processing observation 29530
2026-04-27 12:16:56,090 main: ********************************************************************************
2026-04-27 12:16:56,091 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:56,092 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:16:58,142 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/centroid_resids.pkl
2026-04-27 12:16:58,152 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-27 12:16:58,152 plot_crs_time: Plot file exists, skipping
2026-04-27 12:16:58,152 plot_crs_scatter: Plot file exists, skipping
2026-04-27 12:16:58,690 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/n_kalman_delta_roll.png
2026-04-27 12:16:58,832 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/index.html
2026-04-27 12:16:58,834 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/info.json
2026-04-27 12:16:58,843 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29530/index.html
2026-04-27 12:16:58,844 main:
2026-04-27 12:16:58,844 main: ********************************************************************************
2026-04-27 12:16:58,844 main: Processing observation 29867
2026-04-27 12:16:58,844 main: ********************************************************************************
2026-04-27 12:16:58,845 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:16:58,846 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:17:01,087 __init__: ObsID 29867 has insufficient telemetry, skipping
2026-04-27 12:17:01,089 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29867/index.html
2026-04-27 12:17:01,097 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29867/info.json
2026-04-27 12:17:01,099 main:
2026-04-27 12:17:01,099 main: ********************************************************************************
2026-04-27 12:17:01,099 main: Processing observation 41532
2026-04-27 12:17:01,099 main: ********************************************************************************
2026-04-27 12:17:01,102 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:01,104 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:17:03,877 __init__: ObsID 41532 has insufficient telemetry, skipping
2026-04-27 12:17:03,878 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41532/index.html
2026-04-27 12:17:03,890 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41532/info.json
2026-04-27 12:17:03,894 main:
2026-04-27 12:17:03,895 main: ********************************************************************************
2026-04-27 12:17:03,895 main: Processing observation 41531
2026-04-27 12:17:03,895 main: ********************************************************************************
2026-04-27 12:17:03,896 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:03,897 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:17:08,536 __init__: ObsID 41531 has insufficient telemetry, skipping
2026-04-27 12:17:08,537 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41531/index.html
2026-04-27 12:17:08,541 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41531/info.json
2026-04-27 12:17:08,542 main:
2026-04-27 12:17:08,542 main: ********************************************************************************
2026-04-27 12:17:08,542 main: Processing observation 41530
2026-04-27 12:17:08,542 main: ********************************************************************************
2026-04-27 12:17:08,543 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:08,544 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:17:10,652 __init__: ObsID 41530 has insufficient telemetry, skipping
2026-04-27 12:17:10,652 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41530/index.html
2026-04-27 12:17:10,657 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41530/info.json
2026-04-27 12:17:10,658 main:
2026-04-27 12:17:10,658 main: ********************************************************************************
2026-04-27 12:17:10,658 main: Processing observation 41529
2026-04-27 12:17:10,658 main: ********************************************************************************
2026-04-27 12:17:10,659 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:10,660 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:17:12,667 __init__: ObsID 41529 has insufficient telemetry, skipping
2026-04-27 12:17:12,667 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41529/index.html
2026-04-27 12:17:12,671 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41529/info.json
2026-04-27 12:17:12,673 main:
2026-04-27 12:17:12,673 main: ********************************************************************************
2026-04-27 12:17:12,673 main: Processing observation 32308
2026-04-27 12:17:12,673 main: ********************************************************************************
2026-04-27 12:17:12,674 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:12,675 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:17:14,764 __init__: ObsID 32308 has insufficient telemetry, skipping
2026-04-27 12:17:14,765 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32308/index.html
2026-04-27 12:17:14,769 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32308/info.json
2026-04-27 12:17:14,770 main:
2026-04-27 12:17:14,770 main: ********************************************************************************
2026-04-27 12:17:14,770 main: Processing observation 32316
2026-04-27 12:17:14,770 main: ********************************************************************************
2026-04-27 12:17:14,771 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:14,772 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-27 12:17:16,852 __init__: ObsID 32316 has insufficient telemetry, skipping
2026-04-27 12:17:16,852 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32316/index.html
2026-04-27 12:17:16,857 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32316/info.json
2026-04-27 12:17:16,858 main:
2026-04-27 12:17:16,858 main: ********************************************************************************
2026-04-27 12:17:16,858 main: Processing observation 30228
2026-04-27 12:17:16,858 main: ********************************************************************************
2026-04-27 12:17:16,860 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:16,861 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-27 12:17:18,948 __init__: ObsID 30228 has insufficient telemetry, skipping
2026-04-27 12:17:18,948 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30228/index.html
2026-04-27 12:17:18,962 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30228/info.json
2026-04-27 12:17:18,963 main:
2026-04-27 12:17:18,963 main: ********************************************************************************
2026-04-27 12:17:18,963 main: Processing observation 30189
2026-04-27 12:17:18,963 main: ********************************************************************************
2026-04-27 12:17:18,964 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:18,965 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-27 12:17:21,052 __init__: ObsID 30189 has insufficient telemetry, skipping
2026-04-27 12:17:21,053 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30189/index.html
2026-04-27 12:17:21,057 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30189/info.json
2026-04-27 12:17:21,058 main:
2026-04-27 12:17:21,058 main: ********************************************************************************
2026-04-27 12:17:21,058 main: Processing observation 32321
2026-04-27 12:17:21,058 main: ********************************************************************************
2026-04-27 12:17:21,059 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:21,060 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-27 12:17:23,110 __init__: ObsID 32321 has no maneuver event in telemetry, skipping
2026-04-27 12:17:23,111 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32321/index.html
2026-04-27 12:17:23,115 info: could not get attribute kalman_start for obsid 32321
2026-04-27 12:17:23,115 info: could not get attribute kalman_stop for obsid 32321
2026-04-27 12:17:23,115 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32321/info.json
2026-04-27 12:17:23,116 main:
2026-04-27 12:17:23,116 main: ********************************************************************************
2026-04-27 12:17:23,116 main: Processing observation 30199
2026-04-27 12:17:23,116 main: ********************************************************************************
2026-04-27 12:17:23,117 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30199/info.json file found, obs=None
2026-04-27 12:17:23,118 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-27 12:17:23,119 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-27 12:17:25,153 __init__: ObsID 30199 has no maneuver event in telemetry, skipping
2026-04-27 12:17:25,153 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30199/index.html
2026-04-27 12:17:25,158 info: could not get attribute kalman_start for obsid 30199
2026-04-27 12:17:25,158 info: could not get attribute kalman_stop for obsid 30199
2026-04-27 12:17:25,158 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30199/info.json
2026-04-27 12:17:25,159 main:
2026-04-27 13:17:26,533 run_check: Starting centroid dashboard continuity check
2026-04-27 13:17:26,533 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-27 13:17:26,535 collect_observations: Processing year 2020
2026-04-27 13:17:28,538 collect_observations: Processing year 2021
2026-04-27 13:17:31,473 collect_observations: Processing year 2022
2026-04-27 13:17:34,850 collect_observations: Processing year 2023
2026-04-27 13:17:38,075 collect_observations: Processing year 2024
2026-04-27 13:17:41,229 collect_observations: Processing year 2025
2026-04-27 13:17:44,497 collect_observations: Processing year 2026
2026-04-27 13:17:45,262 collect_observations: Collected 13774 observations from 4-digit years
2026-04-27 13:17:45,273 sort_observations_by_date: Sorted observations by date
2026-04-27 13:17:45,273 check_continuity: Starting continuity check from most recent: ObsID 30199 (APR2726A) at 2026:117:14:57:19.147
2026-04-27 13:17:45,295 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-27 13:17:45,295 check_continuity: Chain complete: visited 13774 observations out of 13774 total
2026-04-27 13:17:45,296 run_check: ✓ Observation chain continuity check PASSED
2026-04-27 13:17:45,296 run_check: Summary: 13774 observations from 4-digit years, all properly linked