Prev
Index
Next
centroid_dashboard: Fri Dec 19 13:17:20 2025
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Fri Dec 19 13:17:20 2025 |
No errors
File contents:
2025-12-19 13:16:11,451 main: Processing from 2025:346:18:16:11.450 to 2025:353:18:16:11.450
2025-12-19 13:16:18,467 get_observations: Found observation 41888 at 2025:346:18:59:52.814 with 1 manvrs
2025-12-19 13:16:18,468 get_observations: Found observation 32039 at 2025:346:20:20:21.976 with 1 manvrs
2025-12-19 13:16:18,468 get_observations: Found observation 30299 at 2025:347:00:57:39.597 with 2 manvrs
2025-12-19 13:16:18,469 get_observations: Found observation 41886 at 2025:347:06:00:31.454 with 1 manvrs
2025-12-19 13:16:18,469 get_observations: Found observation 30050 at 2025:347:07:03:35.296 with 1 manvrs
2025-12-19 13:16:18,470 get_observations: Found observation 41885 at 2025:347:12:05:49.477 with 1 manvrs
2025-12-19 13:16:18,470 get_observations: Found observation 32042 at 2025:347:12:51:15.781 with 1 manvrs
2025-12-19 13:16:18,471 get_observations: Found observation 41884 at 2025:347:17:39:09.617 with 1 manvrs
2025-12-19 13:16:18,471 get_observations: Found observation 32037 at 2025:347:18:42:14.007 with 1 manvrs
2025-12-19 13:16:18,472 get_observations: Found observation 41883 at 2025:347:23:44:28.209 with 1 manvrs
2025-12-19 13:16:18,472 get_observations: Found observation 30312 at 2025:348:00:29:55.111 with 1 manvrs
2025-12-19 13:16:18,472 get_observations: Found observation 31285 at 2025:348:05:24:06.277 with 1 manvrs
2025-12-19 13:16:18,473 get_observations: Found observation 32043 at 2025:348:08:56:46.902 with 1 manvrs
2025-12-19 13:16:18,473 get_observations: Found observation 30255 at 2025:348:12:38:07.206 with 1 manvrs
2025-12-19 13:16:18,474 get_observations: Found observation 41882 at 2025:348:17:17:58.240 with 1 manvrs
2025-12-19 13:16:18,474 get_observations: Found observation 32040 at 2025:348:18:22:38.535 with 1 manvrs
2025-12-19 13:16:18,475 get_observations: Found observation 41881 at 2025:348:23:02:32.511 with 1 manvrs
2025-12-19 13:16:18,475 get_observations: Found observation 41880 at 2025:349:01:55:40.252 with 1 manvrs
2025-12-19 13:16:18,476 get_observations: Found observation 41879 at 2025:349:05:55:40.252 with 1 manvrs
2025-12-19 13:16:18,476 get_observations: Found observation 41878 at 2025:349:07:25:40.252 with 1 manvrs
2025-12-19 13:16:18,476 get_observations: Found observation 41877 at 2025:349:08:19:59.970 with 1 manvrs
2025-12-19 13:16:18,477 get_observations: Found observation 31116 at 2025:349:09:41:11.760 with 1 manvrs
2025-12-19 13:16:18,477 get_observations: Found observation 31160 at 2025:349:15:52:21.952 with 1 manvrs
2025-12-19 13:16:18,478 get_observations: Found observation 32052 at 2025:349:20:46:30.105 with 1 manvrs
2025-12-19 13:16:18,478 get_observations: Found observation 31593 at 2025:350:00:17:18.656 with 1 manvrs
2025-12-19 13:16:18,479 get_observations: Found observation 32051 at 2025:350:05:09:44.359 with 1 manvrs
2025-12-19 13:16:18,479 get_observations: Found observation 32057 at 2025:350:08:40:30.386 with 1 manvrs
2025-12-19 13:16:18,479 get_observations: Found observation 30289 at 2025:350:13:27:53.047 with 1 manvrs
2025-12-19 13:16:18,480 get_observations: Found observation 41876 at 2025:350:16:38:43.131 with 1 manvrs
2025-12-19 13:16:18,480 get_observations: Found observation 32058 at 2025:350:17:51:52.762 with 1 manvrs
2025-12-19 13:16:18,481 get_observations: Found observation 31256 at 2025:350:21:56:29.341 with 2 manvrs
2025-12-19 13:16:18,481 get_observations: Found observation 29957 at 2025:351:01:51:20.831 with 1 manvrs
2025-12-19 13:16:18,482 get_observations: Found observation 41874 at 2025:351:14:33:01.743 with 1 manvrs
2025-12-19 13:16:18,482 get_observations: Found observation 41873 at 2025:351:18:55:40.252 with 1 manvrs
2025-12-19 13:16:18,482 get_observations: Found observation 41872 at 2025:351:20:29:54.333 with 1 manvrs
2025-12-19 13:16:18,483 get_observations: Found observation 41871 at 2025:351:21:27:09.816 with 1 manvrs
2025-12-19 13:16:18,483 get_observations: Found observation 41870 at 2025:351:22:23:14.720 with 1 manvrs
2025-12-19 13:16:18,484 get_observations: Found observation 41869 at 2025:351:23:50:23.515 with 1 manvrs
2025-12-19 13:16:18,484 get_observations: Found observation 30243 at 2025:352:03:14:17.406 with 1 manvrs
2025-12-19 13:16:18,485 get_observations: Found observation 30245 at 2025:352:11:01:07.406 with 1 manvrs
2025-12-19 13:16:18,485 get_observations: Found observation 29889 at 2025:352:15:51:45.368 with 1 manvrs
2025-12-19 13:16:18,486 get_observations: Found observation 32049 at 2025:352:21:44:16.101 with 1 manvrs
2025-12-19 13:16:18,486 get_observations: Found observation 30115 at 2025:353:02:52:26.840 with 1 manvrs
2025-12-19 13:16:18,487 get_observations: Found observation 32059 at 2025:353:09:10:44.019 with 2 manvrs
2025-12-19 13:16:18,487 get_observations: Found observation 41867 at 2025:353:13:55:53.849 with 1 manvrs
2025-12-19 13:16:18,488 get_observations: Found observation 31272 at 2025:353:14:52:45.421 with 1 manvrs
2025-12-19 13:16:18,488 main: Found 46 observations
2025-12-19 13:16:18,488 main: ********************************************************************************
2025-12-19 13:16:18,488 main: Processing observation 41888
2025-12-19 13:16:18,488 main: ********************************************************************************
2025-12-19 13:16:18,495 obs_link_from_info: Found prev obsid 41889
2025-12-19 13:16:18,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,503 process_obs: ObsID 41888 already processed, skipping
2025-12-19 13:16:18,503 main:
2025-12-19 13:16:18,503 main: ********************************************************************************
2025-12-19 13:16:18,503 main: Processing observation 32039
2025-12-19 13:16:18,503 main: ********************************************************************************
2025-12-19 13:16:18,504 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,505 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,508 process_obs: ObsID 32039 already processed, skipping
2025-12-19 13:16:18,508 main:
2025-12-19 13:16:18,508 main: ********************************************************************************
2025-12-19 13:16:18,508 main: Processing observation 30299
2025-12-19 13:16:18,508 main: ********************************************************************************
2025-12-19 13:16:18,509 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,510 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,513 process_obs: ObsID 30299 already processed, skipping
2025-12-19 13:16:18,513 main:
2025-12-19 13:16:18,513 main: ********************************************************************************
2025-12-19 13:16:18,513 main: Processing observation 41886
2025-12-19 13:16:18,513 main: ********************************************************************************
2025-12-19 13:16:18,514 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,515 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,518 process_obs: ObsID 41886 already processed, skipping
2025-12-19 13:16:18,518 main:
2025-12-19 13:16:18,518 main: ********************************************************************************
2025-12-19 13:16:18,518 main: Processing observation 30050
2025-12-19 13:16:18,518 main: ********************************************************************************
2025-12-19 13:16:18,519 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,520 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,523 process_obs: ObsID 30050 already processed, skipping
2025-12-19 13:16:18,523 main:
2025-12-19 13:16:18,523 main: ********************************************************************************
2025-12-19 13:16:18,523 main: Processing observation 41885
2025-12-19 13:16:18,523 main: ********************************************************************************
2025-12-19 13:16:18,524 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,525 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,529 process_obs: ObsID 41885 already processed, skipping
2025-12-19 13:16:18,529 main:
2025-12-19 13:16:18,529 main: ********************************************************************************
2025-12-19 13:16:18,529 main: Processing observation 32042
2025-12-19 13:16:18,529 main: ********************************************************************************
2025-12-19 13:16:18,530 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,531 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,534 process_obs: ObsID 32042 already processed, skipping
2025-12-19 13:16:18,534 main:
2025-12-19 13:16:18,534 main: ********************************************************************************
2025-12-19 13:16:18,534 main: Processing observation 41884
2025-12-19 13:16:18,534 main: ********************************************************************************
2025-12-19 13:16:18,535 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,536 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,539 process_obs: ObsID 41884 already processed, skipping
2025-12-19 13:16:18,539 main:
2025-12-19 13:16:18,539 main: ********************************************************************************
2025-12-19 13:16:18,539 main: Processing observation 32037
2025-12-19 13:16:18,539 main: ********************************************************************************
2025-12-19 13:16:18,540 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,541 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,544 process_obs: ObsID 32037 already processed, skipping
2025-12-19 13:16:18,544 main:
2025-12-19 13:16:18,544 main: ********************************************************************************
2025-12-19 13:16:18,544 main: Processing observation 41883
2025-12-19 13:16:18,544 main: ********************************************************************************
2025-12-19 13:16:18,545 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,546 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,549 process_obs: ObsID 41883 already processed, skipping
2025-12-19 13:16:18,549 main:
2025-12-19 13:16:18,549 main: ********************************************************************************
2025-12-19 13:16:18,549 main: Processing observation 30312
2025-12-19 13:16:18,549 main: ********************************************************************************
2025-12-19 13:16:18,550 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,551 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,554 process_obs: ObsID 30312 already processed, skipping
2025-12-19 13:16:18,554 main:
2025-12-19 13:16:18,554 main: ********************************************************************************
2025-12-19 13:16:18,554 main: Processing observation 31285
2025-12-19 13:16:18,554 main: ********************************************************************************
2025-12-19 13:16:18,555 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,556 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,560 process_obs: ObsID 31285 already processed, skipping
2025-12-19 13:16:18,560 main:
2025-12-19 13:16:18,560 main: ********************************************************************************
2025-12-19 13:16:18,560 main: Processing observation 32043
2025-12-19 13:16:18,560 main: ********************************************************************************
2025-12-19 13:16:18,561 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,562 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,565 process_obs: ObsID 32043 already processed, skipping
2025-12-19 13:16:18,565 main:
2025-12-19 13:16:18,565 main: ********************************************************************************
2025-12-19 13:16:18,565 main: Processing observation 30255
2025-12-19 13:16:18,565 main: ********************************************************************************
2025-12-19 13:16:18,566 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,567 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,570 process_obs: ObsID 30255 already processed, skipping
2025-12-19 13:16:18,570 main:
2025-12-19 13:16:18,570 main: ********************************************************************************
2025-12-19 13:16:18,570 main: Processing observation 41882
2025-12-19 13:16:18,570 main: ********************************************************************************
2025-12-19 13:16:18,571 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,572 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 13:16:18,575 process_obs: ObsID 41882 already processed, skipping
2025-12-19 13:16:18,575 main:
2025-12-19 13:16:18,575 main: ********************************************************************************
2025-12-19 13:16:18,575 main: Processing observation 32040
2025-12-19 13:16:18,575 main: ********************************************************************************
2025-12-19 13:16:18,576 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 13:16:18,577 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 12:16:22,561 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/32040/centroid_resids.pkl
2025-12-19 12:16:23,481 write_centroid_resids: Centroid residuals file exists, skipping
2025-12-19 12:16:23,481 plot_crs_time: Plot file exists, skipping
2025-12-19 12:16:23,481 plot_crs_scatter: Plot file exists, skipping
2025-12-19 12:16:25,352 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/32040/n_kalman_delta_roll.png
2025-12-19 12:16:28,435 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/32040/index.html
2025-12-19 12:16:28,448 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/32040/info.json
2025-12-19 12:16:28,483 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32040/index.html
2025-12-19 12:16:28,498 main:
2025-12-19 12:16:28,498 main: ********************************************************************************
2025-12-19 12:16:28,498 main: Processing observation 41881
2025-12-19 12:16:28,498 main: ********************************************************************************
2025-12-19 12:16:28,515 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,539 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0825A/last.html
2025-12-19 12:16:28,623 process_obs: ObsID 41881 already processed, skipping
2025-12-19 12:16:28,623 main:
2025-12-19 12:16:28,623 main: ********************************************************************************
2025-12-19 12:16:28,624 main: Processing observation 41880
2025-12-19 12:16:28,624 main: ********************************************************************************
2025-12-19 12:16:28,646 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,667 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:28,689 process_obs: ObsID 41880 already processed, skipping
2025-12-19 12:16:28,689 main:
2025-12-19 12:16:28,689 main: ********************************************************************************
2025-12-19 12:16:28,689 main: Processing observation 41879
2025-12-19 12:16:28,690 main: ********************************************************************************
2025-12-19 12:16:28,693 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,696 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:28,702 process_obs: ObsID 41879 already processed, skipping
2025-12-19 12:16:28,702 main:
2025-12-19 12:16:28,702 main: ********************************************************************************
2025-12-19 12:16:28,702 main: Processing observation 41878
2025-12-19 12:16:28,702 main: ********************************************************************************
2025-12-19 12:16:28,704 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,705 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:28,709 process_obs: ObsID 41878 already processed, skipping
2025-12-19 12:16:28,709 main:
2025-12-19 12:16:28,709 main: ********************************************************************************
2025-12-19 12:16:28,709 main: Processing observation 41877
2025-12-19 12:16:28,709 main: ********************************************************************************
2025-12-19 12:16:28,713 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,715 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:28,776 process_obs: ObsID 41877 already processed, skipping
2025-12-19 12:16:28,776 main:
2025-12-19 12:16:28,776 main: ********************************************************************************
2025-12-19 12:16:28,776 main: Processing observation 31116
2025-12-19 12:16:28,776 main: ********************************************************************************
2025-12-19 12:16:28,795 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,816 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:28,855 process_obs: ObsID 31116 already processed, skipping
2025-12-19 12:16:28,855 main:
2025-12-19 12:16:28,855 main: ********************************************************************************
2025-12-19 12:16:28,855 main: Processing observation 31160
2025-12-19 12:16:28,856 main: ********************************************************************************
2025-12-19 12:16:28,867 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,895 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:28,959 process_obs: ObsID 31160 already processed, skipping
2025-12-19 12:16:28,959 main:
2025-12-19 12:16:28,959 main: ********************************************************************************
2025-12-19 12:16:28,959 main: Processing observation 32052
2025-12-19 12:16:28,960 main: ********************************************************************************
2025-12-19 12:16:28,976 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:28,999 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,017 process_obs: ObsID 32052 already processed, skipping
2025-12-19 12:16:29,017 main:
2025-12-19 12:16:29,017 main: ********************************************************************************
2025-12-19 12:16:29,017 main: Processing observation 31593
2025-12-19 12:16:29,017 main: ********************************************************************************
2025-12-19 12:16:29,018 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,020 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,023 process_obs: ObsID 31593 already processed, skipping
2025-12-19 12:16:29,023 main:
2025-12-19 12:16:29,023 main: ********************************************************************************
2025-12-19 12:16:29,023 main: Processing observation 32051
2025-12-19 12:16:29,023 main: ********************************************************************************
2025-12-19 12:16:29,024 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,025 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,028 process_obs: ObsID 32051 already processed, skipping
2025-12-19 12:16:29,028 main:
2025-12-19 12:16:29,028 main: ********************************************************************************
2025-12-19 12:16:29,028 main: Processing observation 32057
2025-12-19 12:16:29,028 main: ********************************************************************************
2025-12-19 12:16:29,029 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,030 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,034 process_obs: ObsID 32057 already processed, skipping
2025-12-19 12:16:29,034 main:
2025-12-19 12:16:29,034 main: ********************************************************************************
2025-12-19 12:16:29,034 main: Processing observation 30289
2025-12-19 12:16:29,034 main: ********************************************************************************
2025-12-19 12:16:29,035 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,036 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,054 process_obs: ObsID 30289 already processed, skipping
2025-12-19 12:16:29,054 main:
2025-12-19 12:16:29,054 main: ********************************************************************************
2025-12-19 12:16:29,054 main: Processing observation 41876
2025-12-19 12:16:29,054 main: ********************************************************************************
2025-12-19 12:16:29,055 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,056 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,086 process_obs: ObsID 41876 already processed, skipping
2025-12-19 12:16:29,086 main:
2025-12-19 12:16:29,086 main: ********************************************************************************
2025-12-19 12:16:29,086 main: Processing observation 32058
2025-12-19 12:16:29,086 main: ********************************************************************************
2025-12-19 12:16:29,087 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,088 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,106 process_obs: ObsID 32058 already processed, skipping
2025-12-19 12:16:29,106 main:
2025-12-19 12:16:29,106 main: ********************************************************************************
2025-12-19 12:16:29,106 main: Processing observation 31256
2025-12-19 12:16:29,106 main: ********************************************************************************
2025-12-19 12:16:29,107 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,108 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:29,124 process_obs: ObsID 31256 already processed, skipping
2025-12-19 12:16:29,124 main:
2025-12-19 12:16:29,124 main: ********************************************************************************
2025-12-19 12:16:29,124 main: Processing observation 29957
2025-12-19 12:16:29,124 main: ********************************************************************************
2025-12-19 12:16:29,125 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:29,126 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:31,863 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29957/centroid_resids.pkl
2025-12-19 12:16:32,621 write_centroid_resids: Centroid residuals file exists, skipping
2025-12-19 12:16:32,621 plot_crs_time: Plot file exists, skipping
2025-12-19 12:16:32,623 plot_crs_scatter: Plot file exists, skipping
2025-12-19 12:16:32,666 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-12-19 12:16:32,787 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29957/n_kalman_delta_roll.png
2025-12-19 12:16:36,324 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29957/index.html
2025-12-19 12:16:36,325 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29957/info.json
2025-12-19 12:16:36,329 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29957/index.html
2025-12-19 12:16:36,330 main:
2025-12-19 12:16:36,330 main: ********************************************************************************
2025-12-19 12:16:36,330 main: Processing observation 41874
2025-12-19 12:16:36,330 main: ********************************************************************************
2025-12-19 12:16:36,331 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:36,340 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:36,375 process_obs: ObsID 41874 already processed, skipping
2025-12-19 12:16:36,375 main:
2025-12-19 12:16:36,375 main: ********************************************************************************
2025-12-19 12:16:36,376 main: Processing observation 41873
2025-12-19 12:16:36,376 main: ********************************************************************************
2025-12-19 12:16:36,379 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:36,380 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:36,400 process_obs: ObsID 41873 already processed, skipping
2025-12-19 12:16:36,400 main:
2025-12-19 12:16:36,400 main: ********************************************************************************
2025-12-19 12:16:36,400 main: Processing observation 41872
2025-12-19 12:16:36,400 main: ********************************************************************************
2025-12-19 12:16:36,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:36,402 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:36,428 process_obs: ObsID 41872 already processed, skipping
2025-12-19 12:16:36,428 main:
2025-12-19 12:16:36,428 main: ********************************************************************************
2025-12-19 12:16:36,428 main: Processing observation 41871
2025-12-19 12:16:36,428 main: ********************************************************************************
2025-12-19 12:16:36,429 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:36,431 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:36,444 process_obs: ObsID 41871 already processed, skipping
2025-12-19 12:16:36,444 main:
2025-12-19 12:16:36,444 main: ********************************************************************************
2025-12-19 12:16:36,444 main: Processing observation 41870
2025-12-19 12:16:36,444 main: ********************************************************************************
2025-12-19 12:16:36,445 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:36,446 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:36,497 process_obs: ObsID 41870 already processed, skipping
2025-12-19 12:16:36,497 main:
2025-12-19 12:16:36,497 main: ********************************************************************************
2025-12-19 12:16:36,497 main: Processing observation 41869
2025-12-19 12:16:36,497 main: ********************************************************************************
2025-12-19 12:16:36,502 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:36,509 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:40,464 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/41869/centroid_resids.pkl with 8 slots
2025-12-19 12:16:40,552 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/41869/centroid_resids_time.png
2025-12-19 12:16:41,602 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/41869/centroid_resids_scatter.png
2025-12-19 12:16:41,747 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-12-19 12:16:41,923 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/41869/n_kalman_delta_roll.png
2025-12-19 12:16:45,174 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/41869/index.html
2025-12-19 12:16:45,176 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/41869/info.json
2025-12-19 12:16:45,177 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41869/index.html
2025-12-19 12:16:45,178 main:
2025-12-19 12:16:45,178 main: ********************************************************************************
2025-12-19 12:16:45,178 main: Processing observation 30243
2025-12-19 12:16:45,178 main: ********************************************************************************
2025-12-19 12:16:45,179 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:45,184 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:48,789 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30243/centroid_resids.pkl with 5 slots
2025-12-19 12:16:48,868 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30243/centroid_resids_time.png
2025-12-19 12:16:49,478 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30243/centroid_resids_scatter.png
2025-12-19 12:16:50,674 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30243/n_kalman_delta_roll.png
2025-12-19 12:16:50,952 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30243/index.html
2025-12-19 12:16:50,960 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30243/info.json
2025-12-19 12:16:50,967 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30243/index.html
2025-12-19 12:16:50,975 main:
2025-12-19 12:16:50,975 main: ********************************************************************************
2025-12-19 12:16:50,975 main: Processing observation 30245
2025-12-19 12:16:50,975 main: ********************************************************************************
2025-12-19 12:16:50,980 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:50,988 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:16:54,490 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30245/centroid_resids.pkl with 5 slots
2025-12-19 12:16:54,569 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30245/centroid_resids_time.png
2025-12-19 12:16:54,883 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30245/centroid_resids_scatter.png
2025-12-19 12:16:55,883 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30245/n_kalman_delta_roll.png
2025-12-19 12:16:56,204 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30245/index.html
2025-12-19 12:16:56,208 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30245/info.json
2025-12-19 12:16:56,220 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30245/index.html
2025-12-19 12:16:56,226 main:
2025-12-19 12:16:56,226 main: ********************************************************************************
2025-12-19 12:16:56,226 main: Processing observation 29889
2025-12-19 12:16:56,226 main: ********************************************************************************
2025-12-19 12:16:56,227 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:16:56,235 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:17:00,172 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29889/centroid_resids.pkl with 5 slots
2025-12-19 12:17:00,223 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29889/centroid_resids_time.png
2025-12-19 12:17:00,775 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29889/centroid_resids_scatter.png
2025-12-19 12:17:01,826 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29889/n_kalman_delta_roll.png
2025-12-19 12:17:02,004 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29889/index.html
2025-12-19 12:17:02,006 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/29889/info.json
2025-12-19 12:17:02,009 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29889/index.html
2025-12-19 12:17:02,012 main:
2025-12-19 12:17:02,012 main: ********************************************************************************
2025-12-19 12:17:02,012 main: Processing observation 32049
2025-12-19 12:17:02,012 main: ********************************************************************************
2025-12-19 12:17:02,013 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:17:02,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:17:05,539 __init__: ObsID 32049 has insufficient telemetry, skipping
2025-12-19 12:17:05,541 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/32049/index.html
2025-12-19 12:17:05,544 main:
2025-12-19 12:17:05,544 main: ********************************************************************************
2025-12-19 12:17:05,544 main: Processing observation 30115
2025-12-19 12:17:05,544 main: ********************************************************************************
2025-12-19 12:17:05,546 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:17:05,547 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:17:10,602 __init__: ObsID 30115 has insufficient telemetry, skipping
2025-12-19 12:17:10,603 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/30115/index.html
2025-12-19 12:17:10,612 main:
2025-12-19 12:17:10,612 main: ********************************************************************************
2025-12-19 12:17:10,612 main: Processing observation 32059
2025-12-19 12:17:10,612 main: ********************************************************************************
2025-12-19 12:17:10,626 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:17:10,635 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:17:13,748 __init__: ObsID 32059 has insufficient telemetry, skipping
2025-12-19 12:17:13,748 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/32059/index.html
2025-12-19 12:17:13,749 main:
2025-12-19 12:17:13,749 main: ********************************************************************************
2025-12-19 12:17:13,749 main: Processing observation 41867
2025-12-19 12:17:13,750 main: ********************************************************************************
2025-12-19 12:17:13,751 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:17:13,752 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:17:16,822 __init__: ObsID 41867 has insufficient telemetry, skipping
2025-12-19 12:17:16,826 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/41867/index.html
2025-12-19 12:17:16,836 main:
2025-12-19 12:17:16,836 main: ********************************************************************************
2025-12-19 12:17:16,836 main: Processing observation 31272
2025-12-19 12:17:16,836 main: ********************************************************************************
2025-12-19 12:17:16,840 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/31272/info.json file found, obs=None
2025-12-19 12:17:16,856 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-19 12:17:16,881 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/last.html
2025-12-19 12:17:19,452 __init__: ObsID 31272 has no maneuver event in telemetry, skipping
2025-12-19 12:17:19,464 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC1525A/31272/index.html
2025-12-19 12:17:19,476 main: