Prev
Index
Next
centroid_dashboard: Sun Dec 7 13:17:46 2025
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Sun Dec 7 13:17:46 2025 |
No errors
File contents:
2025-12-07 13:16:15,293 main: Processing from 2025:334:18:16:15.292 to 2025:341:18:16:15.292
2025-12-07 13:16:25,747 get_observations: Found observation 31291 at 2025:334:19:11:42.414 with 1 manvrs
2025-12-07 13:16:25,748 get_observations: Found observation 31990 at 2025:334:22:34:55.495 with 1 manvrs
2025-12-07 13:16:25,748 get_observations: Found observation 41918 at 2025:335:01:38:34.437 with 1 manvrs
2025-12-07 13:16:25,748 get_observations: Found observation 41917 at 2025:335:02:29:13.462 with 1 manvrs
2025-12-07 13:16:25,749 get_observations: Found observation 41916 at 2025:335:03:17:07.999 with 1 manvrs
2025-12-07 13:16:25,749 get_observations: Found observation 29956 at 2025:335:03:42:14.322 with 1 manvrs
2025-12-07 13:16:25,750 get_observations: Found observation 41915 at 2025:335:10:04:04.170 with 1 manvrs
2025-12-07 13:16:25,750 get_observations: Found observation 30064 at 2025:335:10:43:32.977 with 1 manvrs
2025-12-07 13:16:25,751 get_observations: Found observation 41914 at 2025:335:17:12:27.162 with 1 manvrs
2025-12-07 13:16:25,751 get_observations: Found observation 41913 at 2025:336:00:31:40.252 with 1 manvrs
2025-12-07 13:16:25,752 get_observations: Found observation 32027 at 2025:336:05:15:30.131 with 1 manvrs
2025-12-07 13:16:25,752 get_observations: Found observation 30287 at 2025:336:10:47:02.606 with 1 manvrs
2025-12-07 13:16:25,752 get_observations: Found observation 31524 at 2025:336:14:20:10.944 with 1 manvrs
2025-12-07 13:16:25,753 get_observations: Found observation 32028 at 2025:336:18:55:17.322 with 1 manvrs
2025-12-07 13:16:25,753 get_observations: Found observation 32034 at 2025:336:22:28:23.873 with 1 manvrs
2025-12-07 13:16:25,754 get_observations: Found observation 30288 at 2025:337:03:08:32.038 with 1 manvrs
2025-12-07 13:16:25,754 get_observations: Found observation 31526 at 2025:337:06:45:48.589 with 1 manvrs
2025-12-07 13:16:25,755 get_observations: Found observation 32029 at 2025:337:11:20:56.754 with 1 manvrs
2025-12-07 13:16:25,755 get_observations: Found observation 32035 at 2025:337:14:54:03.305 with 1 manvrs
2025-12-07 13:16:25,756 get_observations: Found observation 30290 at 2025:337:19:31:41.470 with 1 manvrs
2025-12-07 13:16:25,756 get_observations: Found observation 30056 at 2025:337:23:15:19.746 with 1 manvrs
2025-12-07 13:16:25,756 get_observations: Found observation 41912 at 2025:338:08:50:15.002 with 1 manvrs
2025-12-07 13:16:25,757 get_observations: Found observation 41911 at 2025:338:14:50:40.252 with 1 manvrs
2025-12-07 13:16:25,757 get_observations: Found observation 41910 at 2025:338:16:25:40.252 with 1 manvrs
2025-12-07 13:16:25,758 get_observations: Found observation 41909 at 2025:338:17:06:32.185 with 1 manvrs
2025-12-07 13:16:25,758 get_observations: Found observation 41908 at 2025:338:19:50:40.252 with 1 manvrs
2025-12-07 13:16:25,759 get_observations: Found observation 28359 at 2025:338:21:51:59.138 with 1 manvrs
2025-12-07 13:16:25,759 get_observations: Found observation 30241 at 2025:339:01:30:58.158 with 1 manvrs
2025-12-07 13:16:25,760 get_observations: Found observation 31039 at 2025:339:12:02:23.525 with 2 manvrs
2025-12-07 13:16:25,760 get_observations: Found observation 41906 at 2025:339:16:32:42.182 with 1 manvrs
2025-12-07 13:16:25,760 get_observations: Found observation 32026 at 2025:339:17:29:08.626 with 1 manvrs
2025-12-07 13:16:25,761 get_observations: Found observation 41905 at 2025:339:22:46:12.703 with 1 manvrs
2025-12-07 13:16:25,761 get_observations: Found observation 32032 at 2025:339:23:39:01.051 with 1 manvrs
2025-12-07 13:16:25,762 get_observations: Found observation 32024 at 2025:340:04:24:41.907 with 1 manvrs
2025-12-07 13:16:25,762 get_observations: Found observation 32033 at 2025:340:09:27:02.762 with 1 manvrs
2025-12-07 13:16:25,763 get_observations: Found observation 32025 at 2025:340:13:14:11.149 with 1 manvrs
2025-12-07 13:16:25,763 get_observations: Found observation 31977 at 2025:340:18:09:06.913 with 1 manvrs
2025-12-07 13:16:25,763 get_observations: Found observation 31289 at 2025:340:21:14:20.788 with 1 manvrs
2025-12-07 13:16:25,764 get_observations: Found observation 41904 at 2025:341:00:42:06.746 with 1 manvrs
2025-12-07 13:16:25,764 get_observations: Found observation 41903 at 2025:341:09:53:40.252 with 1 manvrs
2025-12-07 13:16:25,765 get_observations: Found observation 32030 at 2025:341:11:12:20.138 with 1 manvrs
2025-12-07 13:16:25,765 get_observations: Found observation 32023 at 2025:341:16:00:09.354 with 1 manvrs
2025-12-07 13:16:25,766 main: Found 42 observations
2025-12-07 13:16:25,766 main: ********************************************************************************
2025-12-07 13:16:25,766 main: Processing observation 31291
2025-12-07 13:16:25,766 main: ********************************************************************************
2025-12-07 13:16:25,773 obs_link_from_info: Found prev obsid 31989
2025-12-07 13:16:25,778 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,780 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-12-07 13:16:25,786 process_obs: ObsID 31291 already processed, skipping
2025-12-07 13:16:25,786 main:
2025-12-07 13:16:25,786 main: ********************************************************************************
2025-12-07 13:16:25,786 main: Processing observation 31990
2025-12-07 13:16:25,786 main: ********************************************************************************
2025-12-07 13:16:25,792 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,793 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/NOV2425A/last.html
2025-12-07 13:16:25,797 process_obs: ObsID 31990 already processed, skipping
2025-12-07 13:16:25,797 main:
2025-12-07 13:16:25,797 main: ********************************************************************************
2025-12-07 13:16:25,797 main: Processing observation 41918
2025-12-07 13:16:25,797 main: ********************************************************************************
2025-12-07 13:16:25,798 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,800 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,808 process_obs: ObsID 41918 already processed, skipping
2025-12-07 13:16:25,808 main:
2025-12-07 13:16:25,808 main: ********************************************************************************
2025-12-07 13:16:25,808 main: Processing observation 41917
2025-12-07 13:16:25,808 main: ********************************************************************************
2025-12-07 13:16:25,809 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,810 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,815 process_obs: ObsID 41917 already processed, skipping
2025-12-07 13:16:25,815 main:
2025-12-07 13:16:25,815 main: ********************************************************************************
2025-12-07 13:16:25,815 main: Processing observation 41916
2025-12-07 13:16:25,815 main: ********************************************************************************
2025-12-07 13:16:25,816 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,818 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,822 process_obs: ObsID 41916 already processed, skipping
2025-12-07 13:16:25,822 main:
2025-12-07 13:16:25,822 main: ********************************************************************************
2025-12-07 13:16:25,822 main: Processing observation 29956
2025-12-07 13:16:25,822 main: ********************************************************************************
2025-12-07 13:16:25,824 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,829 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,835 process_obs: ObsID 29956 already processed, skipping
2025-12-07 13:16:25,835 main:
2025-12-07 13:16:25,835 main: ********************************************************************************
2025-12-07 13:16:25,835 main: Processing observation 41915
2025-12-07 13:16:25,835 main: ********************************************************************************
2025-12-07 13:16:25,836 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,837 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,842 process_obs: ObsID 41915 already processed, skipping
2025-12-07 13:16:25,842 main:
2025-12-07 13:16:25,842 main: ********************************************************************************
2025-12-07 13:16:25,842 main: Processing observation 30064
2025-12-07 13:16:25,842 main: ********************************************************************************
2025-12-07 13:16:25,843 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,844 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,848 process_obs: ObsID 30064 already processed, skipping
2025-12-07 13:16:25,848 main:
2025-12-07 13:16:25,848 main: ********************************************************************************
2025-12-07 13:16:25,848 main: Processing observation 41914
2025-12-07 13:16:25,848 main: ********************************************************************************
2025-12-07 13:16:25,849 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,850 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,855 process_obs: ObsID 41914 already processed, skipping
2025-12-07 13:16:25,855 main:
2025-12-07 13:16:25,855 main: ********************************************************************************
2025-12-07 13:16:25,855 main: Processing observation 41913
2025-12-07 13:16:25,855 main: ********************************************************************************
2025-12-07 13:16:25,856 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,858 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,867 process_obs: ObsID 41913 already processed, skipping
2025-12-07 13:16:25,867 main:
2025-12-07 13:16:25,867 main: ********************************************************************************
2025-12-07 13:16:25,867 main: Processing observation 32027
2025-12-07 13:16:25,867 main: ********************************************************************************
2025-12-07 13:16:25,869 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,870 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,876 process_obs: ObsID 32027 already processed, skipping
2025-12-07 13:16:25,876 main:
2025-12-07 13:16:25,876 main: ********************************************************************************
2025-12-07 13:16:25,876 main: Processing observation 30287
2025-12-07 13:16:25,876 main: ********************************************************************************
2025-12-07 13:16:25,877 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,878 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,882 process_obs: ObsID 30287 already processed, skipping
2025-12-07 13:16:25,882 main:
2025-12-07 13:16:25,882 main: ********************************************************************************
2025-12-07 13:16:25,882 main: Processing observation 31524
2025-12-07 13:16:25,882 main: ********************************************************************************
2025-12-07 13:16:25,883 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,884 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,891 process_obs: ObsID 31524 already processed, skipping
2025-12-07 13:16:25,891 main:
2025-12-07 13:16:25,891 main: ********************************************************************************
2025-12-07 13:16:25,891 main: Processing observation 32028
2025-12-07 13:16:25,891 main: ********************************************************************************
2025-12-07 13:16:25,892 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,893 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,896 process_obs: ObsID 32028 already processed, skipping
2025-12-07 13:16:25,896 main:
2025-12-07 13:16:25,896 main: ********************************************************************************
2025-12-07 13:16:25,896 main: Processing observation 32034
2025-12-07 13:16:25,896 main: ********************************************************************************
2025-12-07 13:16:25,898 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,900 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,904 process_obs: ObsID 32034 already processed, skipping
2025-12-07 13:16:25,904 main:
2025-12-07 13:16:25,904 main: ********************************************************************************
2025-12-07 13:16:25,904 main: Processing observation 30288
2025-12-07 13:16:25,904 main: ********************************************************************************
2025-12-07 13:16:25,906 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,907 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,910 process_obs: ObsID 30288 already processed, skipping
2025-12-07 13:16:25,911 main:
2025-12-07 13:16:25,911 main: ********************************************************************************
2025-12-07 13:16:25,911 main: Processing observation 31526
2025-12-07 13:16:25,911 main: ********************************************************************************
2025-12-07 13:16:25,914 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,915 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,920 process_obs: ObsID 31526 already processed, skipping
2025-12-07 13:16:25,921 main:
2025-12-07 13:16:25,921 main: ********************************************************************************
2025-12-07 13:16:25,921 main: Processing observation 32029
2025-12-07 13:16:25,921 main: ********************************************************************************
2025-12-07 13:16:25,922 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,923 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 13:16:25,928 process_obs: ObsID 32029 already processed, skipping
2025-12-07 13:16:25,928 main:
2025-12-07 13:16:25,928 main: ********************************************************************************
2025-12-07 13:16:25,928 main: Processing observation 32035
2025-12-07 13:16:25,928 main: ********************************************************************************
2025-12-07 13:16:25,929 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 13:16:25,930 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:30,206 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32035/centroid_resids.pkl
2025-12-07 12:16:30,981 write_centroid_resids: Centroid residuals file exists, skipping
2025-12-07 12:16:30,981 plot_crs_time: Plot file exists, skipping
2025-12-07 12:16:30,982 plot_crs_scatter: Plot file exists, skipping
2025-12-07 12:16:31,028 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-12-07 12:16:31,562 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32035/n_kalman_delta_roll.png
2025-12-07 12:16:36,230 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32035/index.html
2025-12-07 12:16:36,236 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32035/info.json
2025-12-07 12:16:36,255 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32035/index.html
2025-12-07 12:16:36,262 main:
2025-12-07 12:16:36,262 main: ********************************************************************************
2025-12-07 12:16:36,262 main: Processing observation 30290
2025-12-07 12:16:36,262 main: ********************************************************************************
2025-12-07 12:16:36,264 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,266 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,283 process_obs: ObsID 30290 already processed, skipping
2025-12-07 12:16:36,283 main:
2025-12-07 12:16:36,283 main: ********************************************************************************
2025-12-07 12:16:36,283 main: Processing observation 30056
2025-12-07 12:16:36,283 main: ********************************************************************************
2025-12-07 12:16:36,287 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,289 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,310 process_obs: ObsID 30056 already processed, skipping
2025-12-07 12:16:36,310 main:
2025-12-07 12:16:36,310 main: ********************************************************************************
2025-12-07 12:16:36,310 main: Processing observation 41912
2025-12-07 12:16:36,310 main: ********************************************************************************
2025-12-07 12:16:36,312 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,316 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,350 process_obs: ObsID 41912 already processed, skipping
2025-12-07 12:16:36,350 main:
2025-12-07 12:16:36,351 main: ********************************************************************************
2025-12-07 12:16:36,351 main: Processing observation 41911
2025-12-07 12:16:36,351 main: ********************************************************************************
2025-12-07 12:16:36,356 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,360 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,404 process_obs: ObsID 41911 already processed, skipping
2025-12-07 12:16:36,404 main:
2025-12-07 12:16:36,404 main: ********************************************************************************
2025-12-07 12:16:36,404 main: Processing observation 41910
2025-12-07 12:16:36,404 main: ********************************************************************************
2025-12-07 12:16:36,414 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,438 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,493 process_obs: ObsID 41910 already processed, skipping
2025-12-07 12:16:36,493 main:
2025-12-07 12:16:36,493 main: ********************************************************************************
2025-12-07 12:16:36,493 main: Processing observation 41909
2025-12-07 12:16:36,493 main: ********************************************************************************
2025-12-07 12:16:36,495 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,497 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,522 process_obs: ObsID 41909 already processed, skipping
2025-12-07 12:16:36,522 main:
2025-12-07 12:16:36,522 main: ********************************************************************************
2025-12-07 12:16:36,522 main: Processing observation 41908
2025-12-07 12:16:36,522 main: ********************************************************************************
2025-12-07 12:16:36,802 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,803 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,825 process_obs: ObsID 41908 already processed, skipping
2025-12-07 12:16:36,825 main:
2025-12-07 12:16:36,825 main: ********************************************************************************
2025-12-07 12:16:36,825 main: Processing observation 28359
2025-12-07 12:16:36,825 main: ********************************************************************************
2025-12-07 12:16:36,826 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,828 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:36,843 process_obs: ObsID 28359 already processed, skipping
2025-12-07 12:16:36,843 main:
2025-12-07 12:16:36,843 main: ********************************************************************************
2025-12-07 12:16:36,843 main: Processing observation 30241
2025-12-07 12:16:36,843 main: ********************************************************************************
2025-12-07 12:16:36,844 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:36,845 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:40,520 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/30241/centroid_resids.pkl
2025-12-07 12:16:41,881 write_centroid_resids: Centroid residuals file exists, skipping
2025-12-07 12:16:41,881 plot_crs_time: Plot file exists, skipping
2025-12-07 12:16:41,884 plot_crs_scatter: Plot file exists, skipping
2025-12-07 12:16:41,927 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-12-07 12:16:42,038 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/30241/n_kalman_delta_roll.png
2025-12-07 12:16:42,170 get_aberration_correction: More than one entry for 30241 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2025/DEC0125/oflsa/output/DEC0125A_ManErr.txt. Skipping aber correction
2025-12-07 12:16:46,138 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/30241/index.html
2025-12-07 12:16:46,147 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/30241/info.json
2025-12-07 12:16:46,155 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30241/index.html
2025-12-07 12:16:46,166 main:
2025-12-07 12:16:46,166 main: ********************************************************************************
2025-12-07 12:16:46,166 main: Processing observation 31039
2025-12-07 12:16:46,166 main: ********************************************************************************
2025-12-07 12:16:46,168 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:46,180 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:46,207 process_obs: ObsID 31039 already processed, skipping
2025-12-07 12:16:46,207 main:
2025-12-07 12:16:46,207 main: ********************************************************************************
2025-12-07 12:16:46,207 main: Processing observation 41906
2025-12-07 12:16:46,207 main: ********************************************************************************
2025-12-07 12:16:46,210 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:46,218 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:46,237 process_obs: ObsID 41906 already processed, skipping
2025-12-07 12:16:46,237 main:
2025-12-07 12:16:46,237 main: ********************************************************************************
2025-12-07 12:16:46,237 main: Processing observation 32026
2025-12-07 12:16:46,237 main: ********************************************************************************
2025-12-07 12:16:46,244 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:46,250 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:49,852 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32026/centroid_resids.pkl
2025-12-07 12:16:50,307 write_centroid_resids: Centroid residuals file exists, skipping
2025-12-07 12:16:50,307 plot_crs_time: Plot file exists, skipping
2025-12-07 12:16:50,308 plot_crs_scatter: Plot file exists, skipping
2025-12-07 12:16:51,369 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32026/n_kalman_delta_roll.png
2025-12-07 12:16:55,119 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32026/index.html
2025-12-07 12:16:55,122 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32026/info.json
2025-12-07 12:16:55,127 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32026/index.html
2025-12-07 12:16:55,130 main:
2025-12-07 12:16:55,130 main: ********************************************************************************
2025-12-07 12:16:55,130 main: Processing observation 41905
2025-12-07 12:16:55,130 main: ********************************************************************************
2025-12-07 12:16:55,133 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:55,135 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:55,160 process_obs: ObsID 41905 already processed, skipping
2025-12-07 12:16:55,160 main:
2025-12-07 12:16:55,160 main: ********************************************************************************
2025-12-07 12:16:55,160 main: Processing observation 32032
2025-12-07 12:16:55,160 main: ********************************************************************************
2025-12-07 12:16:55,163 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:16:55,165 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:16:58,789 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32032/centroid_resids.pkl with 5 slots
2025-12-07 12:16:58,853 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32032/centroid_resids_time.png
2025-12-07 12:17:00,383 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32032/centroid_resids_scatter.png
2025-12-07 12:17:01,438 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32032/n_kalman_delta_roll.png
2025-12-07 12:17:04,762 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32032/index.html
2025-12-07 12:17:04,764 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32032/info.json
2025-12-07 12:17:04,766 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32032/index.html
2025-12-07 12:17:04,768 main:
2025-12-07 12:17:04,768 main: ********************************************************************************
2025-12-07 12:17:04,768 main: Processing observation 32024
2025-12-07 12:17:04,768 main: ********************************************************************************
2025-12-07 12:17:04,770 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:04,772 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:10,796 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32024/centroid_resids.pkl with 5 slots
2025-12-07 12:17:10,848 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32024/centroid_resids_time.png
2025-12-07 12:17:11,150 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32024/centroid_resids_scatter.png
2025-12-07 12:17:12,156 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32024/n_kalman_delta_roll.png
2025-12-07 12:17:12,318 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32024/index.html
2025-12-07 12:17:12,322 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32024/info.json
2025-12-07 12:17:12,325 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32024/index.html
2025-12-07 12:17:12,328 main:
2025-12-07 12:17:12,328 main: ********************************************************************************
2025-12-07 12:17:12,328 main: Processing observation 32033
2025-12-07 12:17:12,328 main: ********************************************************************************
2025-12-07 12:17:12,329 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:12,331 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:16,383 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32033/centroid_resids.pkl with 5 slots
2025-12-07 12:17:16,442 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32033/centroid_resids_time.png
2025-12-07 12:17:16,755 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32033/centroid_resids_scatter.png
2025-12-07 12:17:17,821 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32033/n_kalman_delta_roll.png
2025-12-07 12:17:18,059 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32033/index.html
2025-12-07 12:17:18,063 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32033/info.json
2025-12-07 12:17:18,069 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32033/index.html
2025-12-07 12:17:18,073 main:
2025-12-07 12:17:18,073 main: ********************************************************************************
2025-12-07 12:17:18,073 main: Processing observation 32025
2025-12-07 12:17:18,073 main: ********************************************************************************
2025-12-07 12:17:18,074 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:18,076 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:21,541 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32025/centroid_resids.pkl with 5 slots
2025-12-07 12:17:21,607 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32025/centroid_resids_time.png
2025-12-07 12:17:22,120 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32025/centroid_resids_scatter.png
2025-12-07 12:17:23,698 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32025/n_kalman_delta_roll.png
2025-12-07 12:17:23,887 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32025/index.html
2025-12-07 12:17:23,892 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32025/info.json
2025-12-07 12:17:23,894 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32025/index.html
2025-12-07 12:17:23,895 main:
2025-12-07 12:17:23,895 main: ********************************************************************************
2025-12-07 12:17:23,895 main: Processing observation 31977
2025-12-07 12:17:23,895 main: ********************************************************************************
2025-12-07 12:17:23,897 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:23,898 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:27,203 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31977/centroid_resids.pkl with 5 slots
2025-12-07 12:17:27,251 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31977/centroid_resids_time.png
2025-12-07 12:17:27,550 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31977/centroid_resids_scatter.png
2025-12-07 12:17:28,423 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31977/n_kalman_delta_roll.png
2025-12-07 12:17:28,643 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31977/index.html
2025-12-07 12:17:28,648 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31977/info.json
2025-12-07 12:17:28,656 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31977/index.html
2025-12-07 12:17:28,658 main:
2025-12-07 12:17:28,658 main: ********************************************************************************
2025-12-07 12:17:28,658 main: Processing observation 31289
2025-12-07 12:17:28,658 main: ********************************************************************************
2025-12-07 12:17:28,663 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:28,668 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:32,155 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31289/centroid_resids.pkl with 5 slots
2025-12-07 12:17:32,202 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31289/centroid_resids_time.png
2025-12-07 12:17:32,458 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31289/centroid_resids_scatter.png
2025-12-07 12:17:32,588 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-12-07 12:17:32,737 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31289/n_kalman_delta_roll.png
2025-12-07 12:17:32,917 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31289/index.html
2025-12-07 12:17:32,919 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/31289/info.json
2025-12-07 12:17:32,921 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31289/index.html
2025-12-07 12:17:32,922 main:
2025-12-07 12:17:32,922 main: ********************************************************************************
2025-12-07 12:17:32,922 main: Processing observation 41904
2025-12-07 12:17:32,922 main: ********************************************************************************
2025-12-07 12:17:32,924 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:32,925 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:36,424 __init__: ObsID 41904 has insufficient telemetry, skipping
2025-12-07 12:17:36,425 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/41904/index.html
2025-12-07 12:17:36,426 main:
2025-12-07 12:17:36,426 main: ********************************************************************************
2025-12-07 12:17:36,426 main: Processing observation 41903
2025-12-07 12:17:36,426 main: ********************************************************************************
2025-12-07 12:17:36,428 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:36,429 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:39,419 __init__: ObsID 41903 has insufficient telemetry, skipping
2025-12-07 12:17:39,419 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/41903/index.html
2025-12-07 12:17:39,421 main:
2025-12-07 12:17:39,421 main: ********************************************************************************
2025-12-07 12:17:39,421 main: Processing observation 32030
2025-12-07 12:17:39,421 main: ********************************************************************************
2025-12-07 12:17:39,422 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:39,423 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:42,195 __init__: ObsID 32030 has no maneuver event in telemetry, skipping
2025-12-07 12:17:42,197 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32030/index.html
2025-12-07 12:17:42,201 main:
2025-12-07 12:17:42,201 main: ********************************************************************************
2025-12-07 12:17:42,201 main: Processing observation 32023
2025-12-07 12:17:42,201 main: ********************************************************************************
2025-12-07 12:17:42,202 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32023/info.json file found, obs=None
2025-12-07 12:17:42,203 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2025-12-07 12:17:42,204 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/last.html
2025-12-07 12:17:45,645 __init__: ObsID 32023 has no maneuver event in telemetry, skipping
2025-12-07 12:17:45,646 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2025/DEC0125A/32023/index.html
2025-12-07 12:17:45,650 main: