Prev
Index
Next
centroid_dashboard: Thu Mar 12 13:17:30 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Thu Mar 12 13:17:30 2026 |
No errors
File contents:
2026-03-12 13:16:08,022 main: Processing from 2026:064:17:16:08.021 to 2026:071:17:16:08.021
2026-03-12 13:16:15,165 get_observations: Found observation 32202 at 2026:064:20:19:21.222 with 1 manvrs
2026-03-12 13:16:15,165 get_observations: Found observation 32194 at 2026:065:01:15:20.772 with 2 manvrs
2026-03-12 13:16:15,166 get_observations: Found observation 29632 at 2026:065:04:40:46.070 with 1 manvrs
2026-03-12 13:16:15,166 get_observations: Found observation 32195 at 2026:065:09:25:03.923 with 1 manvrs
2026-03-12 13:16:15,166 get_observations: Found observation 32173 at 2026:065:13:26:01.588 with 1 manvrs
2026-03-12 13:16:15,167 get_observations: Found observation 41670 at 2026:065:14:17:30.252 with 1 manvrs
2026-03-12 13:16:15,167 get_observations: Found observation 32183 at 2026:065:14:57:24.703 with 1 manvrs
2026-03-12 13:16:15,168 get_observations: Found observation 29888 at 2026:065:17:21:58.430 with 2 manvrs
2026-03-12 13:16:15,168 get_observations: Found observation 41668 at 2026:065:23:03:11.823 with 1 manvrs
2026-03-12 13:16:15,168 get_observations: Found observation 41667 at 2026:066:00:34:35.380 with 1 manvrs
2026-03-12 13:16:15,169 get_observations: Found observation 41666 at 2026:066:01:33:26.145 with 1 manvrs
2026-03-12 13:16:15,169 get_observations: Found observation 41664 at 2026:066:04:05:50.252 with 2 manvrs
2026-03-12 13:16:15,170 get_observations: Found observation 41663 at 2026:066:06:32:40.252 with 1 manvrs
2026-03-12 13:16:15,170 get_observations: Found observation 41662 at 2026:066:07:59:04.087 with 1 manvrs
2026-03-12 13:16:15,170 get_observations: Found observation 31258 at 2026:066:10:35:54.485 with 1 manvrs
2026-03-12 13:16:15,171 get_observations: Found observation 31897 at 2026:066:12:40:24.081 with 1 manvrs
2026-03-12 13:16:15,171 get_observations: Found observation 41661 at 2026:066:14:36:13.805 with 1 manvrs
2026-03-12 13:16:15,172 get_observations: Found observation 32184 at 2026:066:15:27:53.441 with 1 manvrs
2026-03-12 13:16:15,172 get_observations: Found observation 32196 at 2026:066:19:10:17.470 with 1 manvrs
2026-03-12 13:16:15,172 get_observations: Found observation 30344 at 2026:066:22:36:02.485 with 1 manvrs
2026-03-12 13:16:15,173 get_observations: Found observation 30266 at 2026:067:03:20:55.835 with 1 manvrs
2026-03-12 13:16:15,173 get_observations: Found observation 32201 at 2026:067:06:46:39.178 with 1 manvrs
2026-03-12 13:16:15,174 get_observations: Found observation 32197 at 2026:067:11:30:40.261 with 1 manvrs
2026-03-12 13:16:15,174 get_observations: Found observation 32185 at 2026:067:14:55:30.266 with 1 manvrs
2026-03-12 13:16:15,175 get_observations: Found observation 32198 at 2026:067:18:37:00.274 with 1 manvrs
2026-03-12 13:16:15,175 get_observations: Found observation 31081 at 2026:067:22:17:02.426 with 2 manvrs
2026-03-12 13:16:15,175 get_observations: Found observation 32208 at 2026:068:07:24:36.896 with 1 manvrs
2026-03-12 13:16:15,176 get_observations: Found observation 32205 at 2026:068:11:11:38.634 with 1 manvrs
2026-03-12 13:16:15,176 get_observations: Found observation 41659 at 2026:068:14:56:18.616 with 1 manvrs
2026-03-12 13:16:15,177 get_observations: Found observation 41658 at 2026:068:19:55:40.252 with 1 manvrs
2026-03-12 13:16:15,177 get_observations: Found observation 41657 at 2026:068:22:55:40.252 with 1 manvrs
2026-03-12 13:16:15,177 get_observations: Found observation 41656 at 2026:068:23:55:11.453 with 1 manvrs
2026-03-12 13:16:15,178 get_observations: Found observation 30333 at 2026:069:02:36:13.455 with 1 manvrs
2026-03-12 13:16:15,178 get_observations: Found observation 29920 at 2026:069:08:13:39.172 with 1 manvrs
2026-03-12 13:16:15,179 get_observations: Found observation 32216 at 2026:069:12:27:44.971 with 1 manvrs
2026-03-12 13:16:15,179 get_observations: Found observation 31149 at 2026:069:16:53:11.416 with 1 manvrs
2026-03-12 13:16:15,179 get_observations: Found observation 32209 at 2026:070:01:42:22.336 with 1 manvrs
2026-03-12 13:16:15,180 get_observations: Found observation 31123 at 2026:070:05:03:31.668 with 1 manvrs
2026-03-12 13:16:15,180 get_observations: Found observation 41655 at 2026:070:13:59:37.318 with 1 manvrs
2026-03-12 13:16:15,181 get_observations: Found observation 32221 at 2026:070:14:51:22.685 with 1 manvrs
2026-03-12 13:16:15,181 get_observations: Found observation 32213 at 2026:070:23:52:57.473 with 2 manvrs
2026-03-12 13:16:15,182 get_observations: Found observation 41653 at 2026:071:05:19:38.276 with 1 manvrs
2026-03-12 13:16:15,182 get_observations: Found observation 41652 at 2026:071:06:52:02.724 with 1 manvrs
2026-03-12 13:16:15,182 get_observations: Found observation 41651 at 2026:071:11:15:40.252 with 1 manvrs
2026-03-12 13:16:15,183 get_observations: Found observation 41649 at 2026:071:13:49:50.252 with 2 manvrs
2026-03-12 13:16:15,183 get_observations: Found observation 41648 at 2026:071:15:35:40.252 with 1 manvrs
2026-03-12 13:16:15,184 main: Found 46 observations
2026-03-12 13:16:15,184 main: ********************************************************************************
2026-03-12 13:16:15,184 main: Processing observation 32202
2026-03-12 13:16:15,184 main: ********************************************************************************
2026-03-12 13:16:15,383 obs_link_from_info: Found prev obsid 32193
2026-03-12 13:16:15,389 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 13:16:15,391 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 13:16:15,396 process_obs: ObsID 32202 already processed, skipping
2026-03-12 13:16:15,396 main:
2026-03-12 13:16:15,396 main: ********************************************************************************
2026-03-12 13:16:15,396 main: Processing observation 32194
2026-03-12 13:16:15,396 main: ********************************************************************************
2026-03-12 13:16:15,398 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 13:16:15,399 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 13:16:15,405 process_obs: ObsID 32194 already processed, skipping
2026-03-12 13:16:15,405 main:
2026-03-12 13:16:15,405 main: ********************************************************************************
2026-03-12 13:16:15,405 main: Processing observation 29632
2026-03-12 13:16:15,405 main: ********************************************************************************
2026-03-12 13:16:15,406 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 13:16:15,408 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 13:16:15,414 process_obs: ObsID 29632 already processed, skipping
2026-03-12 13:16:15,414 main:
2026-03-12 13:16:15,414 main: ********************************************************************************
2026-03-12 13:16:15,414 main: Processing observation 32195
2026-03-12 13:16:15,414 main: ********************************************************************************
2026-03-12 13:16:15,416 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 13:16:15,417 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 13:16:15,423 process_obs: ObsID 32195 already processed, skipping
2026-03-12 13:16:15,423 main:
2026-03-12 13:16:15,423 main: ********************************************************************************
2026-03-12 13:16:15,423 main: Processing observation 32173
2026-03-12 13:16:15,423 main: ********************************************************************************
2026-03-12 13:16:15,424 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 13:16:15,426 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:19,679 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/32173/centroid_resids.pkl
2026-03-12 12:16:19,681 write_centroid_resids: Centroid residuals file exists, skipping
2026-03-12 12:16:19,681 plot_crs_time: Plot file exists, skipping
2026-03-12 12:16:19,681 plot_crs_scatter: Plot file exists, skipping
2026-03-12 12:16:19,839 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-03-12 12:16:20,059 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/32173/n_kalman_delta_roll.png
2026-03-12 12:16:22,748 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/32173/index.html
2026-03-12 12:16:22,750 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/32173/info.json
2026-03-12 12:16:22,753 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32173/index.html
2026-03-12 12:16:22,753 main:
2026-03-12 12:16:22,754 main: ********************************************************************************
2026-03-12 12:16:22,754 main: Processing observation 41670
2026-03-12 12:16:22,754 main: ********************************************************************************
2026-03-12 12:16:22,755 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,756 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,759 process_obs: ObsID 41670 already processed, skipping
2026-03-12 12:16:22,759 main:
2026-03-12 12:16:22,759 main: ********************************************************************************
2026-03-12 12:16:22,759 main: Processing observation 32183
2026-03-12 12:16:22,759 main: ********************************************************************************
2026-03-12 12:16:22,760 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,761 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,764 process_obs: ObsID 32183 already processed, skipping
2026-03-12 12:16:22,764 main:
2026-03-12 12:16:22,764 main: ********************************************************************************
2026-03-12 12:16:22,764 main: Processing observation 29888
2026-03-12 12:16:22,764 main: ********************************************************************************
2026-03-12 12:16:22,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,766 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,770 process_obs: ObsID 29888 already processed, skipping
2026-03-12 12:16:22,770 main:
2026-03-12 12:16:22,770 main: ********************************************************************************
2026-03-12 12:16:22,770 main: Processing observation 41668
2026-03-12 12:16:22,770 main: ********************************************************************************
2026-03-12 12:16:22,771 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,772 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,775 process_obs: ObsID 41668 already processed, skipping
2026-03-12 12:16:22,775 main:
2026-03-12 12:16:22,775 main: ********************************************************************************
2026-03-12 12:16:22,775 main: Processing observation 41667
2026-03-12 12:16:22,775 main: ********************************************************************************
2026-03-12 12:16:22,776 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,777 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,780 process_obs: ObsID 41667 already processed, skipping
2026-03-12 12:16:22,780 main:
2026-03-12 12:16:22,780 main: ********************************************************************************
2026-03-12 12:16:22,780 main: Processing observation 41666
2026-03-12 12:16:22,780 main: ********************************************************************************
2026-03-12 12:16:22,781 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,782 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,785 process_obs: ObsID 41666 already processed, skipping
2026-03-12 12:16:22,785 main:
2026-03-12 12:16:22,785 main: ********************************************************************************
2026-03-12 12:16:22,785 main: Processing observation 41664
2026-03-12 12:16:22,785 main: ********************************************************************************
2026-03-12 12:16:22,786 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,787 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,790 process_obs: ObsID 41664 already processed, skipping
2026-03-12 12:16:22,790 main:
2026-03-12 12:16:22,790 main: ********************************************************************************
2026-03-12 12:16:22,790 main: Processing observation 41663
2026-03-12 12:16:22,790 main: ********************************************************************************
2026-03-12 12:16:22,791 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,792 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,796 process_obs: ObsID 41663 already processed, skipping
2026-03-12 12:16:22,796 main:
2026-03-12 12:16:22,796 main: ********************************************************************************
2026-03-12 12:16:22,796 main: Processing observation 41662
2026-03-12 12:16:22,796 main: ********************************************************************************
2026-03-12 12:16:22,797 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,798 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,801 process_obs: ObsID 41662 already processed, skipping
2026-03-12 12:16:22,801 main:
2026-03-12 12:16:22,801 main: ********************************************************************************
2026-03-12 12:16:22,801 main: Processing observation 31258
2026-03-12 12:16:22,801 main: ********************************************************************************
2026-03-12 12:16:22,802 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,803 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,806 process_obs: ObsID 31258 already processed, skipping
2026-03-12 12:16:22,806 main:
2026-03-12 12:16:22,806 main: ********************************************************************************
2026-03-12 12:16:22,806 main: Processing observation 31897
2026-03-12 12:16:22,806 main: ********************************************************************************
2026-03-12 12:16:22,807 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,808 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,811 process_obs: ObsID 31897 already processed, skipping
2026-03-12 12:16:22,811 main:
2026-03-12 12:16:22,811 main: ********************************************************************************
2026-03-12 12:16:22,811 main: Processing observation 41661
2026-03-12 12:16:22,811 main: ********************************************************************************
2026-03-12 12:16:22,812 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,813 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,816 process_obs: ObsID 41661 already processed, skipping
2026-03-12 12:16:22,816 main:
2026-03-12 12:16:22,816 main: ********************************************************************************
2026-03-12 12:16:22,816 main: Processing observation 32184
2026-03-12 12:16:22,816 main: ********************************************************************************
2026-03-12 12:16:22,817 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,818 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,821 process_obs: ObsID 32184 already processed, skipping
2026-03-12 12:16:22,821 main:
2026-03-12 12:16:22,822 main: ********************************************************************************
2026-03-12 12:16:22,822 main: Processing observation 32196
2026-03-12 12:16:22,822 main: ********************************************************************************
2026-03-12 12:16:22,822 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,823 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,827 process_obs: ObsID 32196 already processed, skipping
2026-03-12 12:16:22,827 main:
2026-03-12 12:16:22,827 main: ********************************************************************************
2026-03-12 12:16:22,827 main: Processing observation 30344
2026-03-12 12:16:22,827 main: ********************************************************************************
2026-03-12 12:16:22,828 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,829 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,832 process_obs: ObsID 30344 already processed, skipping
2026-03-12 12:16:22,832 main:
2026-03-12 12:16:22,832 main: ********************************************************************************
2026-03-12 12:16:22,832 main: Processing observation 30266
2026-03-12 12:16:22,832 main: ********************************************************************************
2026-03-12 12:16:22,833 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,834 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,837 process_obs: ObsID 30266 already processed, skipping
2026-03-12 12:16:22,837 main:
2026-03-12 12:16:22,837 main: ********************************************************************************
2026-03-12 12:16:22,837 main: Processing observation 32201
2026-03-12 12:16:22,837 main: ********************************************************************************
2026-03-12 12:16:22,838 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,839 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,842 process_obs: ObsID 32201 already processed, skipping
2026-03-12 12:16:22,842 main:
2026-03-12 12:16:22,842 main: ********************************************************************************
2026-03-12 12:16:22,842 main: Processing observation 32197
2026-03-12 12:16:22,842 main: ********************************************************************************
2026-03-12 12:16:22,843 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,844 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,847 process_obs: ObsID 32197 already processed, skipping
2026-03-12 12:16:22,847 main:
2026-03-12 12:16:22,847 main: ********************************************************************************
2026-03-12 12:16:22,847 main: Processing observation 32185
2026-03-12 12:16:22,847 main: ********************************************************************************
2026-03-12 12:16:22,848 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,849 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,853 process_obs: ObsID 32185 already processed, skipping
2026-03-12 12:16:22,853 main:
2026-03-12 12:16:22,853 main: ********************************************************************************
2026-03-12 12:16:22,853 main: Processing observation 32198
2026-03-12 12:16:22,853 main: ********************************************************************************
2026-03-12 12:16:22,854 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,855 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0226A/last.html
2026-03-12 12:16:22,858 process_obs: ObsID 32198 already processed, skipping
2026-03-12 12:16:22,858 main:
2026-03-12 12:16:22,858 main: ********************************************************************************
2026-03-12 12:16:22,858 main: Processing observation 31081
2026-03-12 12:16:22,858 main: ********************************************************************************
2026-03-12 12:16:22,859 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,860 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:22,863 process_obs: ObsID 31081 already processed, skipping
2026-03-12 12:16:22,863 main:
2026-03-12 12:16:22,863 main: ********************************************************************************
2026-03-12 12:16:22,863 main: Processing observation 32208
2026-03-12 12:16:22,863 main: ********************************************************************************
2026-03-12 12:16:22,864 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,865 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:22,868 process_obs: ObsID 32208 already processed, skipping
2026-03-12 12:16:22,869 main:
2026-03-12 12:16:22,869 main: ********************************************************************************
2026-03-12 12:16:22,869 main: Processing observation 32205
2026-03-12 12:16:22,869 main: ********************************************************************************
2026-03-12 12:16:22,869 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,871 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:22,886 process_obs: ObsID 32205 already processed, skipping
2026-03-12 12:16:22,886 main:
2026-03-12 12:16:22,886 main: ********************************************************************************
2026-03-12 12:16:22,886 main: Processing observation 41659
2026-03-12 12:16:22,886 main: ********************************************************************************
2026-03-12 12:16:22,887 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,888 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:22,902 process_obs: ObsID 41659 already processed, skipping
2026-03-12 12:16:22,902 main:
2026-03-12 12:16:22,902 main: ********************************************************************************
2026-03-12 12:16:22,902 main: Processing observation 41658
2026-03-12 12:16:22,902 main: ********************************************************************************
2026-03-12 12:16:22,903 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,904 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:22,917 process_obs: ObsID 41658 already processed, skipping
2026-03-12 12:16:22,917 main:
2026-03-12 12:16:22,917 main: ********************************************************************************
2026-03-12 12:16:22,917 main: Processing observation 41657
2026-03-12 12:16:22,917 main: ********************************************************************************
2026-03-12 12:16:22,918 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,919 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:22,935 process_obs: ObsID 41657 already processed, skipping
2026-03-12 12:16:22,935 main:
2026-03-12 12:16:22,935 main: ********************************************************************************
2026-03-12 12:16:22,935 main: Processing observation 41656
2026-03-12 12:16:22,935 main: ********************************************************************************
2026-03-12 12:16:22,936 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:22,937 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:23,002 process_obs: ObsID 41656 already processed, skipping
2026-03-12 12:16:23,002 main:
2026-03-12 12:16:23,002 main: ********************************************************************************
2026-03-12 12:16:23,002 main: Processing observation 30333
2026-03-12 12:16:23,002 main: ********************************************************************************
2026-03-12 12:16:23,003 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:23,004 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:23,017 process_obs: ObsID 30333 already processed, skipping
2026-03-12 12:16:23,017 main:
2026-03-12 12:16:23,017 main: ********************************************************************************
2026-03-12 12:16:23,017 main: Processing observation 29920
2026-03-12 12:16:23,017 main: ********************************************************************************
2026-03-12 12:16:23,018 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:23,019 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:23,030 process_obs: ObsID 29920 already processed, skipping
2026-03-12 12:16:23,030 main:
2026-03-12 12:16:23,030 main: ********************************************************************************
2026-03-12 12:16:23,030 main: Processing observation 32216
2026-03-12 12:16:23,030 main: ********************************************************************************
2026-03-12 12:16:23,031 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:23,032 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:23,048 process_obs: ObsID 32216 already processed, skipping
2026-03-12 12:16:23,048 main:
2026-03-12 12:16:23,048 main: ********************************************************************************
2026-03-12 12:16:23,048 main: Processing observation 31149
2026-03-12 12:16:23,048 main: ********************************************************************************
2026-03-12 12:16:23,049 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:23,050 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:23,061 process_obs: ObsID 31149 already processed, skipping
2026-03-12 12:16:23,061 main:
2026-03-12 12:16:23,061 main: ********************************************************************************
2026-03-12 12:16:23,061 main: Processing observation 32209
2026-03-12 12:16:23,061 main: ********************************************************************************
2026-03-12 12:16:23,062 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:23,063 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:25,464 get_centroid_resids: Computing centroid residuals from telemetry
2026-03-12 12:16:26,148 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32209/centroid_resids.pkl with 5 slots
2026-03-12 12:16:26,193 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32209/centroid_resids_time.png
2026-03-12 12:16:26,670 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32209/centroid_resids_scatter.png
2026-03-12 12:16:27,362 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32209/n_kalman_delta_roll.png
2026-03-12 12:16:35,479 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32209/index.html
2026-03-12 12:16:35,482 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32209/info.json
2026-03-12 12:16:35,487 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32209/index.html
2026-03-12 12:16:35,488 main:
2026-03-12 12:16:35,488 main: ********************************************************************************
2026-03-12 12:16:35,488 main: Processing observation 31123
2026-03-12 12:16:35,488 main: ********************************************************************************
2026-03-12 12:16:35,491 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:35,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:40,657 get_centroid_resids: Computing centroid residuals from telemetry
2026-03-12 12:16:41,126 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/31123/centroid_resids.pkl with 5 slots
2026-03-12 12:16:41,209 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/31123/centroid_resids_time.png
2026-03-12 12:16:41,779 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/31123/centroid_resids_scatter.png
2026-03-12 12:16:42,087 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-03-12 12:16:42,240 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/31123/n_kalman_delta_roll.png
2026-03-12 12:16:42,704 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/31123/index.html
2026-03-12 12:16:42,724 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/31123/info.json
2026-03-12 12:16:42,752 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31123/index.html
2026-03-12 12:16:42,768 main:
2026-03-12 12:16:42,768 main: ********************************************************************************
2026-03-12 12:16:42,768 main: Processing observation 41655
2026-03-12 12:16:42,768 main: ********************************************************************************
2026-03-12 12:16:42,784 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:42,807 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:47,340 get_centroid_resids: Computing centroid residuals from telemetry
2026-03-12 12:16:48,271 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41655/centroid_resids.pkl with 8 slots
2026-03-12 12:16:48,340 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41655/centroid_resids_time.png
2026-03-12 12:16:48,664 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41655/centroid_resids_scatter.png
2026-03-12 12:16:48,900 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-03-12 12:16:49,025 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41655/n_kalman_delta_roll.png
2026-03-12 12:16:49,370 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41655/index.html
2026-03-12 12:16:49,374 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41655/info.json
2026-03-12 12:16:49,385 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41655/index.html
2026-03-12 12:16:49,388 main:
2026-03-12 12:16:49,388 main: ********************************************************************************
2026-03-12 12:16:49,388 main: Processing observation 32221
2026-03-12 12:16:49,388 main: ********************************************************************************
2026-03-12 12:16:49,393 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:49,398 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:54,405 get_centroid_resids: Computing centroid residuals from telemetry
2026-03-12 12:16:54,719 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32221/centroid_resids.pkl with 5 slots
2026-03-12 12:16:54,776 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32221/centroid_resids_time.png
2026-03-12 12:16:55,074 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32221/centroid_resids_scatter.png
2026-03-12 12:16:55,283 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-03-12 12:16:55,435 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32221/n_kalman_delta_roll.png
2026-03-12 12:16:55,560 get_aberration_correction: More than one entry for 32221 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAR0926/oflsa/output/MAR0926A_ManErr.txt. Skipping aber correction
2026-03-12 12:16:55,571 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32221/index.html
2026-03-12 12:16:55,572 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32221/info.json
2026-03-12 12:16:55,575 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32221/index.html
2026-03-12 12:16:55,576 main:
2026-03-12 12:16:55,576 main: ********************************************************************************
2026-03-12 12:16:55,576 main: Processing observation 32213
2026-03-12 12:16:55,576 main: ********************************************************************************
2026-03-12 12:16:55,577 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:55,578 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:57,426 __init__: ObsID 32213 has insufficient telemetry, skipping
2026-03-12 12:16:57,426 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32213/index.html
2026-03-12 12:16:57,440 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/32213/info.json
2026-03-12 12:16:57,441 main:
2026-03-12 12:16:57,441 main: ********************************************************************************
2026-03-12 12:16:57,441 main: Processing observation 41653
2026-03-12 12:16:57,441 main: ********************************************************************************
2026-03-12 12:16:57,443 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:57,444 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:16:59,265 __init__: ObsID 41653 has insufficient telemetry, skipping
2026-03-12 12:16:59,265 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41653/index.html
2026-03-12 12:16:59,271 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41653/info.json
2026-03-12 12:16:59,272 main:
2026-03-12 12:16:59,272 main: ********************************************************************************
2026-03-12 12:16:59,272 main: Processing observation 41652
2026-03-12 12:16:59,272 main: ********************************************************************************
2026-03-12 12:16:59,273 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:16:59,274 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:17:01,222 __init__: ObsID 41652 has insufficient telemetry, skipping
2026-03-12 12:17:01,223 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41652/index.html
2026-03-12 12:17:01,230 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41652/info.json
2026-03-12 12:17:01,232 main:
2026-03-12 12:17:01,232 main: ********************************************************************************
2026-03-12 12:17:01,232 main: Processing observation 41651
2026-03-12 12:17:01,232 main: ********************************************************************************
2026-03-12 12:17:01,234 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:17:01,241 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:17:03,832 __init__: ObsID 41651 has no maneuver event in telemetry, skipping
2026-03-12 12:17:03,833 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41651/index.html
2026-03-12 12:17:03,839 info: could not get attribute kalman_start for obsid 41651
2026-03-12 12:17:03,839 info: could not get attribute kalman_stop for obsid 41651
2026-03-12 12:17:03,839 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41651/info.json
2026-03-12 12:17:03,840 main:
2026-03-12 12:17:03,840 main: ********************************************************************************
2026-03-12 12:17:03,840 main: Processing observation 41649
2026-03-12 12:17:03,840 main: ********************************************************************************
2026-03-12 12:17:03,842 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:17:03,843 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:17:08,194 __init__: ObsID 41649 has no maneuver event in telemetry, skipping
2026-03-12 12:17:08,195 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41649/index.html
2026-03-12 12:17:08,200 info: could not get attribute kalman_start for obsid 41649
2026-03-12 12:17:08,200 info: could not get attribute kalman_stop for obsid 41649
2026-03-12 12:17:08,200 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41649/info.json
2026-03-12 12:17:08,201 main:
2026-03-12 12:17:08,201 main: ********************************************************************************
2026-03-12 12:17:08,201 main: Processing observation 41648
2026-03-12 12:17:08,201 main: ********************************************************************************
2026-03-12 12:17:08,201 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41648/info.json file found, obs=None
2026-03-12 12:17:08,202 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-03-12 12:17:08,203 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/last.html
2026-03-12 12:17:09,928 __init__: ObsID 41648 has no maneuver event in telemetry, skipping
2026-03-12 12:17:09,928 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41648/index.html
2026-03-12 12:17:09,933 info: could not get attribute kalman_start for obsid 41648
2026-03-12 12:17:09,933 info: could not get attribute kalman_stop for obsid 41648
2026-03-12 12:17:09,933 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR0926A/41648/info.json
2026-03-12 12:17:09,934 main:
2026-03-12 13:17:11,319 run_check: Starting centroid dashboard continuity check
2026-03-12 13:17:11,319 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-03-12 13:17:11,332 collect_observations: Processing year 2020
2026-03-12 13:17:13,459 collect_observations: Processing year 2021
2026-03-12 13:17:16,418 collect_observations: Processing year 2022
2026-03-12 13:17:19,875 collect_observations: Processing year 2023
2026-03-12 13:17:23,280 collect_observations: Processing year 2024
2026-03-12 13:17:26,566 collect_observations: Processing year 2025
2026-03-12 13:17:30,181 collect_observations: Processing year 2026
2026-03-12 13:17:30,603 collect_observations: Collected 13478 observations from 4-digit years
2026-03-12 13:17:30,607 sort_observations_by_date: Sorted observations by date
2026-03-12 13:17:30,607 check_continuity: Starting continuity check from most recent: ObsID 41648 (MAR0926A) at 2026:071:14:57:23.303
2026-03-12 13:17:30,625 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-03-12 13:17:30,625 check_continuity: Chain complete: visited 13478 observations out of 13478 total
2026-03-12 13:17:30,625 run_check: ✓ Observation chain continuity check PASSED
2026-03-12 13:17:30,625 run_check: Summary: 13478 observations from 4-digit years, all properly linked