Prev
Index
Next
centroid_dashboard: Sun Feb 8 13:20:43 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
NOT OK
|
0.89 | 1.0 |
Sun Feb 8 13:20:43 2026 |
Errors:
- Line 398: 2026-02-08 12:17:16,442 main: Error making traceback HTML for 41744:
- Line 398: 2026-02-08 12:17:16,442 main: Error making traceback HTML for 41744:
- Line 399: Traceback (most recent call last):
- Line 409: During handling of the above exception, another exception occurred:
- Line 411: Traceback (most recent call last):
- Line 426: raise ValueError("manvr_event is None")
- Line 427: ValueError: manvr_event is None
- Line 437: 2026-02-08 12:17:18,813 main: Error making traceback HTML for 41743:
- Line 437: 2026-02-08 12:17:18,813 main: Error making traceback HTML for 41743:
- Line 438: Traceback (most recent call last):
- Line 448: During handling of the above exception, another exception occurred:
- Line 450: Traceback (most recent call last):
- Line 465: raise ValueError("manvr_event is None")
- Line 466: ValueError: manvr_event is None
- Line 477: 2026-02-08 12:17:21,290 main: Error making traceback HTML for 41742:
- Line 477: 2026-02-08 12:17:21,290 main: Error making traceback HTML for 41742:
- Line 478: Traceback (most recent call last):
- Line 488: During handling of the above exception, another exception occurred:
- Line 490: Traceback (most recent call last):
- Line 505: raise ValueError("manvr_event is None")
- Line 506: ValueError: manvr_event is None
File contents:
2026-02-08 13:16:13,078 main: Processing from 2026:032:18:16:13.077 to 2026:039:18:16:13.077
2026-02-08 13:16:19,533 get_observations: Found observation 31047 at 2026:032:20:25:37.776 with 1 manvrs
2026-02-08 13:16:19,534 get_observations: Found observation 29981 at 2026:033:00:24:26.175 with 1 manvrs
2026-02-08 13:16:19,534 get_observations: Found observation 31280 at 2026:033:05:00:54.712 with 1 manvrs
2026-02-08 13:16:19,535 get_observations: Found observation 29833 at 2026:033:09:10:44.770 with 1 manvrs
2026-02-08 13:16:19,535 get_observations: Found observation 32137 at 2026:033:12:53:48.124 with 1 manvrs
2026-02-08 13:16:19,535 get_observations: Found observation 32111 at 2026:033:16:20:11.605 with 1 manvrs
2026-02-08 13:16:19,536 get_observations: Found observation 30296 at 2026:033:19:49:07.478 with 1 manvrs
2026-02-08 13:16:19,536 get_observations: Found observation 30393 at 2026:034:01:55:34.046 with 1 manvrs
2026-02-08 13:16:19,537 get_observations: Found observation 41752 at 2026:034:04:56:49.499 with 1 manvrs
2026-02-08 13:16:19,537 get_observations: Found observation 41751 at 2026:034:08:55:40.252 with 1 manvrs
2026-02-08 13:16:19,537 get_observations: Found observation 41750 at 2026:034:11:25:40.252 with 1 manvrs
2026-02-08 13:16:19,538 get_observations: Found observation 41749 at 2026:034:15:05:40.252 with 1 manvrs
2026-02-08 13:16:19,538 get_observations: Found observation 41748 at 2026:034:16:10:40.252 with 1 manvrs
2026-02-08 13:16:19,539 get_observations: Found observation 30127 at 2026:034:17:18:24.662 with 1 manvrs
2026-02-08 13:16:19,539 get_observations: Found observation 31433 at 2026:034:22:03:31.441 with 1 manvrs
2026-02-08 13:16:19,539 get_observations: Found observation 32142 at 2026:035:01:48:38.256 with 1 manvrs
2026-02-08 13:16:19,540 get_observations: Found observation 31444 at 2026:035:06:10:01.636 with 1 manvrs
2026-02-08 13:16:19,540 get_observations: Found observation 31048 at 2026:035:08:31:44.625 with 1 manvrs
2026-02-08 13:16:19,541 get_observations: Found observation 31049 at 2026:035:12:00:14.625 with 1 manvrs
2026-02-08 13:16:19,541 get_observations: Found observation 30314 at 2026:035:15:49:13.033 with 1 manvrs
2026-02-08 13:16:19,542 get_observations: Found observation 31050 at 2026:035:21:00:44.242 with 1 manvrs
2026-02-08 13:16:19,542 get_observations: Found observation 32138 at 2026:036:00:34:42.343 with 1 manvrs
2026-02-08 13:16:19,543 get_observations: Found observation 30232 at 2026:036:03:59:23.856 with 1 manvrs
2026-02-08 13:16:19,543 get_observations: Found observation 30316 at 2026:036:07:38:06.221 with 1 manvrs
2026-02-08 13:16:19,543 get_observations: Found observation 41747 at 2026:036:20:40:24.879 with 1 manvrs
2026-02-08 13:16:19,544 get_observations: Found observation 41746 at 2026:037:00:10:40.252 with 1 manvrs
2026-02-08 13:16:19,544 get_observations: Found observation 41745 at 2026:037:03:55:10.901 with 1 manvrs
2026-02-08 13:16:19,545 get_observations: Found observation 32144 at 2026:037:08:49:20.882 with 1 manvrs
2026-02-08 13:16:19,545 get_observations: Found observation 31431 at 2026:037:13:57:39.381 with 1 manvrs
2026-02-08 13:16:19,545 get_observations: Found observation 32145 at 2026:037:17:42:35.721 with 1 manvrs
2026-02-08 13:16:19,546 get_observations: Found observation 32149 at 2026:037:21:10:52.173 with 1 manvrs
2026-02-08 13:16:19,546 get_observations: Found observation 30399 at 2026:038:00:55:40.846 with 1 manvrs
2026-02-08 13:16:19,546 get_observations: Found observation 32143 at 2026:038:04:37:17.540 with 1 manvrs
2026-02-08 13:16:19,547 get_observations: Found observation 32146 at 2026:038:10:15:30.679 with 1 manvrs
2026-02-08 13:16:19,547 get_observations: Found observation 32140 at 2026:038:14:45:53.507 with 1 manvrs
2026-02-08 13:16:19,548 get_observations: Found observation 30494 at 2026:038:16:55:19.818 with 1 manvrs
2026-02-08 13:16:19,548 get_observations: Found observation 32139 at 2026:038:20:51:46.973 with 1 manvrs
2026-02-08 13:16:19,548 get_observations: Found observation 31079 at 2026:039:00:31:46.326 with 1 manvrs
2026-02-08 13:16:19,549 get_observations: Found observation 32141 at 2026:039:09:27:34.429 with 1 manvrs
2026-02-08 13:16:19,549 get_observations: Found observation 41744 at 2026:039:12:04:22.935 with 1 manvrs
2026-02-08 13:16:19,550 get_observations: Found observation 41743 at 2026:039:13:55:40.252 with 1 manvrs
2026-02-08 13:16:19,550 get_observations: Found observation 41742 at 2026:039:15:40:40.252 with 1 manvrs
2026-02-08 13:16:19,551 main: Found 42 observations
2026-02-08 13:16:19,551 main: ********************************************************************************
2026-02-08 13:16:19,551 main: Processing observation 31047
2026-02-08 13:16:19,551 main: ********************************************************************************
2026-02-08 13:16:19,646 obs_link_from_info: Found prev obsid 31445
2026-02-08 13:16:19,678 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 13:16:19,714 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JAN2626A/last.html
2026-02-08 13:16:19,763 process_obs: ObsID 31047 already processed, skipping
2026-02-08 13:16:19,763 main:
2026-02-08 13:16:19,763 main: ********************************************************************************
2026-02-08 13:16:19,763 main: Processing observation 29981
2026-02-08 13:16:19,763 main: ********************************************************************************
2026-02-08 13:16:19,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 13:16:19,766 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 13:16:19,769 process_obs: ObsID 29981 already processed, skipping
2026-02-08 13:16:19,769 main:
2026-02-08 13:16:19,769 main: ********************************************************************************
2026-02-08 13:16:19,769 main: Processing observation 31280
2026-02-08 13:16:19,769 main: ********************************************************************************
2026-02-08 13:16:19,770 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 13:16:19,771 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 13:16:19,775 process_obs: ObsID 31280 already processed, skipping
2026-02-08 13:16:19,775 main:
2026-02-08 13:16:19,775 main: ********************************************************************************
2026-02-08 13:16:19,775 main: Processing observation 29833
2026-02-08 13:16:19,775 main: ********************************************************************************
2026-02-08 13:16:19,776 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 13:16:19,777 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:22,881 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/29833/centroid_resids.pkl
2026-02-08 12:16:23,550 write_centroid_resids: Centroid residuals file exists, skipping
2026-02-08 12:16:23,550 plot_crs_time: Plot file exists, skipping
2026-02-08 12:16:23,551 plot_crs_scatter: Plot file exists, skipping
2026-02-08 12:16:23,662 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-02-08 12:16:24,320 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/29833/n_kalman_delta_roll.png
2026-02-08 12:16:27,070 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/29833/index.html
2026-02-08 12:16:27,072 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/29833/info.json
2026-02-08 12:16:27,075 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29833/index.html
2026-02-08 12:16:27,076 main:
2026-02-08 12:16:27,076 main: ********************************************************************************
2026-02-08 12:16:27,076 main: Processing observation 32137
2026-02-08 12:16:27,076 main: ********************************************************************************
2026-02-08 12:16:27,077 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:27,078 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:29,163 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32137/centroid_resids.pkl
2026-02-08 12:16:29,449 write_centroid_resids: Centroid residuals file exists, skipping
2026-02-08 12:16:29,449 plot_crs_time: Plot file exists, skipping
2026-02-08 12:16:29,449 plot_crs_scatter: Plot file exists, skipping
2026-02-08 12:16:29,511 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-02-08 12:16:29,650 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32137/n_kalman_delta_roll.png
2026-02-08 12:16:29,778 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32137/index.html
2026-02-08 12:16:29,779 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32137/info.json
2026-02-08 12:16:29,782 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32137/index.html
2026-02-08 12:16:29,783 main:
2026-02-08 12:16:29,783 main: ********************************************************************************
2026-02-08 12:16:29,783 main: Processing observation 32111
2026-02-08 12:16:29,783 main: ********************************************************************************
2026-02-08 12:16:29,784 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:29,785 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:31,979 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32111/centroid_resids.pkl
2026-02-08 12:16:32,279 write_centroid_resids: Centroid residuals file exists, skipping
2026-02-08 12:16:32,280 plot_crs_time: Plot file exists, skipping
2026-02-08 12:16:32,280 plot_crs_scatter: Plot file exists, skipping
2026-02-08 12:16:32,342 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-02-08 12:16:32,494 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32111/n_kalman_delta_roll.png
2026-02-08 12:16:32,674 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32111/index.html
2026-02-08 12:16:32,691 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/32111/info.json
2026-02-08 12:16:32,762 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32111/index.html
2026-02-08 12:16:32,782 main:
2026-02-08 12:16:32,782 main: ********************************************************************************
2026-02-08 12:16:32,782 main: Processing observation 30296
2026-02-08 12:16:32,782 main: ********************************************************************************
2026-02-08 12:16:32,794 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,804 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,808 process_obs: ObsID 30296 already processed, skipping
2026-02-08 12:16:32,808 main:
2026-02-08 12:16:32,808 main: ********************************************************************************
2026-02-08 12:16:32,808 main: Processing observation 30393
2026-02-08 12:16:32,808 main: ********************************************************************************
2026-02-08 12:16:32,809 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,812 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,816 process_obs: ObsID 30393 already processed, skipping
2026-02-08 12:16:32,816 main:
2026-02-08 12:16:32,816 main: ********************************************************************************
2026-02-08 12:16:32,817 main: Processing observation 41752
2026-02-08 12:16:32,817 main: ********************************************************************************
2026-02-08 12:16:32,818 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,827 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,834 process_obs: ObsID 41752 already processed, skipping
2026-02-08 12:16:32,834 main:
2026-02-08 12:16:32,834 main: ********************************************************************************
2026-02-08 12:16:32,834 main: Processing observation 41751
2026-02-08 12:16:32,834 main: ********************************************************************************
2026-02-08 12:16:32,835 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,836 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,839 process_obs: ObsID 41751 already processed, skipping
2026-02-08 12:16:32,839 main:
2026-02-08 12:16:32,839 main: ********************************************************************************
2026-02-08 12:16:32,839 main: Processing observation 41750
2026-02-08 12:16:32,839 main: ********************************************************************************
2026-02-08 12:16:32,840 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,841 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,870 process_obs: ObsID 41750 already processed, skipping
2026-02-08 12:16:32,870 main:
2026-02-08 12:16:32,870 main: ********************************************************************************
2026-02-08 12:16:32,870 main: Processing observation 41749
2026-02-08 12:16:32,870 main: ********************************************************************************
2026-02-08 12:16:32,878 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,894 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,918 process_obs: ObsID 41749 already processed, skipping
2026-02-08 12:16:32,919 main:
2026-02-08 12:16:32,919 main: ********************************************************************************
2026-02-08 12:16:32,919 main: Processing observation 41748
2026-02-08 12:16:32,919 main: ********************************************************************************
2026-02-08 12:16:32,920 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,921 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,924 process_obs: ObsID 41748 already processed, skipping
2026-02-08 12:16:32,924 main:
2026-02-08 12:16:32,924 main: ********************************************************************************
2026-02-08 12:16:32,924 main: Processing observation 30127
2026-02-08 12:16:32,924 main: ********************************************************************************
2026-02-08 12:16:32,925 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,926 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,929 process_obs: ObsID 30127 already processed, skipping
2026-02-08 12:16:32,929 main:
2026-02-08 12:16:32,930 main: ********************************************************************************
2026-02-08 12:16:32,930 main: Processing observation 31433
2026-02-08 12:16:32,930 main: ********************************************************************************
2026-02-08 12:16:32,931 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,932 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,935 process_obs: ObsID 31433 already processed, skipping
2026-02-08 12:16:32,935 main:
2026-02-08 12:16:32,935 main: ********************************************************************************
2026-02-08 12:16:32,935 main: Processing observation 32142
2026-02-08 12:16:32,935 main: ********************************************************************************
2026-02-08 12:16:32,936 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,937 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,940 process_obs: ObsID 32142 already processed, skipping
2026-02-08 12:16:32,940 main:
2026-02-08 12:16:32,940 main: ********************************************************************************
2026-02-08 12:16:32,940 main: Processing observation 31444
2026-02-08 12:16:32,940 main: ********************************************************************************
2026-02-08 12:16:32,941 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,942 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,946 process_obs: ObsID 31444 already processed, skipping
2026-02-08 12:16:32,946 main:
2026-02-08 12:16:32,946 main: ********************************************************************************
2026-02-08 12:16:32,946 main: Processing observation 31048
2026-02-08 12:16:32,946 main: ********************************************************************************
2026-02-08 12:16:32,947 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,948 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,951 process_obs: ObsID 31048 already processed, skipping
2026-02-08 12:16:32,951 main:
2026-02-08 12:16:32,951 main: ********************************************************************************
2026-02-08 12:16:32,951 main: Processing observation 31049
2026-02-08 12:16:32,951 main: ********************************************************************************
2026-02-08 12:16:32,952 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,953 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,957 process_obs: ObsID 31049 already processed, skipping
2026-02-08 12:16:32,957 main:
2026-02-08 12:16:32,957 main: ********************************************************************************
2026-02-08 12:16:32,957 main: Processing observation 30314
2026-02-08 12:16:32,957 main: ********************************************************************************
2026-02-08 12:16:32,958 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,959 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,962 process_obs: ObsID 30314 already processed, skipping
2026-02-08 12:16:32,962 main:
2026-02-08 12:16:32,962 main: ********************************************************************************
2026-02-08 12:16:32,962 main: Processing observation 31050
2026-02-08 12:16:32,962 main: ********************************************************************************
2026-02-08 12:16:32,963 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,964 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,967 process_obs: ObsID 31050 already processed, skipping
2026-02-08 12:16:32,967 main:
2026-02-08 12:16:32,967 main: ********************************************************************************
2026-02-08 12:16:32,967 main: Processing observation 32138
2026-02-08 12:16:32,967 main: ********************************************************************************
2026-02-08 12:16:32,968 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,969 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,973 process_obs: ObsID 32138 already processed, skipping
2026-02-08 12:16:32,973 main:
2026-02-08 12:16:32,973 main: ********************************************************************************
2026-02-08 12:16:32,973 main: Processing observation 30232
2026-02-08 12:16:32,973 main: ********************************************************************************
2026-02-08 12:16:32,974 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,975 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,978 process_obs: ObsID 30232 already processed, skipping
2026-02-08 12:16:32,978 main:
2026-02-08 12:16:32,978 main: ********************************************************************************
2026-02-08 12:16:32,978 main: Processing observation 30316
2026-02-08 12:16:32,978 main: ********************************************************************************
2026-02-08 12:16:32,979 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,980 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:32,995 process_obs: ObsID 30316 already processed, skipping
2026-02-08 12:16:32,995 main:
2026-02-08 12:16:32,995 main: ********************************************************************************
2026-02-08 12:16:32,995 main: Processing observation 41747
2026-02-08 12:16:32,995 main: ********************************************************************************
2026-02-08 12:16:32,996 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:32,997 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:33,015 process_obs: ObsID 41747 already processed, skipping
2026-02-08 12:16:33,015 main:
2026-02-08 12:16:33,015 main: ********************************************************************************
2026-02-08 12:16:33,015 main: Processing observation 41746
2026-02-08 12:16:33,015 main: ********************************************************************************
2026-02-08 12:16:33,016 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:33,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:33,061 process_obs: ObsID 41746 already processed, skipping
2026-02-08 12:16:33,061 main:
2026-02-08 12:16:33,061 main: ********************************************************************************
2026-02-08 12:16:33,061 main: Processing observation 41745
2026-02-08 12:16:33,061 main: ********************************************************************************
2026-02-08 12:16:33,062 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:33,063 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:33,125 process_obs: ObsID 41745 already processed, skipping
2026-02-08 12:16:33,125 main:
2026-02-08 12:16:33,125 main: ********************************************************************************
2026-02-08 12:16:33,125 main: Processing observation 32144
2026-02-08 12:16:33,125 main: ********************************************************************************
2026-02-08 12:16:33,126 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:33,127 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0226A/last.html
2026-02-08 12:16:33,148 process_obs: ObsID 32144 already processed, skipping
2026-02-08 12:16:33,148 main:
2026-02-08 12:16:33,148 main: ********************************************************************************
2026-02-08 12:16:33,148 main: Processing observation 31431
2026-02-08 12:16:33,148 main: ********************************************************************************
2026-02-08 12:16:33,149 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:33,150 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:16:33,164 process_obs: ObsID 31431 already processed, skipping
2026-02-08 12:16:33,164 main:
2026-02-08 12:16:33,164 main: ********************************************************************************
2026-02-08 12:16:33,164 main: Processing observation 32145
2026-02-08 12:16:33,164 main: ********************************************************************************
2026-02-08 12:16:33,165 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:33,166 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:16:33,174 process_obs: ObsID 32145 already processed, skipping
2026-02-08 12:16:33,174 main:
2026-02-08 12:16:33,174 main: ********************************************************************************
2026-02-08 12:16:33,174 main: Processing observation 32149
2026-02-08 12:16:33,175 main: ********************************************************************************
2026-02-08 12:16:33,175 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:33,177 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:16:35,340 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32149/centroid_resids.pkl
2026-02-08 12:16:35,920 write_centroid_resids: Centroid residuals file exists, skipping
2026-02-08 12:16:35,920 plot_crs_time: Plot file exists, skipping
2026-02-08 12:16:35,920 plot_crs_scatter: Plot file exists, skipping
2026-02-08 12:16:36,669 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32149/n_kalman_delta_roll.png
2026-02-08 12:16:39,311 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32149/index.html
2026-02-08 12:16:39,313 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32149/info.json
2026-02-08 12:16:39,323 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32149/index.html
2026-02-08 12:16:39,324 main:
2026-02-08 12:16:39,324 main: ********************************************************************************
2026-02-08 12:16:39,324 main: Processing observation 30399
2026-02-08 12:16:39,324 main: ********************************************************************************
2026-02-08 12:16:39,325 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:39,327 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:16:41,977 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30399/centroid_resids.pkl with 5 slots
2026-02-08 12:16:42,030 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30399/centroid_resids_time.png
2026-02-08 12:16:44,072 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30399/centroid_resids_scatter.png
2026-02-08 12:16:45,211 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30399/n_kalman_delta_roll.png
2026-02-08 12:16:45,359 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30399/index.html
2026-02-08 12:16:45,366 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30399/info.json
2026-02-08 12:16:45,369 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30399/index.html
2026-02-08 12:16:45,370 main:
2026-02-08 12:16:45,370 main: ********************************************************************************
2026-02-08 12:16:45,370 main: Processing observation 32143
2026-02-08 12:16:45,370 main: ********************************************************************************
2026-02-08 12:16:45,371 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:45,372 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:16:48,548 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32143/centroid_resids.pkl with 5 slots
2026-02-08 12:16:48,602 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32143/centroid_resids_time.png
2026-02-08 12:16:48,876 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32143/centroid_resids_scatter.png
2026-02-08 12:16:49,784 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32143/n_kalman_delta_roll.png
2026-02-08 12:16:49,939 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32143/index.html
2026-02-08 12:16:49,941 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32143/info.json
2026-02-08 12:16:49,959 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32143/index.html
2026-02-08 12:16:49,960 main:
2026-02-08 12:16:49,960 main: ********************************************************************************
2026-02-08 12:16:49,960 main: Processing observation 32146
2026-02-08 12:16:49,960 main: ********************************************************************************
2026-02-08 12:16:49,961 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:49,962 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:16:52,963 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32146/centroid_resids.pkl with 5 slots
2026-02-08 12:16:53,020 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32146/centroid_resids_time.png
2026-02-08 12:16:53,278 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32146/centroid_resids_scatter.png
2026-02-08 12:16:54,240 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32146/n_kalman_delta_roll.png
2026-02-08 12:16:54,390 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32146/index.html
2026-02-08 12:16:54,398 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32146/info.json
2026-02-08 12:16:54,400 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32146/index.html
2026-02-08 12:16:54,401 main:
2026-02-08 12:16:54,401 main: ********************************************************************************
2026-02-08 12:16:54,401 main: Processing observation 32140
2026-02-08 12:16:54,401 main: ********************************************************************************
2026-02-08 12:16:54,403 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:54,404 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:16:57,351 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32140/centroid_resids.pkl with 5 slots
2026-02-08 12:16:57,392 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32140/centroid_resids_time.png
2026-02-08 12:16:57,623 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32140/centroid_resids_scatter.png
2026-02-08 12:16:58,310 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32140/n_kalman_delta_roll.png
2026-02-08 12:16:58,454 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32140/index.html
2026-02-08 12:16:58,462 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32140/info.json
2026-02-08 12:16:58,470 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32140/index.html
2026-02-08 12:16:58,471 main:
2026-02-08 12:16:58,471 main: ********************************************************************************
2026-02-08 12:16:58,471 main: Processing observation 30494
2026-02-08 12:16:58,471 main: ********************************************************************************
2026-02-08 12:16:58,472 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:16:58,473 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:17:01,369 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30494/centroid_resids.pkl with 5 slots
2026-02-08 12:17:01,419 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30494/centroid_resids_time.png
2026-02-08 12:17:01,975 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30494/centroid_resids_scatter.png
2026-02-08 12:17:02,142 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-02-08 12:17:02,304 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30494/n_kalman_delta_roll.png
2026-02-08 12:17:02,461 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30494/index.html
2026-02-08 12:17:02,465 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/30494/info.json
2026-02-08 12:17:02,471 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30494/index.html
2026-02-08 12:17:02,472 main:
2026-02-08 12:17:02,472 main: ********************************************************************************
2026-02-08 12:17:02,472 main: Processing observation 32139
2026-02-08 12:17:02,472 main: ********************************************************************************
2026-02-08 12:17:02,488 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:17:02,490 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:17:06,216 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32139/centroid_resids.pkl with 5 slots
2026-02-08 12:17:06,264 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32139/centroid_resids_time.png
2026-02-08 12:17:06,598 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32139/centroid_resids_scatter.png
2026-02-08 12:17:06,968 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-02-08 12:17:07,161 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32139/n_kalman_delta_roll.png
2026-02-08 12:17:07,466 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32139/index.html
2026-02-08 12:17:07,470 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32139/info.json
2026-02-08 12:17:07,479 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32139/index.html
2026-02-08 12:17:07,483 main:
2026-02-08 12:17:07,483 main: ********************************************************************************
2026-02-08 12:17:07,483 main: Processing observation 31079
2026-02-08 12:17:07,483 main: ********************************************************************************
2026-02-08 12:17:07,487 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:17:07,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:17:11,368 __init__: ObsID 31079 has insufficient telemetry, skipping
2026-02-08 12:17:11,374 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/31079/index.html
2026-02-08 12:17:11,389 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/31079/info.json
2026-02-08 12:17:11,410 main:
2026-02-08 12:17:11,410 main: ********************************************************************************
2026-02-08 12:17:11,410 main: Processing observation 32141
2026-02-08 12:17:11,410 main: ********************************************************************************
2026-02-08 12:17:11,428 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:17:11,454 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:17:14,097 __init__: ObsID 32141 has insufficient telemetry, skipping
2026-02-08 12:17:14,098 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32141/index.html
2026-02-08 12:17:14,104 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/32141/info.json
2026-02-08 12:17:14,105 main:
2026-02-08 12:17:14,105 main: ********************************************************************************
2026-02-08 12:17:14,105 main: Processing observation 41744
2026-02-08 12:17:14,105 main: ********************************************************************************
2026-02-08 12:17:14,110 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:17:14,114 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:17:16,370 __init__: ObsID 41744 has no maneuver event in telemetry, skipping
2026-02-08 12:17:16,378 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/41744/index.html
2026-02-08 12:17:16,442 main: Error making traceback HTML for 41744:
Traceback (most recent call last):
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1388, in main
process_obs(obs, opt)
~~~~~~~~~~~^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1294, in process_obs
raise SkipObservation(
f"ObsID {obs.obsid} has no maneuver event in telemetry, skipping"
)
ska_trend.centroid_dashboard.app.SkipObservation: ObsID 41744 has no maneuver event in telemetry, skipping
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1393, in main
write_info_json(obs, info_json_path)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1166, in write_info_json
out = obs.info.copy()
^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/functools.py", line 1025, in __get__
val = self.func(instance)
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 293, in info
out[attr] = getattr(self, attr).date
~~~~~~~^^^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/functools.py", line 1025, in __get__
val = self.func(instance)
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 270, in kalman_start
raise ValueError("manvr_event is None")
ValueError: manvr_event is None
2026-02-08 12:17:16,442 main:
2026-02-08 12:17:16,442 main: ********************************************************************************
2026-02-08 12:17:16,442 main: Processing observation 41743
2026-02-08 12:17:16,443 main: ********************************************************************************
2026-02-08 12:17:16,458 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:17:16,490 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:17:18,790 __init__: ObsID 41743 has no maneuver event in telemetry, skipping
2026-02-08 12:17:18,794 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/41743/index.html
2026-02-08 12:17:18,813 main: Error making traceback HTML for 41743:
Traceback (most recent call last):
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1388, in main
process_obs(obs, opt)
~~~~~~~~~~~^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1294, in process_obs
raise SkipObservation(
f"ObsID {obs.obsid} has no maneuver event in telemetry, skipping"
)
ska_trend.centroid_dashboard.app.SkipObservation: ObsID 41743 has no maneuver event in telemetry, skipping
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1393, in main
write_info_json(obs, info_json_path)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1166, in write_info_json
out = obs.info.copy()
^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/functools.py", line 1025, in __get__
val = self.func(instance)
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 293, in info
out[attr] = getattr(self, attr).date
~~~~~~~^^^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/functools.py", line 1025, in __get__
val = self.func(instance)
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 270, in kalman_start
raise ValueError("manvr_event is None")
ValueError: manvr_event is None
2026-02-08 12:17:18,813 main:
2026-02-08 12:17:18,813 main: ********************************************************************************
2026-02-08 12:17:18,813 main: Processing observation 41742
2026-02-08 12:17:18,813 main: ********************************************************************************
2026-02-08 12:17:18,818 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/41742/info.json file found, obs=None
2026-02-08 12:17:18,834 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-08 12:17:18,862 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-08 12:17:21,262 __init__: ObsID 41742 has no maneuver event in telemetry, skipping
2026-02-08 12:17:21,278 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/41742/index.html
2026-02-08 12:17:21,290 main: Error making traceback HTML for 41742:
Traceback (most recent call last):
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1388, in main
process_obs(obs, opt)
~~~~~~~~~~~^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1294, in process_obs
raise SkipObservation(
f"ObsID {obs.obsid} has no maneuver event in telemetry, skipping"
)
ska_trend.centroid_dashboard.app.SkipObservation: ObsID 41742 has no maneuver event in telemetry, skipping
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1393, in main
write_info_json(obs, info_json_path)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 1166, in write_info_json
out = obs.info.copy()
^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/functools.py", line 1025, in __get__
val = self.func(instance)
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 293, in info
out[attr] = getattr(self, attr).date
~~~~~~~^^^^^^^^^^^^
File "/proj/sot/ska3/aca/lib/python3.13/functools.py", line 1025, in __get__
val = self.func(instance)
File "/proj/sot/ska3/aca/lib/python3.13/site-packages/ska_trend/centroid_dashboard/app.py", line 270, in kalman_start
raise ValueError("manvr_event is None")
ValueError: manvr_event is None
2026-02-08 12:17:21,290 main:
2026-02-08 13:17:23,287 run_check: Starting centroid dashboard continuity check
2026-02-08 13:17:23,287 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-02-08 13:17:23,460 collect_observations: Processing year 2020
2026-02-08 13:17:50,372 collect_observations: Processing year 2021
2026-02-08 13:18:24,946 collect_observations: Processing year 2022
2026-02-08 13:19:00,281 collect_observations: Processing year 2023
2026-02-08 13:19:36,649 collect_observations: Processing year 2024
2026-02-08 13:20:11,969 collect_observations: Processing year 2025
2026-02-08 13:20:41,424 collect_observations: Processing year 2026
2026-02-08 13:20:43,231 collect_observations: Collected 13277 observations from 4-digit years
2026-02-08 13:20:43,238 sort_observations_by_date: Sorted observations by date
2026-02-08 13:20:43,238 check_continuity: Starting continuity check from most recent: ObsID 32141 (FEB0626A) at 2026:039:08:56:12.074
2026-02-08 13:20:43,258 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-02-08 13:20:43,258 check_continuity: Chain complete: visited 13277 observations out of 13277 total
2026-02-08 13:20:43,259 run_check: ✓ Observation chain continuity check PASSED
2026-02-08 13:20:43,259 run_check: Summary: 13277 observations from 4-digit years, all properly linked