Prev
Index
Next
centroid_dashboard: Thu Feb 19 13:17:20 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Thu Feb 19 13:17:20 2026 |
No errors
File contents:
2026-02-19 13:16:07,939 main: Processing from 2026:043:18:16:07.938 to 2026:050:18:16:07.938
2026-02-19 13:16:14,001 get_observations: Found observation 32150 at 2026:043:21:56:52.560 with 1 manvrs
2026-02-19 13:16:14,001 get_observations: Found observation 30302 at 2026:044:01:16:57.951 with 1 manvrs
2026-02-19 13:16:14,002 get_observations: Found observation 32151 at 2026:044:10:10:59.836 with 1 manvrs
2026-02-19 13:16:14,002 get_observations: Found observation 29827 at 2026:044:14:57:18.020 with 1 manvrs
2026-02-19 13:16:14,002 get_observations: Found observation 41729 at 2026:044:19:32:53.963 with 1 manvrs
2026-02-19 13:16:14,003 get_observations: Found observation 41728 at 2026:044:20:55:52.790 with 1 manvrs
2026-02-19 13:16:14,003 get_observations: Found observation 41727 at 2026:044:22:29:15.914 with 1 manvrs
2026-02-19 13:16:14,004 get_observations: Found observation 41726 at 2026:045:01:55:40.252 with 1 manvrs
2026-02-19 13:16:14,004 get_observations: Found observation 41725 at 2026:045:04:25:40.252 with 1 manvrs
2026-02-19 13:16:14,004 get_observations: Found observation 41724 at 2026:045:05:24:14.458 with 1 manvrs
2026-02-19 13:16:14,005 get_observations: Found observation 41723 at 2026:045:06:13:18.766 with 1 manvrs
2026-02-19 13:16:14,005 get_observations: Found observation 30238 at 2026:045:07:23:02.236 with 1 manvrs
2026-02-19 13:16:14,006 get_observations: Found observation 32158 at 2026:045:13:26:07.528 with 2 manvrs
2026-02-19 13:16:14,006 get_observations: Found observation 32155 at 2026:045:19:12:54.338 with 2 manvrs
2026-02-19 13:16:14,006 get_observations: Found observation 32159 at 2026:045:23:36:21.350 with 2 manvrs
2026-02-19 13:16:14,007 get_observations: Found observation 30248 at 2026:046:04:33:35.688 with 2 manvrs
2026-02-19 13:16:14,007 get_observations: Found observation 32160 at 2026:046:10:04:10.351 with 2 manvrs
2026-02-19 13:16:14,008 get_observations: Found observation 32157 at 2026:046:14:53:12.809 with 2 manvrs
2026-02-19 13:16:14,008 get_observations: Found observation 32156 at 2026:046:18:09:33.665 with 1 manvrs
2026-02-19 13:16:14,008 get_observations: Found observation 29861 at 2026:046:22:42:56.065 with 1 manvrs
2026-02-19 13:16:14,009 get_observations: Found observation 30069 at 2026:047:02:50:59.845 with 1 manvrs
2026-02-19 13:16:14,010 get_observations: Found observation 32164 at 2026:047:06:25:43.623 with 1 manvrs
2026-02-19 13:16:14,010 get_observations: Found observation 41716 at 2026:047:10:30:56.048 with 1 manvrs
2026-02-19 13:16:14,010 get_observations: Found observation 41715 at 2026:047:11:53:48.729 with 1 manvrs
2026-02-19 13:16:14,011 get_observations: Found observation 41714 at 2026:047:16:55:40.252 with 1 manvrs
2026-02-19 13:16:14,011 get_observations: Found observation 30306 at 2026:047:23:13:01.167 with 1 manvrs
2026-02-19 13:16:14,012 get_observations: Found observation 41713 at 2026:048:13:34:18.761 with 1 manvrs
2026-02-19 13:16:14,012 get_observations: Found observation 31994 at 2026:048:14:21:00.279 with 1 manvrs
2026-02-19 13:16:14,012 get_observations: Found observation 31895 at 2026:048:18:50:22.124 with 1 manvrs
2026-02-19 13:16:14,013 get_observations: Found observation 41712 at 2026:048:20:22:15.326 with 1 manvrs
2026-02-19 13:16:14,013 get_observations: Found observation 30422 at 2026:048:21:00:53.792 with 1 manvrs
2026-02-19 13:16:14,014 get_observations: Found observation 32171 at 2026:049:08:39:24.176 with 1 manvrs
2026-02-19 13:16:14,014 get_observations: Found observation 26972 at 2026:049:13:05:53.800 with 1 manvrs
2026-02-19 13:16:14,014 get_observations: Found observation 41711 at 2026:049:14:47:01.717 with 1 manvrs
2026-02-19 13:16:14,015 get_observations: Found observation 30425 at 2026:049:15:34:05.917 with 1 manvrs
2026-02-19 13:16:14,015 get_observations: Found observation 31008 at 2026:049:22:14:13.433 with 1 manvrs
2026-02-19 13:16:14,016 get_observations: Found observation 41710 at 2026:050:02:09:52.607 with 1 manvrs
2026-02-19 13:16:14,016 get_observations: Found observation 41709 at 2026:050:03:30:24.359 with 1 manvrs
2026-02-19 13:16:14,016 get_observations: Found observation 41708 at 2026:050:07:55:40.252 with 1 manvrs
2026-02-19 13:16:14,017 get_observations: Found observation 41707 at 2026:050:12:25:40.252 with 1 manvrs
2026-02-19 13:16:14,017 get_observations: Found observation 32169 at 2026:050:14:11:23.306 with 1 manvrs
2026-02-19 13:16:14,018 get_observations: Found observation 31995 at 2026:050:17:31:54.397 with 1 manvrs
2026-02-19 13:16:14,018 main: Found 42 observations
2026-02-19 13:16:14,018 main: ********************************************************************************
2026-02-19 13:16:14,018 main: Processing observation 32150
2026-02-19 13:16:14,018 main: ********************************************************************************
2026-02-19 13:16:14,033 obs_link_from_info: Found prev obsid 30298
2026-02-19 13:16:14,037 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,038 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,041 process_obs: ObsID 32150 already processed, skipping
2026-02-19 13:16:14,041 main:
2026-02-19 13:16:14,041 main: ********************************************************************************
2026-02-19 13:16:14,041 main: Processing observation 30302
2026-02-19 13:16:14,041 main: ********************************************************************************
2026-02-19 13:16:14,042 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,043 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,047 process_obs: ObsID 30302 already processed, skipping
2026-02-19 13:16:14,047 main:
2026-02-19 13:16:14,047 main: ********************************************************************************
2026-02-19 13:16:14,047 main: Processing observation 32151
2026-02-19 13:16:14,047 main: ********************************************************************************
2026-02-19 13:16:14,048 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,049 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,052 process_obs: ObsID 32151 already processed, skipping
2026-02-19 13:16:14,052 main:
2026-02-19 13:16:14,052 main: ********************************************************************************
2026-02-19 13:16:14,052 main: Processing observation 29827
2026-02-19 13:16:14,052 main: ********************************************************************************
2026-02-19 13:16:14,053 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,054 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,058 process_obs: ObsID 29827 already processed, skipping
2026-02-19 13:16:14,058 main:
2026-02-19 13:16:14,058 main: ********************************************************************************
2026-02-19 13:16:14,058 main: Processing observation 41729
2026-02-19 13:16:14,058 main: ********************************************************************************
2026-02-19 13:16:14,059 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,060 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,063 process_obs: ObsID 41729 already processed, skipping
2026-02-19 13:16:14,064 main:
2026-02-19 13:16:14,064 main: ********************************************************************************
2026-02-19 13:16:14,064 main: Processing observation 41728
2026-02-19 13:16:14,064 main: ********************************************************************************
2026-02-19 13:16:14,064 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,066 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,069 process_obs: ObsID 41728 already processed, skipping
2026-02-19 13:16:14,069 main:
2026-02-19 13:16:14,069 main: ********************************************************************************
2026-02-19 13:16:14,069 main: Processing observation 41727
2026-02-19 13:16:14,069 main: ********************************************************************************
2026-02-19 13:16:14,070 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,071 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,074 process_obs: ObsID 41727 already processed, skipping
2026-02-19 13:16:14,074 main:
2026-02-19 13:16:14,074 main: ********************************************************************************
2026-02-19 13:16:14,074 main: Processing observation 41726
2026-02-19 13:16:14,074 main: ********************************************************************************
2026-02-19 13:16:14,075 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,076 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,080 process_obs: ObsID 41726 already processed, skipping
2026-02-19 13:16:14,080 main:
2026-02-19 13:16:14,080 main: ********************************************************************************
2026-02-19 13:16:14,080 main: Processing observation 41725
2026-02-19 13:16:14,080 main: ********************************************************************************
2026-02-19 13:16:14,081 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,082 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,085 process_obs: ObsID 41725 already processed, skipping
2026-02-19 13:16:14,085 main:
2026-02-19 13:16:14,085 main: ********************************************************************************
2026-02-19 13:16:14,085 main: Processing observation 41724
2026-02-19 13:16:14,085 main: ********************************************************************************
2026-02-19 13:16:14,086 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,087 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,090 process_obs: ObsID 41724 already processed, skipping
2026-02-19 13:16:14,090 main:
2026-02-19 13:16:14,090 main: ********************************************************************************
2026-02-19 13:16:14,090 main: Processing observation 41723
2026-02-19 13:16:14,090 main: ********************************************************************************
2026-02-19 13:16:14,091 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,092 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,095 process_obs: ObsID 41723 already processed, skipping
2026-02-19 13:16:14,095 main:
2026-02-19 13:16:14,095 main: ********************************************************************************
2026-02-19 13:16:14,095 main: Processing observation 30238
2026-02-19 13:16:14,095 main: ********************************************************************************
2026-02-19 13:16:14,096 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,097 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,101 process_obs: ObsID 30238 already processed, skipping
2026-02-19 13:16:14,101 main:
2026-02-19 13:16:14,101 main: ********************************************************************************
2026-02-19 13:16:14,101 main: Processing observation 32158
2026-02-19 13:16:14,101 main: ********************************************************************************
2026-02-19 13:16:14,102 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,103 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,106 process_obs: ObsID 32158 already processed, skipping
2026-02-19 13:16:14,106 main:
2026-02-19 13:16:14,106 main: ********************************************************************************
2026-02-19 13:16:14,106 main: Processing observation 32155
2026-02-19 13:16:14,106 main: ********************************************************************************
2026-02-19 13:16:14,107 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,108 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,111 process_obs: ObsID 32155 already processed, skipping
2026-02-19 13:16:14,111 main:
2026-02-19 13:16:14,111 main: ********************************************************************************
2026-02-19 13:16:14,111 main: Processing observation 32159
2026-02-19 13:16:14,111 main: ********************************************************************************
2026-02-19 13:16:14,112 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,113 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,117 process_obs: ObsID 32159 already processed, skipping
2026-02-19 13:16:14,117 main:
2026-02-19 13:16:14,117 main: ********************************************************************************
2026-02-19 13:16:14,117 main: Processing observation 30248
2026-02-19 13:16:14,117 main: ********************************************************************************
2026-02-19 13:16:14,118 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,119 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,122 process_obs: ObsID 30248 already processed, skipping
2026-02-19 13:16:14,122 main:
2026-02-19 13:16:14,122 main: ********************************************************************************
2026-02-19 13:16:14,122 main: Processing observation 32160
2026-02-19 13:16:14,122 main: ********************************************************************************
2026-02-19 13:16:14,123 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,127 process_obs: ObsID 32160 already processed, skipping
2026-02-19 13:16:14,127 main:
2026-02-19 13:16:14,127 main: ********************************************************************************
2026-02-19 13:16:14,127 main: Processing observation 32157
2026-02-19 13:16:14,127 main: ********************************************************************************
2026-02-19 13:16:14,128 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,129 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,132 process_obs: ObsID 32157 already processed, skipping
2026-02-19 13:16:14,132 main:
2026-02-19 13:16:14,132 main: ********************************************************************************
2026-02-19 13:16:14,132 main: Processing observation 32156
2026-02-19 13:16:14,132 main: ********************************************************************************
2026-02-19 13:16:14,133 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,134 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB0626A/last.html
2026-02-19 13:16:14,137 process_obs: ObsID 32156 already processed, skipping
2026-02-19 13:16:14,138 main:
2026-02-19 13:16:14,138 main: ********************************************************************************
2026-02-19 13:16:14,138 main: Processing observation 29861
2026-02-19 13:16:14,138 main: ********************************************************************************
2026-02-19 13:16:14,139 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,140 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 13:16:14,143 process_obs: ObsID 29861 already processed, skipping
2026-02-19 13:16:14,143 main:
2026-02-19 13:16:14,143 main: ********************************************************************************
2026-02-19 13:16:14,143 main: Processing observation 30069
2026-02-19 13:16:14,143 main: ********************************************************************************
2026-02-19 13:16:14,144 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 13:16:14,149 process_obs: ObsID 30069 already processed, skipping
2026-02-19 13:16:14,149 main:
2026-02-19 13:16:14,149 main: ********************************************************************************
2026-02-19 13:16:14,149 main: Processing observation 32164
2026-02-19 13:16:14,149 main: ********************************************************************************
2026-02-19 13:16:14,150 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,151 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 13:16:14,154 process_obs: ObsID 32164 already processed, skipping
2026-02-19 13:16:14,154 main:
2026-02-19 13:16:14,154 main: ********************************************************************************
2026-02-19 13:16:14,154 main: Processing observation 41716
2026-02-19 13:16:14,154 main: ********************************************************************************
2026-02-19 13:16:14,155 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,156 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 13:16:14,159 process_obs: ObsID 41716 already processed, skipping
2026-02-19 13:16:14,159 main:
2026-02-19 13:16:14,159 main: ********************************************************************************
2026-02-19 13:16:14,159 main: Processing observation 41715
2026-02-19 13:16:14,159 main: ********************************************************************************
2026-02-19 13:16:14,160 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,161 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 13:16:14,164 process_obs: ObsID 41715 already processed, skipping
2026-02-19 13:16:14,164 main:
2026-02-19 13:16:14,164 main: ********************************************************************************
2026-02-19 13:16:14,164 main: Processing observation 41714
2026-02-19 13:16:14,164 main: ********************************************************************************
2026-02-19 13:16:14,165 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,166 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 13:16:14,169 process_obs: ObsID 41714 already processed, skipping
2026-02-19 13:16:14,169 main:
2026-02-19 13:16:14,169 main: ********************************************************************************
2026-02-19 13:16:14,169 main: Processing observation 30306
2026-02-19 13:16:14,169 main: ********************************************************************************
2026-02-19 13:16:14,170 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 13:16:14,171 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:17,013 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30306/centroid_resids.pkl
2026-02-19 12:16:17,049 write_centroid_resids: Centroid residuals file exists, skipping
2026-02-19 12:16:17,049 plot_crs_time: Plot file exists, skipping
2026-02-19 12:16:17,049 plot_crs_scatter: Plot file exists, skipping
2026-02-19 12:16:18,738 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30306/n_kalman_delta_roll.png
2026-02-19 12:16:21,067 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30306/index.html
2026-02-19 12:16:21,069 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30306/info.json
2026-02-19 12:16:21,083 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30306/index.html
2026-02-19 12:16:21,084 main:
2026-02-19 12:16:21,084 main: ********************************************************************************
2026-02-19 12:16:21,084 main: Processing observation 41713
2026-02-19 12:16:21,084 main: ********************************************************************************
2026-02-19 12:16:21,085 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:21,086 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:21,104 process_obs: ObsID 41713 already processed, skipping
2026-02-19 12:16:21,104 main:
2026-02-19 12:16:21,104 main: ********************************************************************************
2026-02-19 12:16:21,104 main: Processing observation 31994
2026-02-19 12:16:21,104 main: ********************************************************************************
2026-02-19 12:16:21,105 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:21,106 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:21,122 process_obs: ObsID 31994 already processed, skipping
2026-02-19 12:16:21,122 main:
2026-02-19 12:16:21,122 main: ********************************************************************************
2026-02-19 12:16:21,122 main: Processing observation 31895
2026-02-19 12:16:21,122 main: ********************************************************************************
2026-02-19 12:16:21,123 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:21,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:21,137 process_obs: ObsID 31895 already processed, skipping
2026-02-19 12:16:21,137 main:
2026-02-19 12:16:21,137 main: ********************************************************************************
2026-02-19 12:16:21,137 main: Processing observation 41712
2026-02-19 12:16:21,137 main: ********************************************************************************
2026-02-19 12:16:21,138 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:21,139 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:21,148 process_obs: ObsID 41712 already processed, skipping
2026-02-19 12:16:21,148 main:
2026-02-19 12:16:21,148 main: ********************************************************************************
2026-02-19 12:16:21,148 main: Processing observation 30422
2026-02-19 12:16:21,148 main: ********************************************************************************
2026-02-19 12:16:21,149 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:21,150 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:23,268 get_centroid_resids: Computing centroid residuals from telemetry
2026-02-19 12:16:23,634 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30422/centroid_resids.pkl with 5 slots
2026-02-19 12:16:23,702 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30422/centroid_resids_time.png
2026-02-19 12:16:24,272 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30422/centroid_resids_scatter.png
2026-02-19 12:16:25,492 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30422/n_kalman_delta_roll.png
2026-02-19 12:16:27,742 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30422/index.html
2026-02-19 12:16:27,743 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30422/info.json
2026-02-19 12:16:27,746 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30422/index.html
2026-02-19 12:16:27,747 main:
2026-02-19 12:16:27,747 main: ********************************************************************************
2026-02-19 12:16:27,747 main: Processing observation 32171
2026-02-19 12:16:27,747 main: ********************************************************************************
2026-02-19 12:16:27,748 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:27,749 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:29,820 get_centroid_resids: Computing centroid residuals from telemetry
2026-02-19 12:16:30,102 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32171/centroid_resids.pkl with 5 slots
2026-02-19 12:16:30,151 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32171/centroid_resids_time.png
2026-02-19 12:16:30,606 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32171/centroid_resids_scatter.png
2026-02-19 12:16:31,544 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32171/n_kalman_delta_roll.png
2026-02-19 12:16:31,692 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32171/index.html
2026-02-19 12:16:31,693 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32171/info.json
2026-02-19 12:16:31,709 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32171/index.html
2026-02-19 12:16:31,710 main:
2026-02-19 12:16:31,710 main: ********************************************************************************
2026-02-19 12:16:31,710 main: Processing observation 26972
2026-02-19 12:16:31,710 main: ********************************************************************************
2026-02-19 12:16:31,711 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:31,712 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:33,878 get_centroid_resids: Computing centroid residuals from telemetry
2026-02-19 12:16:34,121 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/26972/centroid_resids.pkl with 5 slots
2026-02-19 12:16:34,163 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/26972/centroid_resids_time.png
2026-02-19 12:16:34,438 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/26972/centroid_resids_scatter.png
2026-02-19 12:16:35,094 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/26972/n_kalman_delta_roll.png
2026-02-19 12:16:35,228 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/26972/index.html
2026-02-19 12:16:35,229 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/26972/info.json
2026-02-19 12:16:35,282 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/26/26972/index.html
2026-02-19 12:16:35,283 main:
2026-02-19 12:16:35,283 main: ********************************************************************************
2026-02-19 12:16:35,283 main: Processing observation 41711
2026-02-19 12:16:35,283 main: ********************************************************************************
2026-02-19 12:16:35,284 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:35,285 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:37,433 get_centroid_resids: Computing centroid residuals from telemetry
2026-02-19 12:16:37,843 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41711/centroid_resids.pkl with 8 slots
2026-02-19 12:16:37,903 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41711/centroid_resids_time.png
2026-02-19 12:16:38,163 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41711/centroid_resids_scatter.png
2026-02-19 12:16:38,237 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-02-19 12:16:38,355 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41711/n_kalman_delta_roll.png
2026-02-19 12:16:38,492 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41711/index.html
2026-02-19 12:16:38,494 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41711/info.json
2026-02-19 12:16:38,497 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41711/index.html
2026-02-19 12:16:38,498 main:
2026-02-19 12:16:38,498 main: ********************************************************************************
2026-02-19 12:16:38,498 main: Processing observation 30425
2026-02-19 12:16:38,498 main: ********************************************************************************
2026-02-19 12:16:38,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:38,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:40,630 get_centroid_resids: Computing centroid residuals from telemetry
2026-02-19 12:16:40,921 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30425/centroid_resids.pkl with 5 slots
2026-02-19 12:16:40,972 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30425/centroid_resids_time.png
2026-02-19 12:16:41,233 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30425/centroid_resids_scatter.png
2026-02-19 12:16:42,210 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30425/n_kalman_delta_roll.png
2026-02-19 12:16:42,351 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30425/index.html
2026-02-19 12:16:42,352 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/30425/info.json
2026-02-19 12:16:42,354 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30425/index.html
2026-02-19 12:16:42,355 main:
2026-02-19 12:16:42,355 main: ********************************************************************************
2026-02-19 12:16:42,355 main: Processing observation 31008
2026-02-19 12:16:42,355 main: ********************************************************************************
2026-02-19 12:16:42,365 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:42,366 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:44,460 get_centroid_resids: Computing centroid residuals from telemetry
2026-02-19 12:16:44,737 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31008/centroid_resids.pkl with 5 slots
2026-02-19 12:16:44,784 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31008/centroid_resids_time.png
2026-02-19 12:16:45,033 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31008/centroid_resids_scatter.png
2026-02-19 12:16:45,177 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-02-19 12:16:45,336 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31008/n_kalman_delta_roll.png
2026-02-19 12:16:45,466 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31008/index.html
2026-02-19 12:16:45,468 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31008/info.json
2026-02-19 12:16:45,470 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31008/index.html
2026-02-19 12:16:45,471 main:
2026-02-19 12:16:45,471 main: ********************************************************************************
2026-02-19 12:16:45,471 main: Processing observation 41710
2026-02-19 12:16:45,471 main: ********************************************************************************
2026-02-19 12:16:45,473 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:45,474 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:47,514 __init__: ObsID 41710 has insufficient telemetry, skipping
2026-02-19 12:16:47,515 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41710/index.html
2026-02-19 12:16:47,519 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41710/info.json
2026-02-19 12:16:47,520 main:
2026-02-19 12:16:47,520 main: ********************************************************************************
2026-02-19 12:16:47,520 main: Processing observation 41709
2026-02-19 12:16:47,520 main: ********************************************************************************
2026-02-19 12:16:47,521 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:47,522 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:49,589 __init__: ObsID 41709 has insufficient telemetry, skipping
2026-02-19 12:16:49,589 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41709/index.html
2026-02-19 12:16:49,596 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41709/info.json
2026-02-19 12:16:49,597 main:
2026-02-19 12:16:49,597 main: ********************************************************************************
2026-02-19 12:16:49,597 main: Processing observation 41708
2026-02-19 12:16:49,597 main: ********************************************************************************
2026-02-19 12:16:49,598 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:49,599 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:51,601 __init__: ObsID 41708 has no maneuver event in telemetry, skipping
2026-02-19 12:16:51,601 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41708/index.html
2026-02-19 12:16:51,605 info: could not get attribute kalman_start for obsid 41708
2026-02-19 12:16:51,606 info: could not get attribute kalman_stop for obsid 41708
2026-02-19 12:16:51,606 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41708/info.json
2026-02-19 12:16:51,607 main:
2026-02-19 12:16:51,607 main: ********************************************************************************
2026-02-19 12:16:51,607 main: Processing observation 41707
2026-02-19 12:16:51,607 main: ********************************************************************************
2026-02-19 12:16:51,608 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:51,609 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:53,582 __init__: ObsID 41707 has no maneuver event in telemetry, skipping
2026-02-19 12:16:53,582 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41707/index.html
2026-02-19 12:16:53,586 info: could not get attribute kalman_start for obsid 41707
2026-02-19 12:16:53,587 info: could not get attribute kalman_stop for obsid 41707
2026-02-19 12:16:53,587 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/41707/info.json
2026-02-19 12:16:53,588 main:
2026-02-19 12:16:53,588 main: ********************************************************************************
2026-02-19 12:16:53,588 main: Processing observation 32169
2026-02-19 12:16:53,588 main: ********************************************************************************
2026-02-19 12:16:53,589 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:53,590 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:55,557 __init__: ObsID 32169 has no maneuver event in telemetry, skipping
2026-02-19 12:16:55,558 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32169/index.html
2026-02-19 12:16:55,562 info: could not get attribute kalman_start for obsid 32169
2026-02-19 12:16:55,562 info: could not get attribute kalman_stop for obsid 32169
2026-02-19 12:16:55,562 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/32169/info.json
2026-02-19 12:16:55,563 main:
2026-02-19 12:16:55,563 main: ********************************************************************************
2026-02-19 12:16:55,563 main: Processing observation 31995
2026-02-19 12:16:55,563 main: ********************************************************************************
2026-02-19 12:16:55,563 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31995/info.json file found, obs=None
2026-02-19 12:16:55,564 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-02-19 12:16:55,565 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/last.html
2026-02-19 12:16:57,604 __init__: ObsID 31995 has no maneuver event in telemetry, skipping
2026-02-19 12:16:57,604 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31995/index.html
2026-02-19 12:16:57,609 info: could not get attribute kalman_start for obsid 31995
2026-02-19 12:16:57,609 info: could not get attribute kalman_stop for obsid 31995
2026-02-19 12:16:57,609 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/FEB1626A/31995/info.json
2026-02-19 12:16:57,610 main:
2026-02-19 13:16:58,946 run_check: Starting centroid dashboard continuity check
2026-02-19 13:16:58,946 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-02-19 13:16:58,950 collect_observations: Processing year 2020
2026-02-19 13:17:01,313 collect_observations: Processing year 2021
2026-02-19 13:17:07,847 collect_observations: Processing year 2022
2026-02-19 13:17:11,165 collect_observations: Processing year 2023
2026-02-19 13:17:14,372 collect_observations: Processing year 2024
2026-02-19 13:17:17,449 collect_observations: Processing year 2025
2026-02-19 13:17:20,561 collect_observations: Processing year 2026
2026-02-19 13:17:20,839 collect_observations: Collected 13343 observations from 4-digit years
2026-02-19 13:17:20,843 sort_observations_by_date: Sorted observations by date
2026-02-19 13:17:20,843 check_continuity: Starting continuity check from most recent: ObsID 31995 (FEB1626A) at 2026:050:17:04:37.696
2026-02-19 13:17:20,860 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-02-19 13:17:20,860 check_continuity: Chain complete: visited 13343 observations out of 13343 total
2026-02-19 13:17:20,860 run_check: ✓ Observation chain continuity check PASSED
2026-02-19 13:17:20,860 run_check: Summary: 13343 observations from 4-digit years, all properly linked