Prev
Index
Next
centroid_dashboard: Wed Apr 29 13:17:53 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Wed Apr 29 13:17:53 2026 |
No errors
File contents:
2026-04-29 13:16:11,877 main: Processing from 2026:112:17:16:11.876 to 2026:119:17:16:11.876
2026-04-29 13:16:17,914 get_observations: Found observation 32309 at 2026:112:19:51:48.037 with 1 manvrs
2026-04-29 13:16:17,914 get_observations: Found observation 31516 at 2026:113:00:40:53.146 with 1 manvrs
2026-04-29 13:16:17,915 get_observations: Found observation 32310 at 2026:113:05:13:20.917 with 1 manvrs
2026-04-29 13:16:17,915 get_observations: Found observation 31399 at 2026:113:08:30:22.198 with 1 manvrs
2026-04-29 13:16:17,915 get_observations: Found observation 41536 at 2026:113:11:56:08.483 with 1 manvrs
2026-04-29 13:16:17,916 get_observations: Found observation 41535 at 2026:113:12:59:34.314 with 1 manvrs
2026-04-29 13:16:17,916 get_observations: Found observation 41534 at 2026:113:17:55:40.252 with 1 manvrs
2026-04-29 13:16:17,917 get_observations: Found observation 41533 at 2026:113:21:54:40.252 with 1 manvrs
2026-04-29 13:16:17,917 get_observations: Found observation 32312 at 2026:113:23:35:50.205 with 1 manvrs
2026-04-29 13:16:17,917 get_observations: Found observation 30024 at 2026:114:05:27:29.527 with 1 manvrs
2026-04-29 13:16:17,918 get_observations: Found observation 32313 at 2026:114:09:39:12.814 with 1 manvrs
2026-04-29 13:16:17,918 get_observations: Found observation 31734 at 2026:114:15:17:19.167 with 1 manvrs
2026-04-29 13:16:17,919 get_observations: Found observation 32307 at 2026:115:02:41:28.729 with 1 manvrs
2026-04-29 13:16:17,919 get_observations: Found observation 32314 at 2026:115:06:06:59.496 with 1 manvrs
2026-04-29 13:16:17,920 get_observations: Found observation 31083 at 2026:115:09:26:38.721 with 1 manvrs
2026-04-29 13:16:17,920 get_observations: Found observation 32315 at 2026:115:14:42:57.679 with 1 manvrs
2026-04-29 13:16:17,920 get_observations: Found observation 29530 at 2026:115:17:58:03.618 with 1 manvrs
2026-04-29 13:16:17,921 get_observations: Found observation 29867 at 2026:115:19:25:52.373 with 1 manvrs
2026-04-29 13:16:17,921 get_observations: Found observation 41532 at 2026:116:03:09:33.391 with 1 manvrs
2026-04-29 13:16:17,922 get_observations: Found observation 41531 at 2026:116:06:55:40.252 with 1 manvrs
2026-04-29 13:16:17,922 get_observations: Found observation 41530 at 2026:116:10:25:40.252 with 1 manvrs
2026-04-29 13:16:17,922 get_observations: Found observation 41529 at 2026:116:12:55:40.252 with 1 manvrs
2026-04-29 13:16:17,923 get_observations: Found observation 32308 at 2026:116:15:53:31.989 with 1 manvrs
2026-04-29 13:16:17,923 get_observations: Found observation 32316 at 2026:116:22:28:40.593 with 1 manvrs
2026-04-29 13:16:17,924 get_observations: Found observation 30228 at 2026:117:01:55:38.939 with 1 manvrs
2026-04-29 13:16:17,924 get_observations: Found observation 30189 at 2026:117:05:58:23.023 with 1 manvrs
2026-04-29 13:16:17,925 get_observations: Found observation 32321 at 2026:117:09:52:53.399 with 1 manvrs
2026-04-29 13:16:17,925 get_observations: Found observation 30199 at 2026:117:15:35:45.774 with 1 manvrs
2026-04-29 13:16:17,925 get_observations: Found observation 30046 at 2026:117:20:36:56.590 with 1 manvrs
2026-04-29 13:16:17,926 get_observations: Found observation 32320 at 2026:118:03:28:14.369 with 1 manvrs
2026-04-29 13:16:17,926 get_observations: Found observation 32319 at 2026:118:08:23:07.028 with 1 manvrs
2026-04-29 13:16:17,927 get_observations: Found observation 29883 at 2026:118:15:21:04.757 with 1 manvrs
2026-04-29 13:16:17,927 get_observations: Found observation 41528 at 2026:118:18:50:19.464 with 1 manvrs
2026-04-29 13:16:17,927 get_observations: Found observation 41527 at 2026:118:20:55:40.252 with 1 manvrs
2026-04-29 13:16:17,928 get_observations: Found observation 41526 at 2026:118:23:55:40.252 with 1 manvrs
2026-04-29 13:16:17,928 get_observations: Found observation 41525 at 2026:119:01:55:40.252 with 1 manvrs
2026-04-29 13:16:17,929 get_observations: Found observation 41524 at 2026:119:03:55:40.252 with 1 manvrs
2026-04-29 13:16:17,929 get_observations: Found observation 41523 at 2026:119:05:55:40.252 with 1 manvrs
2026-04-29 13:16:17,929 get_observations: Found observation 31877 at 2026:119:07:27:52.176 with 1 manvrs
2026-04-29 13:16:17,930 get_observations: Found observation 31106 at 2026:119:11:50:14.616 with 1 manvrs
2026-04-29 13:16:17,930 main: Found 40 observations
2026-04-29 13:16:17,930 main: ********************************************************************************
2026-04-29 13:16:17,930 main: Processing observation 32309
2026-04-29 13:16:17,930 main: ********************************************************************************
2026-04-29 13:16:17,934 obs_link_from_info: Found prev obsid 32311
2026-04-29 13:16:17,937 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,938 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,941 process_obs: ObsID 32309 already processed, skipping
2026-04-29 13:16:17,941 main:
2026-04-29 13:16:17,941 main: ********************************************************************************
2026-04-29 13:16:17,941 main: Processing observation 31516
2026-04-29 13:16:17,941 main: ********************************************************************************
2026-04-29 13:16:17,942 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,943 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,946 process_obs: ObsID 31516 already processed, skipping
2026-04-29 13:16:17,946 main:
2026-04-29 13:16:17,946 main: ********************************************************************************
2026-04-29 13:16:17,947 main: Processing observation 32310
2026-04-29 13:16:17,947 main: ********************************************************************************
2026-04-29 13:16:17,947 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,948 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,952 process_obs: ObsID 32310 already processed, skipping
2026-04-29 13:16:17,952 main:
2026-04-29 13:16:17,952 main: ********************************************************************************
2026-04-29 13:16:17,952 main: Processing observation 31399
2026-04-29 13:16:17,952 main: ********************************************************************************
2026-04-29 13:16:17,953 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,954 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,957 process_obs: ObsID 31399 already processed, skipping
2026-04-29 13:16:17,957 main:
2026-04-29 13:16:17,957 main: ********************************************************************************
2026-04-29 13:16:17,957 main: Processing observation 41536
2026-04-29 13:16:17,957 main: ********************************************************************************
2026-04-29 13:16:17,958 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,959 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,962 process_obs: ObsID 41536 already processed, skipping
2026-04-29 13:16:17,962 main:
2026-04-29 13:16:17,962 main: ********************************************************************************
2026-04-29 13:16:17,962 main: Processing observation 41535
2026-04-29 13:16:17,962 main: ********************************************************************************
2026-04-29 13:16:17,963 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,964 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,967 process_obs: ObsID 41535 already processed, skipping
2026-04-29 13:16:17,967 main:
2026-04-29 13:16:17,967 main: ********************************************************************************
2026-04-29 13:16:17,967 main: Processing observation 41534
2026-04-29 13:16:17,967 main: ********************************************************************************
2026-04-29 13:16:17,968 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,969 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,972 process_obs: ObsID 41534 already processed, skipping
2026-04-29 13:16:17,972 main:
2026-04-29 13:16:17,972 main: ********************************************************************************
2026-04-29 13:16:17,972 main: Processing observation 41533
2026-04-29 13:16:17,972 main: ********************************************************************************
2026-04-29 13:16:17,973 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,974 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,977 process_obs: ObsID 41533 already processed, skipping
2026-04-29 13:16:17,977 main:
2026-04-29 13:16:17,978 main: ********************************************************************************
2026-04-29 13:16:17,978 main: Processing observation 32312
2026-04-29 13:16:17,978 main: ********************************************************************************
2026-04-29 13:16:17,978 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,979 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,982 process_obs: ObsID 32312 already processed, skipping
2026-04-29 13:16:17,982 main:
2026-04-29 13:16:17,983 main: ********************************************************************************
2026-04-29 13:16:17,983 main: Processing observation 30024
2026-04-29 13:16:17,983 main: ********************************************************************************
2026-04-29 13:16:17,983 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,984 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,988 process_obs: ObsID 30024 already processed, skipping
2026-04-29 13:16:17,988 main:
2026-04-29 13:16:17,988 main: ********************************************************************************
2026-04-29 13:16:17,988 main: Processing observation 32313
2026-04-29 13:16:17,988 main: ********************************************************************************
2026-04-29 13:16:17,989 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,990 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:17,993 process_obs: ObsID 32313 already processed, skipping
2026-04-29 13:16:17,993 main:
2026-04-29 13:16:17,993 main: ********************************************************************************
2026-04-29 13:16:17,993 main: Processing observation 31734
2026-04-29 13:16:17,993 main: ********************************************************************************
2026-04-29 13:16:17,994 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:17,995 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,011 process_obs: ObsID 31734 already processed, skipping
2026-04-29 13:16:18,011 main:
2026-04-29 13:16:18,011 main: ********************************************************************************
2026-04-29 13:16:18,011 main: Processing observation 32307
2026-04-29 13:16:18,011 main: ********************************************************************************
2026-04-29 13:16:18,012 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,013 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,016 process_obs: ObsID 32307 already processed, skipping
2026-04-29 13:16:18,016 main:
2026-04-29 13:16:18,016 main: ********************************************************************************
2026-04-29 13:16:18,016 main: Processing observation 32314
2026-04-29 13:16:18,016 main: ********************************************************************************
2026-04-29 13:16:18,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,018 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,022 process_obs: ObsID 32314 already processed, skipping
2026-04-29 13:16:18,022 main:
2026-04-29 13:16:18,022 main: ********************************************************************************
2026-04-29 13:16:18,022 main: Processing observation 31083
2026-04-29 13:16:18,022 main: ********************************************************************************
2026-04-29 13:16:18,023 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,024 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,027 process_obs: ObsID 31083 already processed, skipping
2026-04-29 13:16:18,027 main:
2026-04-29 13:16:18,027 main: ********************************************************************************
2026-04-29 13:16:18,027 main: Processing observation 32315
2026-04-29 13:16:18,027 main: ********************************************************************************
2026-04-29 13:16:18,028 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,029 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,032 process_obs: ObsID 32315 already processed, skipping
2026-04-29 13:16:18,032 main:
2026-04-29 13:16:18,032 main: ********************************************************************************
2026-04-29 13:16:18,032 main: Processing observation 29530
2026-04-29 13:16:18,032 main: ********************************************************************************
2026-04-29 13:16:18,033 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,034 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,037 process_obs: ObsID 29530 already processed, skipping
2026-04-29 13:16:18,037 main:
2026-04-29 13:16:18,037 main: ********************************************************************************
2026-04-29 13:16:18,037 main: Processing observation 29867
2026-04-29 13:16:18,037 main: ********************************************************************************
2026-04-29 13:16:18,038 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,039 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,050 process_obs: ObsID 29867 already processed, skipping
2026-04-29 13:16:18,050 main:
2026-04-29 13:16:18,050 main: ********************************************************************************
2026-04-29 13:16:18,050 main: Processing observation 41532
2026-04-29 13:16:18,050 main: ********************************************************************************
2026-04-29 13:16:18,051 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,052 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,068 process_obs: ObsID 41532 already processed, skipping
2026-04-29 13:16:18,068 main:
2026-04-29 13:16:18,068 main: ********************************************************************************
2026-04-29 13:16:18,068 main: Processing observation 41531
2026-04-29 13:16:18,068 main: ********************************************************************************
2026-04-29 13:16:18,069 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,070 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,076 process_obs: ObsID 41531 already processed, skipping
2026-04-29 13:16:18,076 main:
2026-04-29 13:16:18,076 main: ********************************************************************************
2026-04-29 13:16:18,076 main: Processing observation 41530
2026-04-29 13:16:18,076 main: ********************************************************************************
2026-04-29 13:16:18,077 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,078 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,097 process_obs: ObsID 41530 already processed, skipping
2026-04-29 13:16:18,097 main:
2026-04-29 13:16:18,097 main: ********************************************************************************
2026-04-29 13:16:18,097 main: Processing observation 41529
2026-04-29 13:16:18,097 main: ********************************************************************************
2026-04-29 13:16:18,098 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,099 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,117 process_obs: ObsID 41529 already processed, skipping
2026-04-29 13:16:18,117 main:
2026-04-29 13:16:18,117 main: ********************************************************************************
2026-04-29 13:16:18,117 main: Processing observation 32308
2026-04-29 13:16:18,117 main: ********************************************************************************
2026-04-29 13:16:18,118 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,119 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,134 process_obs: ObsID 32308 already processed, skipping
2026-04-29 13:16:18,134 main:
2026-04-29 13:16:18,134 main: ********************************************************************************
2026-04-29 13:16:18,134 main: Processing observation 32316
2026-04-29 13:16:18,134 main: ********************************************************************************
2026-04-29 13:16:18,135 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,136 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-29 13:16:18,159 process_obs: ObsID 32316 already processed, skipping
2026-04-29 13:16:18,159 main:
2026-04-29 13:16:18,159 main: ********************************************************************************
2026-04-29 13:16:18,159 main: Processing observation 30228
2026-04-29 13:16:18,159 main: ********************************************************************************
2026-04-29 13:16:18,160 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,161 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 13:16:18,168 process_obs: ObsID 30228 already processed, skipping
2026-04-29 13:16:18,168 main:
2026-04-29 13:16:18,168 main: ********************************************************************************
2026-04-29 13:16:18,168 main: Processing observation 30189
2026-04-29 13:16:18,168 main: ********************************************************************************
2026-04-29 13:16:18,169 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,170 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 13:16:18,187 process_obs: ObsID 30189 already processed, skipping
2026-04-29 13:16:18,187 main:
2026-04-29 13:16:18,187 main: ********************************************************************************
2026-04-29 13:16:18,187 main: Processing observation 32321
2026-04-29 13:16:18,187 main: ********************************************************************************
2026-04-29 13:16:18,188 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,189 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 13:16:18,205 process_obs: ObsID 32321 already processed, skipping
2026-04-29 13:16:18,205 main:
2026-04-29 13:16:18,205 main: ********************************************************************************
2026-04-29 13:16:18,205 main: Processing observation 30199
2026-04-29 13:16:18,205 main: ********************************************************************************
2026-04-29 13:16:18,206 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 13:16:18,207 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:16:20,651 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30199/centroid_resids.pkl
2026-04-29 12:16:20,702 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-29 12:16:20,702 plot_crs_time: Plot file exists, skipping
2026-04-29 12:16:20,703 plot_crs_scatter: Plot file exists, skipping
2026-04-29 12:16:23,082 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30199/n_kalman_delta_roll.png
2026-04-29 12:16:33,786 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30199/index.html
2026-04-29 12:16:33,788 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30199/info.json
2026-04-29 12:16:33,809 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30199/index.html
2026-04-29 12:16:33,810 main:
2026-04-29 12:16:33,810 main: ********************************************************************************
2026-04-29 12:16:33,810 main: Processing observation 30046
2026-04-29 12:16:33,810 main: ********************************************************************************
2026-04-29 12:16:33,812 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:16:33,813 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:16:37,933 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-29 12:16:38,467 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30046/centroid_resids.pkl with 5 slots
2026-04-29 12:16:38,521 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30046/centroid_resids_time.png
2026-04-29 12:16:38,840 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30046/centroid_resids_scatter.png
2026-04-29 12:16:39,891 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30046/n_kalman_delta_roll.png
2026-04-29 12:16:40,049 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30046/index.html
2026-04-29 12:16:40,051 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/30046/info.json
2026-04-29 12:16:40,067 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30046/index.html
2026-04-29 12:16:40,068 main:
2026-04-29 12:16:40,069 main: ********************************************************************************
2026-04-29 12:16:40,069 main: Processing observation 32320
2026-04-29 12:16:40,069 main: ********************************************************************************
2026-04-29 12:16:40,070 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:16:40,071 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:16:43,610 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-29 12:16:44,674 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32320/centroid_resids.pkl with 5 slots
2026-04-29 12:16:44,727 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32320/centroid_resids_time.png
2026-04-29 12:16:45,243 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32320/centroid_resids_scatter.png
2026-04-29 12:16:46,685 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32320/n_kalman_delta_roll.png
2026-04-29 12:16:46,979 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32320/index.html
2026-04-29 12:16:46,985 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32320/info.json
2026-04-29 12:16:46,993 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32320/index.html
2026-04-29 12:16:47,009 main:
2026-04-29 12:16:47,009 main: ********************************************************************************
2026-04-29 12:16:47,009 main: Processing observation 32319
2026-04-29 12:16:47,009 main: ********************************************************************************
2026-04-29 12:16:47,013 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:16:47,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:16:50,666 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-29 12:16:50,959 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32319/centroid_resids.pkl with 5 slots
2026-04-29 12:16:51,010 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32319/centroid_resids_time.png
2026-04-29 12:16:51,284 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32319/centroid_resids_scatter.png
2026-04-29 12:16:52,280 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32319/n_kalman_delta_roll.png
2026-04-29 12:16:52,424 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32319/index.html
2026-04-29 12:16:52,426 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/32319/info.json
2026-04-29 12:16:52,428 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32319/index.html
2026-04-29 12:16:52,429 main:
2026-04-29 12:16:52,429 main: ********************************************************************************
2026-04-29 12:16:52,429 main: Processing observation 29883
2026-04-29 12:16:52,429 main: ********************************************************************************
2026-04-29 12:16:52,430 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:16:52,431 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:16:54,543 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-29 12:16:54,798 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/29883/centroid_resids.pkl with 5 slots
2026-04-29 12:16:54,842 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/29883/centroid_resids_time.png
2026-04-29 12:16:55,080 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/29883/centroid_resids_scatter.png
2026-04-29 12:16:55,861 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/29883/n_kalman_delta_roll.png
2026-04-29 12:16:56,003 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/29883/index.html
2026-04-29 12:16:56,004 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/29883/info.json
2026-04-29 12:16:56,007 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29883/index.html
2026-04-29 12:16:56,008 main:
2026-04-29 12:16:56,008 main: ********************************************************************************
2026-04-29 12:16:56,008 main: Processing observation 41528
2026-04-29 12:16:56,008 main: ********************************************************************************
2026-04-29 12:16:56,009 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:16:56,010 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:16:58,119 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-29 12:16:58,529 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41528/centroid_resids.pkl with 8 slots
2026-04-29 12:16:58,604 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41528/centroid_resids_time.png
2026-04-29 12:16:58,896 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41528/centroid_resids_scatter.png
2026-04-29 12:16:58,984 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-29 12:16:59,097 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41528/n_kalman_delta_roll.png
2026-04-29 12:16:59,232 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41528/index.html
2026-04-29 12:16:59,233 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41528/info.json
2026-04-29 12:16:59,249 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41528/index.html
2026-04-29 12:16:59,250 main:
2026-04-29 12:16:59,250 main: ********************************************************************************
2026-04-29 12:16:59,250 main: Processing observation 41527
2026-04-29 12:16:59,250 main: ********************************************************************************
2026-04-29 12:16:59,252 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:16:59,253 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:17:01,390 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-29 12:17:01,879 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41527/centroid_resids.pkl with 8 slots
2026-04-29 12:17:01,955 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41527/centroid_resids_time.png
2026-04-29 12:17:02,328 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41527/centroid_resids_scatter.png
2026-04-29 12:17:02,435 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-29 12:17:02,563 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41527/n_kalman_delta_roll.png
2026-04-29 12:17:02,728 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41527/index.html
2026-04-29 12:17:02,731 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41527/info.json
2026-04-29 12:17:02,734 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41527/index.html
2026-04-29 12:17:02,736 main:
2026-04-29 12:17:02,736 main: ********************************************************************************
2026-04-29 12:17:02,736 main: Processing observation 41526
2026-04-29 12:17:02,736 main: ********************************************************************************
2026-04-29 12:17:02,737 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:17:02,738 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:17:05,210 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-29 12:17:06,216 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41526/centroid_resids.pkl with 8 slots
2026-04-29 12:17:06,292 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41526/centroid_resids_time.png
2026-04-29 12:17:06,642 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41526/centroid_resids_scatter.png
2026-04-29 12:17:07,091 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-29 12:17:07,212 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41526/n_kalman_delta_roll.png
2026-04-29 12:17:08,064 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41526/index.html
2026-04-29 12:17:08,088 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41526/info.json
2026-04-29 12:17:08,148 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41526/index.html
2026-04-29 12:17:08,168 main:
2026-04-29 12:17:08,168 main: ********************************************************************************
2026-04-29 12:17:08,168 main: Processing observation 41525
2026-04-29 12:17:08,168 main: ********************************************************************************
2026-04-29 12:17:08,192 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:17:08,220 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:17:10,748 __init__: ObsID 41525 has insufficient telemetry, skipping
2026-04-29 12:17:10,748 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41525/index.html
2026-04-29 12:17:10,753 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41525/info.json
2026-04-29 12:17:10,754 main:
2026-04-29 12:17:10,754 main: ********************************************************************************
2026-04-29 12:17:10,754 main: Processing observation 41524
2026-04-29 12:17:10,754 main: ********************************************************************************
2026-04-29 12:17:10,755 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:17:10,756 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:17:12,852 __init__: ObsID 41524 has insufficient telemetry, skipping
2026-04-29 12:17:12,853 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41524/index.html
2026-04-29 12:17:12,857 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41524/info.json
2026-04-29 12:17:12,858 main:
2026-04-29 12:17:12,858 main: ********************************************************************************
2026-04-29 12:17:12,858 main: Processing observation 41523
2026-04-29 12:17:12,858 main: ********************************************************************************
2026-04-29 12:17:12,860 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:17:12,861 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:17:15,003 __init__: ObsID 41523 has insufficient telemetry, skipping
2026-04-29 12:17:15,004 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41523/index.html
2026-04-29 12:17:15,009 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/41523/info.json
2026-04-29 12:17:15,010 main:
2026-04-29 12:17:15,010 main: ********************************************************************************
2026-04-29 12:17:15,010 main: Processing observation 31877
2026-04-29 12:17:15,010 main: ********************************************************************************
2026-04-29 12:17:15,011 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:17:15,012 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:17:17,070 __init__: ObsID 31877 has no maneuver event in telemetry, skipping
2026-04-29 12:17:17,071 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31877/index.html
2026-04-29 12:17:17,076 info: could not get attribute kalman_start for obsid 31877
2026-04-29 12:17:17,076 info: could not get attribute kalman_stop for obsid 31877
2026-04-29 12:17:17,076 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31877/info.json
2026-04-29 12:17:17,077 main:
2026-04-29 12:17:17,077 main: ********************************************************************************
2026-04-29 12:17:17,077 main: Processing observation 31106
2026-04-29 12:17:17,077 main: ********************************************************************************
2026-04-29 12:17:17,077 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31106/info.json file found, obs=None
2026-04-29 12:17:17,078 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-29 12:17:17,079 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-04-29 12:17:19,126 __init__: ObsID 31106 has no maneuver event in telemetry, skipping
2026-04-29 12:17:19,127 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31106/index.html
2026-04-29 12:17:19,132 info: could not get attribute kalman_start for obsid 31106
2026-04-29 12:17:19,132 info: could not get attribute kalman_stop for obsid 31106
2026-04-29 12:17:19,132 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/31106/info.json
2026-04-29 12:17:19,133 main:
2026-04-29 13:17:20,373 run_check: Starting centroid dashboard continuity check
2026-04-29 13:17:20,373 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-29 13:17:20,377 collect_observations: Processing year 2020
2026-04-29 13:17:23,993 collect_observations: Processing year 2021
2026-04-29 13:17:29,072 collect_observations: Processing year 2022
2026-04-29 13:17:34,800 collect_observations: Processing year 2023
2026-04-29 13:17:40,315 collect_observations: Processing year 2024
2026-04-29 13:17:45,904 collect_observations: Processing year 2025
2026-04-29 13:17:51,549 collect_observations: Processing year 2026
2026-04-29 13:17:53,625 collect_observations: Collected 13786 observations from 4-digit years
2026-04-29 13:17:53,629 sort_observations_by_date: Sorted observations by date
2026-04-29 13:17:53,629 check_continuity: Starting continuity check from most recent: ObsID 31106 (APR2726A) at 2026:119:11:17:17.924
2026-04-29 13:17:53,646 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-29 13:17:53,646 check_continuity: Chain complete: visited 13786 observations out of 13786 total
2026-04-29 13:17:53,647 run_check: ✓ Observation chain continuity check PASSED
2026-04-29 13:17:53,647 run_check: Summary: 13786 observations from 4-digit years, all properly linked