Prev
Index
Next
centroid_dashboard: Fri Jul 4 13:17:22 2025
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Fri Jul 4 13:17:22 2025 |
No errors
File contents:
2025-07-04 13:16:12,380 main: Processing from 2025:178:17:16:12.378 to 2025:185:17:16:12.378
2025-07-04 13:16:18,491 get_observations: Found observation 28744 at 2025:178:18:25:08.809 with 1 manvrs
2025-07-04 13:16:18,492 get_observations: Found observation 30434 at 2025:178:23:17:58.403 with 1 manvrs
2025-07-04 13:16:18,492 get_observations: Found observation 30972 at 2025:179:06:47:59.568 with 1 manvrs
2025-07-04 13:16:18,493 get_observations: Found observation 29618 at 2025:179:10:42:19.714 with 1 manvrs
2025-07-04 13:16:18,493 get_observations: Found observation 42317 at 2025:179:18:17:34.362 with 1 manvrs
2025-07-04 13:16:18,493 get_observations: Found observation 42316 at 2025:179:19:25:40.252 with 1 manvrs
2025-07-04 13:16:18,494 get_observations: Found observation 42315 at 2025:179:20:40:40.252 with 1 manvrs
2025-07-04 13:16:18,494 get_observations: Found observation 42314 at 2025:179:22:15:40.252 with 1 manvrs
2025-07-04 13:16:18,495 get_observations: Found observation 42313 at 2025:179:23:25:40.252 with 1 manvrs
2025-07-04 13:16:18,495 get_observations: Found observation 42312 at 2025:180:02:25:40.252 with 1 manvrs
2025-07-04 13:16:18,496 get_observations: Found observation 42311 at 2025:180:04:05:40.252 with 1 manvrs
2025-07-04 13:16:18,496 get_observations: Found observation 30974 at 2025:180:05:30:28.024 with 1 manvrs
2025-07-04 13:16:18,496 get_observations: Found observation 30167 at 2025:180:10:25:16.438 with 1 manvrs
2025-07-04 13:16:18,497 get_observations: Found observation 28748 at 2025:180:20:08:54.760 with 1 manvrs
2025-07-04 13:16:18,497 get_observations: Found observation 29622 at 2025:181:00:57:09.200 with 1 manvrs
2025-07-04 13:16:18,498 get_observations: Found observation 30140 at 2025:181:07:02:03.081 with 1 manvrs
2025-07-04 13:16:18,498 get_observations: Found observation 29893 at 2025:181:12:32:11.454 with 1 manvrs
2025-07-04 13:16:18,498 get_observations: Found observation 28137 at 2025:181:18:41:19.394 with 1 manvrs
2025-07-04 13:16:18,499 get_observations: Found observation 42310 at 2025:181:20:56:55.887 with 1 manvrs
2025-07-04 13:16:18,499 get_observations: Found observation 42309 at 2025:181:21:52:50.993 with 1 manvrs
2025-07-04 13:16:18,500 get_observations: Found observation 28845 at 2025:181:22:19:03.760 with 1 manvrs
2025-07-04 13:16:18,500 get_observations: Found observation 28688 at 2025:182:04:14:35.575 with 1 manvrs
2025-07-04 13:16:18,501 get_observations: Found observation 42308 at 2025:182:10:25:49.050 with 1 manvrs
2025-07-04 13:16:18,501 get_observations: Found observation 42307 at 2025:182:15:10:40.252 with 1 manvrs
2025-07-04 13:16:18,501 get_observations: Found observation 42305 at 2025:182:16:28:51.252 with 2 manvrs
2025-07-04 13:16:18,502 get_observations: Found observation 42304 at 2025:182:17:20:57.031 with 1 manvrs
2025-07-04 13:16:18,502 get_observations: Found observation 30986 at 2025:182:21:07:53.159 with 1 manvrs
2025-07-04 13:16:18,503 get_observations: Found observation 28745 at 2025:183:01:14:50.577 with 2 manvrs
2025-07-04 13:16:18,503 get_observations: Found observation 30983 at 2025:183:05:45:30.841 with 1 manvrs
2025-07-04 13:16:18,503 get_observations: Found observation 30981 at 2025:183:08:54:07.597 with 1 manvrs
2025-07-04 13:16:18,504 get_observations: Found observation 30979 at 2025:183:12:17:05.243 with 1 manvrs
2025-07-04 13:16:18,504 get_observations: Found observation 28173 at 2025:183:15:41:49.527 with 1 manvrs
2025-07-04 13:16:18,505 get_observations: Found observation 28693 at 2025:184:02:18:12.080 with 1 manvrs
2025-07-04 13:16:18,505 get_observations: Found observation 28726 at 2025:184:10:33:42.817 with 1 manvrs
2025-07-04 13:16:18,505 get_observations: Found observation 42302 at 2025:184:15:02:37.246 with 1 manvrs
2025-07-04 13:16:18,506 get_observations: Found observation 30980 at 2025:184:16:13:37.420 with 1 manvrs
2025-07-04 13:16:18,506 get_observations: Found observation 30978 at 2025:184:21:31:39.770 with 1 manvrs
2025-07-04 13:16:18,507 get_observations: Found observation 42301 at 2025:185:00:42:14.498 with 1 manvrs
2025-07-04 13:16:18,507 get_observations: Found observation 42300 at 2025:185:02:27:18.278 with 1 manvrs
2025-07-04 13:16:18,508 get_observations: Found observation 42299 at 2025:185:05:25:40.252 with 1 manvrs
2025-07-04 13:16:18,508 get_observations: Found observation 42298 at 2025:185:06:35:40.252 with 1 manvrs
2025-07-04 13:16:18,508 get_observations: Found observation 42297 at 2025:185:07:20:10.144 with 1 manvrs
2025-07-04 13:16:18,509 get_observations: Found observation 42296 at 2025:185:09:55:40.252 with 1 manvrs
2025-07-04 13:16:18,509 get_observations: Found observation 42295 at 2025:185:11:55:40.252 with 1 manvrs
2025-07-04 13:16:18,510 get_observations: Found observation 29614 at 2025:185:13:11:21.158 with 1 manvrs
2025-07-04 13:16:18,510 main: Found 45 observations
2025-07-04 13:16:18,510 main: ********************************************************************************
2025-07-04 13:16:18,510 main: Processing observation 28744
2025-07-04 13:16:18,510 main: ********************************************************************************
2025-07-04 13:16:18,514 obs_link_from_info: Found prev obsid 30973
2025-07-04 13:16:18,517 process_obs: ObsID 28744 already processed, skipping
2025-07-04 13:16:18,517 main:
2025-07-04 13:16:18,517 main: ********************************************************************************
2025-07-04 13:16:18,517 main: Processing observation 30434
2025-07-04 13:16:18,517 main: ********************************************************************************
2025-07-04 13:16:18,521 process_obs: ObsID 30434 already processed, skipping
2025-07-04 13:16:18,521 main:
2025-07-04 13:16:18,521 main: ********************************************************************************
2025-07-04 13:16:18,521 main: Processing observation 30972
2025-07-04 13:16:18,521 main: ********************************************************************************
2025-07-04 13:16:18,539 process_obs: ObsID 30972 already processed, skipping
2025-07-04 13:16:18,539 main:
2025-07-04 13:16:18,539 main: ********************************************************************************
2025-07-04 13:16:18,539 main: Processing observation 29618
2025-07-04 13:16:18,539 main: ********************************************************************************
2025-07-04 13:16:18,543 process_obs: ObsID 29618 already processed, skipping
2025-07-04 13:16:18,543 main:
2025-07-04 13:16:18,543 main: ********************************************************************************
2025-07-04 13:16:18,543 main: Processing observation 42317
2025-07-04 13:16:18,543 main: ********************************************************************************
2025-07-04 13:16:18,560 process_obs: ObsID 42317 already processed, skipping
2025-07-04 13:16:18,560 main:
2025-07-04 13:16:18,560 main: ********************************************************************************
2025-07-04 13:16:18,560 main: Processing observation 42316
2025-07-04 13:16:18,560 main: ********************************************************************************
2025-07-04 13:16:18,570 process_obs: ObsID 42316 already processed, skipping
2025-07-04 13:16:18,571 main:
2025-07-04 13:16:18,571 main: ********************************************************************************
2025-07-04 13:16:18,571 main: Processing observation 42315
2025-07-04 13:16:18,571 main: ********************************************************************************
2025-07-04 13:16:18,574 process_obs: ObsID 42315 already processed, skipping
2025-07-04 13:16:18,574 main:
2025-07-04 13:16:18,574 main: ********************************************************************************
2025-07-04 13:16:18,574 main: Processing observation 42314
2025-07-04 13:16:18,574 main: ********************************************************************************
2025-07-04 13:16:18,578 process_obs: ObsID 42314 already processed, skipping
2025-07-04 13:16:18,578 main:
2025-07-04 13:16:18,578 main: ********************************************************************************
2025-07-04 13:16:18,578 main: Processing observation 42313
2025-07-04 13:16:18,578 main: ********************************************************************************
2025-07-04 13:16:18,582 process_obs: ObsID 42313 already processed, skipping
2025-07-04 13:16:18,582 main:
2025-07-04 13:16:18,582 main: ********************************************************************************
2025-07-04 13:16:18,582 main: Processing observation 42312
2025-07-04 13:16:18,582 main: ********************************************************************************
2025-07-04 13:16:18,585 process_obs: ObsID 42312 already processed, skipping
2025-07-04 13:16:18,585 main:
2025-07-04 13:16:18,585 main: ********************************************************************************
2025-07-04 13:16:18,585 main: Processing observation 42311
2025-07-04 13:16:18,585 main: ********************************************************************************
2025-07-04 13:16:18,589 process_obs: ObsID 42311 already processed, skipping
2025-07-04 13:16:18,589 main:
2025-07-04 13:16:18,589 main: ********************************************************************************
2025-07-04 13:16:18,589 main: Processing observation 30974
2025-07-04 13:16:18,589 main: ********************************************************************************
2025-07-04 13:16:18,593 process_obs: ObsID 30974 already processed, skipping
2025-07-04 13:16:18,593 main:
2025-07-04 13:16:18,593 main: ********************************************************************************
2025-07-04 13:16:18,593 main: Processing observation 30167
2025-07-04 13:16:18,593 main: ********************************************************************************
2025-07-04 13:16:18,596 process_obs: ObsID 30167 already processed, skipping
2025-07-04 13:16:18,596 main:
2025-07-04 13:16:18,596 main: ********************************************************************************
2025-07-04 13:16:18,596 main: Processing observation 28748
2025-07-04 13:16:18,596 main: ********************************************************************************
2025-07-04 13:16:18,600 process_obs: ObsID 28748 already processed, skipping
2025-07-04 13:16:18,600 main:
2025-07-04 13:16:18,600 main: ********************************************************************************
2025-07-04 13:16:18,600 main: Processing observation 29622
2025-07-04 13:16:18,600 main: ********************************************************************************
2025-07-04 13:16:18,604 process_obs: ObsID 29622 already processed, skipping
2025-07-04 13:16:18,604 main:
2025-07-04 13:16:18,604 main: ********************************************************************************
2025-07-04 13:16:18,604 main: Processing observation 30140
2025-07-04 13:16:18,604 main: ********************************************************************************
2025-07-04 13:16:18,607 process_obs: ObsID 30140 already processed, skipping
2025-07-04 13:16:18,607 main:
2025-07-04 13:16:18,607 main: ********************************************************************************
2025-07-04 13:16:18,607 main: Processing observation 29893
2025-07-04 13:16:18,607 main: ********************************************************************************
2025-07-04 13:16:18,611 process_obs: ObsID 29893 already processed, skipping
2025-07-04 13:16:18,611 main:
2025-07-04 13:16:18,611 main: ********************************************************************************
2025-07-04 13:16:18,611 main: Processing observation 28137
2025-07-04 13:16:18,611 main: ********************************************************************************
2025-07-04 13:16:18,614 process_obs: ObsID 28137 already processed, skipping
2025-07-04 13:16:18,614 main:
2025-07-04 13:16:18,614 main: ********************************************************************************
2025-07-04 13:16:18,614 main: Processing observation 42310
2025-07-04 13:16:18,615 main: ********************************************************************************
2025-07-04 13:16:18,618 process_obs: ObsID 42310 already processed, skipping
2025-07-04 13:16:18,618 main:
2025-07-04 13:16:18,618 main: ********************************************************************************
2025-07-04 13:16:18,618 main: Processing observation 42309
2025-07-04 13:16:18,618 main: ********************************************************************************
2025-07-04 13:16:18,621 process_obs: ObsID 42309 already processed, skipping
2025-07-04 13:16:18,622 main:
2025-07-04 13:16:18,622 main: ********************************************************************************
2025-07-04 13:16:18,622 main: Processing observation 28845
2025-07-04 13:16:18,622 main: ********************************************************************************
2025-07-04 13:16:18,625 process_obs: ObsID 28845 already processed, skipping
2025-07-04 13:16:18,625 main:
2025-07-04 13:16:18,625 main: ********************************************************************************
2025-07-04 13:16:18,625 main: Processing observation 28688
2025-07-04 13:16:18,625 main: ********************************************************************************
2025-07-04 13:16:18,629 process_obs: ObsID 28688 already processed, skipping
2025-07-04 13:16:18,629 main:
2025-07-04 13:16:18,629 main: ********************************************************************************
2025-07-04 13:16:18,629 main: Processing observation 42308
2025-07-04 13:16:18,629 main: ********************************************************************************
2025-07-04 13:16:18,632 process_obs: ObsID 42308 already processed, skipping
2025-07-04 13:16:18,632 main:
2025-07-04 13:16:18,632 main: ********************************************************************************
2025-07-04 13:16:18,632 main: Processing observation 42307
2025-07-04 13:16:18,633 main: ********************************************************************************
2025-07-04 13:16:18,636 process_obs: ObsID 42307 already processed, skipping
2025-07-04 13:16:18,636 main:
2025-07-04 13:16:18,636 main: ********************************************************************************
2025-07-04 13:16:18,636 main: Processing observation 42305
2025-07-04 13:16:18,636 main: ********************************************************************************
2025-07-04 13:16:18,640 process_obs: ObsID 42305 already processed, skipping
2025-07-04 13:16:18,640 main:
2025-07-04 13:16:18,640 main: ********************************************************************************
2025-07-04 13:16:18,640 main: Processing observation 42304
2025-07-04 13:16:18,640 main: ********************************************************************************
2025-07-04 13:16:18,643 process_obs: ObsID 42304 already processed, skipping
2025-07-04 13:16:18,643 main:
2025-07-04 13:16:18,643 main: ********************************************************************************
2025-07-04 13:16:18,643 main: Processing observation 30986
2025-07-04 13:16:18,643 main: ********************************************************************************
2025-07-04 13:16:18,658 process_obs: ObsID 30986 already processed, skipping
2025-07-04 13:16:18,658 main:
2025-07-04 13:16:18,658 main: ********************************************************************************
2025-07-04 13:16:18,658 main: Processing observation 28745
2025-07-04 13:16:18,658 main: ********************************************************************************
2025-07-04 13:16:18,672 process_obs: ObsID 28745 already processed, skipping
2025-07-04 13:16:18,672 main:
2025-07-04 13:16:18,672 main: ********************************************************************************
2025-07-04 13:16:18,672 main: Processing observation 30983
2025-07-04 13:16:18,672 main: ********************************************************************************
2025-07-04 13:16:18,688 process_obs: ObsID 30983 already processed, skipping
2025-07-04 13:16:18,688 main:
2025-07-04 13:16:18,688 main: ********************************************************************************
2025-07-04 13:16:18,688 main: Processing observation 30981
2025-07-04 13:16:18,688 main: ********************************************************************************
2025-07-04 13:16:18,705 process_obs: ObsID 30981 already processed, skipping
2025-07-04 13:16:18,705 main:
2025-07-04 13:16:18,705 main: ********************************************************************************
2025-07-04 13:16:18,705 main: Processing observation 30979
2025-07-04 13:16:18,705 main: ********************************************************************************
2025-07-04 13:16:18,718 process_obs: ObsID 30979 already processed, skipping
2025-07-04 13:16:18,718 main:
2025-07-04 13:16:18,718 main: ********************************************************************************
2025-07-04 13:16:18,718 main: Processing observation 28173
2025-07-04 13:16:18,718 main: ********************************************************************************
2025-07-04 12:16:21,892 get_centroid_resids_from_file: Reading centroid residuals from /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/centroid_resids.pkl
2025-07-04 12:16:22,581 write_centroid_resids: Centroid residuals file exists, skipping
2025-07-04 12:16:22,581 plot_crs_time: Plot file exists, skipping
2025-07-04 12:16:22,582 plot_crs_scatter: Plot file exists, skipping
2025-07-04 12:16:24,521 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/n_kalman_delta_roll.png
2025-07-04 12:16:32,216 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/index.html
2025-07-04 12:16:32,218 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/info.json
2025-07-04 12:16:32,221 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/index.html
2025-07-04 12:16:32,232 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/index.html
2025-07-04 12:16:32,233 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/centroid_resids.pkl
2025-07-04 12:16:32,233 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/centroid_resids.pkl
2025-07-04 12:16:32,234 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/centroid_resids_time.png
2025-07-04 12:16:32,234 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/centroid_resids_time.png
2025-07-04 12:16:32,235 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/centroid_resids_scatter.png
2025-07-04 12:16:32,235 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/centroid_resids_scatter.png
2025-07-04 12:16:32,236 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/n_kalman_delta_roll.png
2025-07-04 12:16:32,236 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/n_kalman_delta_roll.png
2025-07-04 12:16:32,237 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/info.json
2025-07-04 12:16:32,237 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/info.json
2025-07-04 12:16:32,238 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28173/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28173/kalman_plot_done
2025-07-04 12:16:32,238 main:
2025-07-04 12:16:32,238 main: ********************************************************************************
2025-07-04 12:16:32,238 main: Processing observation 28693
2025-07-04 12:16:32,238 main: ********************************************************************************
2025-07-04 12:16:36,041 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/centroid_resids.pkl with 5 slots
2025-07-04 12:16:36,100 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/centroid_resids_time.png
2025-07-04 12:16:36,977 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/centroid_resids_scatter.png
2025-07-04 12:16:38,275 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/n_kalman_delta_roll.png
2025-07-04 12:16:38,513 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/index.html
2025-07-04 12:16:38,518 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/info.json
2025-07-04 12:16:38,520 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28693/index.html
2025-07-04 12:16:38,521 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28693/centroid_resids.pkl
2025-07-04 12:16:38,522 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28693/centroid_resids_time.png
2025-07-04 12:16:38,523 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28693/centroid_resids_scatter.png
2025-07-04 12:16:38,524 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28693/n_kalman_delta_roll.png
2025-07-04 12:16:38,524 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28693/kalman_plot_done
2025-07-04 12:16:38,525 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28693/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28693/info.json
2025-07-04 12:16:38,526 main:
2025-07-04 12:16:38,526 main: ********************************************************************************
2025-07-04 12:16:38,526 main: Processing observation 28726
2025-07-04 12:16:38,526 main: ********************************************************************************
2025-07-04 12:16:44,575 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/centroid_resids.pkl with 5 slots
2025-07-04 12:16:44,629 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/centroid_resids_time.png
2025-07-04 12:16:45,143 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/centroid_resids_scatter.png
2025-07-04 12:16:46,214 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/n_kalman_delta_roll.png
2025-07-04 12:16:46,835 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/index.html
2025-07-04 12:16:46,854 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/info.json
2025-07-04 12:16:46,909 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28726/index.html
2025-07-04 12:16:46,925 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28726/centroid_resids.pkl
2025-07-04 12:16:46,941 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28726/centroid_resids_time.png
2025-07-04 12:16:46,955 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28726/centroid_resids_scatter.png
2025-07-04 12:16:46,973 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28726/n_kalman_delta_roll.png
2025-07-04 12:16:46,989 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28726/kalman_plot_done
2025-07-04 12:16:47,001 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/28726/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/28/28726/info.json
2025-07-04 12:16:47,005 main:
2025-07-04 12:16:47,005 main: ********************************************************************************
2025-07-04 12:16:47,005 main: Processing observation 42302
2025-07-04 12:16:47,005 main: ********************************************************************************
2025-07-04 12:16:50,677 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/centroid_resids.pkl with 8 slots
2025-07-04 12:16:50,743 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/centroid_resids_time.png
2025-07-04 12:16:51,008 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/centroid_resids_scatter.png
2025-07-04 12:16:51,080 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-07-04 12:16:51,200 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/n_kalman_delta_roll.png
2025-07-04 12:16:51,358 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/index.html
2025-07-04 12:16:51,359 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/info.json
2025-07-04 12:16:51,362 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42302/index.html
2025-07-04 12:16:51,362 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42302/centroid_resids.pkl
2025-07-04 12:16:51,363 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42302/centroid_resids_time.png
2025-07-04 12:16:51,363 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42302/centroid_resids_scatter.png
2025-07-04 12:16:51,364 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42302/n_kalman_delta_roll.png
2025-07-04 12:16:51,365 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42302/kalman_plot_done
2025-07-04 12:16:51,365 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42302/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42302/info.json
2025-07-04 12:16:51,366 main:
2025-07-04 12:16:51,366 main: ********************************************************************************
2025-07-04 12:16:51,366 main: Processing observation 30980
2025-07-04 12:16:51,366 main: ********************************************************************************
2025-07-04 12:16:54,059 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/centroid_resids.pkl with 5 slots
2025-07-04 12:16:54,125 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/centroid_resids_time.png
2025-07-04 12:16:54,413 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/centroid_resids_scatter.png
2025-07-04 12:16:54,541 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-07-04 12:16:54,656 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/n_kalman_delta_roll.png
2025-07-04 12:16:54,793 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/index.html
2025-07-04 12:16:54,794 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/info.json
2025-07-04 12:16:54,796 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30980/index.html
2025-07-04 12:16:54,797 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30980/centroid_resids.pkl
2025-07-04 12:16:54,798 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30980/centroid_resids_time.png
2025-07-04 12:16:54,798 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30980/centroid_resids_scatter.png
2025-07-04 12:16:54,799 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30980/n_kalman_delta_roll.png
2025-07-04 12:16:54,799 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30980/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30980/info.json
2025-07-04 12:16:54,800 main:
2025-07-04 12:16:54,800 main: ********************************************************************************
2025-07-04 12:16:54,800 main: Processing observation 30978
2025-07-04 12:16:54,800 main: ********************************************************************************
2025-07-04 12:16:57,695 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/centroid_resids.pkl with 5 slots
2025-07-04 12:16:57,742 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/centroid_resids_time.png
2025-07-04 12:16:58,182 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/centroid_resids_scatter.png
2025-07-04 12:16:58,288 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-07-04 12:16:58,448 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/n_kalman_delta_roll.png
2025-07-04 12:16:58,596 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/index.html
2025-07-04 12:16:58,598 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/info.json
2025-07-04 12:16:58,600 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30978/centroid_resids.pkl
2025-07-04 12:16:58,601 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30978/centroid_resids_time.png
2025-07-04 12:16:58,601 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30978/centroid_resids_scatter.png
2025-07-04 12:16:58,602 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30978/n_kalman_delta_roll.png
2025-07-04 12:16:58,602 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30978/index.html
2025-07-04 12:16:58,603 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/30978/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30978/info.json
2025-07-04 12:16:58,603 main:
2025-07-04 12:16:58,603 main: ********************************************************************************
2025-07-04 12:16:58,603 main: Processing observation 42301
2025-07-04 12:16:58,603 main: ********************************************************************************
2025-07-04 12:17:01,699 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/centroid_resids.pkl with 8 slots
2025-07-04 12:17:01,768 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/centroid_resids_time.png
2025-07-04 12:17:02,130 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/centroid_resids_scatter.png
2025-07-04 12:17:02,229 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-07-04 12:17:02,415 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/n_kalman_delta_roll.png
2025-07-04 12:17:02,624 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/index.html
2025-07-04 12:17:02,627 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/info.json
2025-07-04 12:17:02,629 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42301/centroid_resids.pkl
2025-07-04 12:17:02,631 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42301/centroid_resids_time.png
2025-07-04 12:17:02,632 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42301/centroid_resids_scatter.png
2025-07-04 12:17:02,633 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42301/n_kalman_delta_roll.png
2025-07-04 12:17:02,634 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42301/kalman_plot_done
2025-07-04 12:17:02,635 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42301/index.html
2025-07-04 12:17:02,636 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42301/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42301/info.json
2025-07-04 12:17:02,636 main:
2025-07-04 12:17:02,636 main: ********************************************************************************
2025-07-04 12:17:02,636 main: Processing observation 42300
2025-07-04 12:17:02,636 main: ********************************************************************************
2025-07-04 12:17:07,474 __init__: ObsID 42300 has insufficient telemetry, skipping
2025-07-04 12:17:07,488 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42300/index.html
2025-07-04 12:17:07,490 main:
2025-07-04 12:17:07,490 main: ********************************************************************************
2025-07-04 12:17:07,490 main: Processing observation 42299
2025-07-04 12:17:07,490 main: ********************************************************************************
2025-07-04 12:17:09,824 __init__: ObsID 42299 has insufficient telemetry, skipping
2025-07-04 12:17:09,836 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42299/index.html
2025-07-04 12:17:09,837 main:
2025-07-04 12:17:09,838 main: ********************************************************************************
2025-07-04 12:17:09,838 main: Processing observation 42298
2025-07-04 12:17:09,838 main: ********************************************************************************
2025-07-04 12:17:12,183 __init__: ObsID 42298 has insufficient telemetry, skipping
2025-07-04 12:17:12,195 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42298/index.html
2025-07-04 12:17:12,196 main:
2025-07-04 12:17:12,196 main: ********************************************************************************
2025-07-04 12:17:12,196 main: Processing observation 42297
2025-07-04 12:17:12,196 main: ********************************************************************************
2025-07-04 12:17:14,542 __init__: ObsID 42297 has insufficient telemetry, skipping
2025-07-04 12:17:14,554 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42297/index.html
2025-07-04 12:17:14,556 main:
2025-07-04 12:17:14,556 main: ********************************************************************************
2025-07-04 12:17:14,556 main: Processing observation 42296
2025-07-04 12:17:14,556 main: ********************************************************************************
2025-07-04 12:17:16,922 __init__: ObsID 42296 has insufficient telemetry, skipping
2025-07-04 12:17:16,934 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42296/index.html
2025-07-04 12:17:16,935 main:
2025-07-04 12:17:16,935 main: ********************************************************************************
2025-07-04 12:17:16,935 main: Processing observation 42295
2025-07-04 12:17:16,935 main: ********************************************************************************
2025-07-04 12:17:19,263 __init__: ObsID 42295 has no maneuver event in telemetry, skipping
2025-07-04 12:17:19,276 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/42295/index.html
2025-07-04 12:17:19,277 main:
2025-07-04 12:17:19,277 main: ********************************************************************************
2025-07-04 12:17:19,277 main: Processing observation 29614
2025-07-04 12:17:19,277 main: ********************************************************************************
2025-07-04 12:17:19,278 obs_link_from_info: No /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/29614/info.json file found, obs=None
2025-07-04 12:17:21,582 __init__: ObsID 29614 has no maneuver event in telemetry, skipping
2025-07-04 12:17:21,594 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/JUN3025A/29614/index.html
2025-07-04 12:17:21,595 main: