Prev
Index
Next
centroid_dashboard: Sun Jun 1 13:16:56 2025
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.90 | 1.0 |
Sun Jun 1 13:16:56 2025 |
No errors
File contents:
2025-06-01 13:16:05,872 main: Processing from 2025:145:17:16:05.872 to 2025:152:17:16:05.872
2025-06-01 13:16:11,830 get_observations: Found observation 30942 at 2025:145:18:51:56.025 with 1 manvrs
2025-06-01 13:16:11,831 get_observations: Found observation 29606 at 2025:145:23:02:07.005 with 1 manvrs
2025-06-01 13:16:11,831 get_observations: Found observation 29788 at 2025:146:01:51:56.205 with 1 manvrs
2025-06-01 13:16:11,831 get_observations: Found observation 30953 at 2025:146:08:53:36.052 with 1 manvrs
2025-06-01 13:16:11,832 get_observations: Found observation 28841 at 2025:146:12:18:53.672 with 1 manvrs
2025-06-01 13:16:11,832 get_observations: Found observation 28304 at 2025:146:17:10:24.380 with 1 manvrs
2025-06-01 13:16:11,833 get_observations: Found observation 30946 at 2025:146:23:41:55.785 with 1 manvrs
2025-06-01 13:16:11,833 get_observations: Found observation 30945 at 2025:147:04:41:52.184 with 1 manvrs
2025-06-01 13:16:11,834 get_observations: Found observation 28858 at 2025:147:10:21:33.037 with 1 manvrs
2025-06-01 13:16:11,834 get_observations: Found observation 29585 at 2025:147:14:47:31.521 with 1 manvrs
2025-06-01 13:16:11,834 get_observations: Found observation 29587 at 2025:147:19:06:01.522 with 1 manvrs
2025-06-01 13:16:11,835 get_observations: Found observation 42382 at 2025:148:01:01:55.689 with 1 manvrs
2025-06-01 13:16:11,835 get_observations: Found observation 42381 at 2025:148:04:55:40.252 with 1 manvrs
2025-06-01 13:16:11,836 get_observations: Found observation 42380 at 2025:148:07:25:40.252 with 1 manvrs
2025-06-01 13:16:11,836 get_observations: Found observation 29809 at 2025:148:11:01:32.912 with 1 manvrs
2025-06-01 13:16:11,837 get_observations: Found observation 28250 at 2025:148:15:39:02.541 with 1 manvrs
2025-06-01 13:16:11,837 get_observations: Found observation 28812 at 2025:148:17:37:13.285 with 1 manvrs
2025-06-01 13:16:11,837 get_observations: Found observation 28129 at 2025:148:19:21:22.311 with 1 manvrs
2025-06-01 13:16:11,838 get_observations: Found observation 29791 at 2025:149:00:17:49.266 with 1 manvrs
2025-06-01 13:16:11,838 get_observations: Found observation 30944 at 2025:149:04:03:08.248 with 1 manvrs
2025-06-01 13:16:11,839 get_observations: Found observation 28851 at 2025:149:08:12:59.688 with 1 manvrs
2025-06-01 13:16:11,839 get_observations: Found observation 29729 at 2025:149:17:13:42.718 with 1 manvrs
2025-06-01 13:16:11,840 get_observations: Found observation 28853 at 2025:149:20:44:22.626 with 1 manvrs
2025-06-01 13:16:11,840 get_observations: Found observation 30138 at 2025:150:04:57:04.593 with 2 manvrs
2025-06-01 13:16:11,840 get_observations: Found observation 28743 at 2025:150:08:19:34.376 with 1 manvrs
2025-06-01 13:16:11,841 get_observations: Found observation 30950 at 2025:150:13:03:39.355 with 1 manvrs
2025-06-01 13:16:11,841 get_observations: Found observation 42378 at 2025:150:16:32:11.327 with 1 manvrs
2025-06-01 13:16:11,842 get_observations: Found observation 42377 at 2025:150:18:55:40.252 with 1 manvrs
2025-06-01 13:16:11,842 get_observations: Found observation 42376 at 2025:150:22:05:40.252 with 1 manvrs
2025-06-01 13:16:11,843 get_observations: Found observation 42375 at 2025:151:00:25:40.252 with 1 manvrs
2025-06-01 13:16:11,843 get_observations: Found observation 30951 at 2025:151:01:47:01.234 with 1 manvrs
2025-06-01 13:16:11,844 get_observations: Found observation 42374 at 2025:151:05:14:57.835 with 1 manvrs
2025-06-01 13:16:11,844 get_observations: Found observation 29637 at 2025:151:05:40:31.875 with 1 manvrs
2025-06-01 13:16:11,844 get_observations: Found observation 30947 at 2025:151:10:30:05.036 with 1 manvrs
2025-06-01 13:16:11,845 get_observations: Found observation 42373 at 2025:151:15:19:22.252 with 1 manvrs
2025-06-01 13:16:11,845 get_observations: Found observation 30948 at 2025:151:15:44:37.014 with 1 manvrs
2025-06-01 13:16:11,846 get_observations: Found observation 28653 at 2025:151:20:42:51.384 with 1 manvrs
2025-06-01 13:16:11,846 get_observations: Found observation 30114 at 2025:152:05:26:22.547 with 1 manvrs
2025-06-01 13:16:11,847 get_observations: Found observation 28037 at 2025:152:14:30:35.810 with 1 manvrs
2025-06-01 13:16:11,847 main: Found 39 observations
2025-06-01 13:16:11,847 main: ********************************************************************************
2025-06-01 13:16:11,847 main: Processing observation 30942
2025-06-01 13:16:11,847 main: ********************************************************************************
2025-06-01 13:16:11,852 obs_link_from_info: Found prev obsid 42383
2025-06-01 13:16:11,855 process_obs: ObsID 30942 already processed, skipping
2025-06-01 13:16:11,855 main:
2025-06-01 13:16:11,855 main: ********************************************************************************
2025-06-01 13:16:11,855 main: Processing observation 29606
2025-06-01 13:16:11,855 main: ********************************************************************************
2025-06-01 13:16:11,859 process_obs: ObsID 29606 already processed, skipping
2025-06-01 13:16:11,859 main:
2025-06-01 13:16:11,859 main: ********************************************************************************
2025-06-01 13:16:11,859 main: Processing observation 29788
2025-06-01 13:16:11,859 main: ********************************************************************************
2025-06-01 13:16:11,863 process_obs: ObsID 29788 already processed, skipping
2025-06-01 13:16:11,863 main:
2025-06-01 13:16:11,863 main: ********************************************************************************
2025-06-01 13:16:11,863 main: Processing observation 30953
2025-06-01 13:16:11,863 main: ********************************************************************************
2025-06-01 13:16:11,866 process_obs: ObsID 30953 already processed, skipping
2025-06-01 13:16:11,866 main:
2025-06-01 13:16:11,866 main: ********************************************************************************
2025-06-01 13:16:11,866 main: Processing observation 28841
2025-06-01 13:16:11,866 main: ********************************************************************************
2025-06-01 13:16:11,870 process_obs: ObsID 28841 already processed, skipping
2025-06-01 13:16:11,870 main:
2025-06-01 13:16:11,870 main: ********************************************************************************
2025-06-01 13:16:11,870 main: Processing observation 28304
2025-06-01 13:16:11,870 main: ********************************************************************************
2025-06-01 13:16:11,874 process_obs: ObsID 28304 already processed, skipping
2025-06-01 13:16:11,874 main:
2025-06-01 13:16:11,874 main: ********************************************************************************
2025-06-01 13:16:11,874 main: Processing observation 30946
2025-06-01 13:16:11,874 main: ********************************************************************************
2025-06-01 13:16:11,877 process_obs: ObsID 30946 already processed, skipping
2025-06-01 13:16:11,877 main:
2025-06-01 13:16:11,877 main: ********************************************************************************
2025-06-01 13:16:11,877 main: Processing observation 30945
2025-06-01 13:16:11,877 main: ********************************************************************************
2025-06-01 13:16:11,880 process_obs: ObsID 30945 already processed, skipping
2025-06-01 13:16:11,880 main:
2025-06-01 13:16:11,880 main: ********************************************************************************
2025-06-01 13:16:11,880 main: Processing observation 28858
2025-06-01 13:16:11,880 main: ********************************************************************************
2025-06-01 13:16:11,884 process_obs: ObsID 28858 already processed, skipping
2025-06-01 13:16:11,884 main:
2025-06-01 13:16:11,884 main: ********************************************************************************
2025-06-01 13:16:11,884 main: Processing observation 29585
2025-06-01 13:16:11,884 main: ********************************************************************************
2025-06-01 13:16:11,887 process_obs: ObsID 29585 already processed, skipping
2025-06-01 13:16:11,887 main:
2025-06-01 13:16:11,887 main: ********************************************************************************
2025-06-01 13:16:11,887 main: Processing observation 29587
2025-06-01 13:16:11,887 main: ********************************************************************************
2025-06-01 13:16:11,890 process_obs: ObsID 29587 already processed, skipping
2025-06-01 13:16:11,890 main:
2025-06-01 13:16:11,890 main: ********************************************************************************
2025-06-01 13:16:11,890 main: Processing observation 42382
2025-06-01 13:16:11,890 main: ********************************************************************************
2025-06-01 13:16:11,894 process_obs: ObsID 42382 already processed, skipping
2025-06-01 13:16:11,894 main:
2025-06-01 13:16:11,894 main: ********************************************************************************
2025-06-01 13:16:11,894 main: Processing observation 42381
2025-06-01 13:16:11,894 main: ********************************************************************************
2025-06-01 13:16:11,898 process_obs: ObsID 42381 already processed, skipping
2025-06-01 13:16:11,898 main:
2025-06-01 13:16:11,898 main: ********************************************************************************
2025-06-01 13:16:11,898 main: Processing observation 42380
2025-06-01 13:16:11,898 main: ********************************************************************************
2025-06-01 13:16:11,901 process_obs: ObsID 42380 already processed, skipping
2025-06-01 13:16:11,901 main:
2025-06-01 13:16:11,901 main: ********************************************************************************
2025-06-01 13:16:11,901 main: Processing observation 29809
2025-06-01 13:16:11,901 main: ********************************************************************************
2025-06-01 13:16:11,904 process_obs: ObsID 29809 already processed, skipping
2025-06-01 13:16:11,904 main:
2025-06-01 13:16:11,904 main: ********************************************************************************
2025-06-01 13:16:11,904 main: Processing observation 28250
2025-06-01 13:16:11,904 main: ********************************************************************************
2025-06-01 13:16:11,907 process_obs: ObsID 28250 already processed, skipping
2025-06-01 13:16:11,907 main:
2025-06-01 13:16:11,908 main: ********************************************************************************
2025-06-01 13:16:11,908 main: Processing observation 28812
2025-06-01 13:16:11,908 main: ********************************************************************************
2025-06-01 13:16:11,911 process_obs: ObsID 28812 already processed, skipping
2025-06-01 13:16:11,911 main:
2025-06-01 13:16:11,911 main: ********************************************************************************
2025-06-01 13:16:11,911 main: Processing observation 28129
2025-06-01 13:16:11,911 main: ********************************************************************************
2025-06-01 13:16:11,914 process_obs: ObsID 28129 already processed, skipping
2025-06-01 13:16:11,914 main:
2025-06-01 13:16:11,914 main: ********************************************************************************
2025-06-01 13:16:11,914 main: Processing observation 29791
2025-06-01 13:16:11,914 main: ********************************************************************************
2025-06-01 13:16:11,918 process_obs: ObsID 29791 already processed, skipping
2025-06-01 13:16:11,918 main:
2025-06-01 13:16:11,918 main: ********************************************************************************
2025-06-01 13:16:11,918 main: Processing observation 30944
2025-06-01 13:16:11,918 main: ********************************************************************************
2025-06-01 13:16:11,921 process_obs: ObsID 30944 already processed, skipping
2025-06-01 13:16:11,921 main:
2025-06-01 13:16:11,921 main: ********************************************************************************
2025-06-01 13:16:11,921 main: Processing observation 28851
2025-06-01 13:16:11,921 main: ********************************************************************************
2025-06-01 13:16:11,924 process_obs: ObsID 28851 already processed, skipping
2025-06-01 13:16:11,924 main:
2025-06-01 13:16:11,924 main: ********************************************************************************
2025-06-01 13:16:11,924 main: Processing observation 29729
2025-06-01 13:16:11,924 main: ********************************************************************************
2025-06-01 13:16:11,928 process_obs: ObsID 29729 already processed, skipping
2025-06-01 13:16:11,928 main:
2025-06-01 13:16:11,928 main: ********************************************************************************
2025-06-01 13:16:11,928 main: Processing observation 28853
2025-06-01 13:16:11,928 main: ********************************************************************************
2025-06-01 13:16:11,931 process_obs: ObsID 28853 already processed, skipping
2025-06-01 13:16:11,931 main:
2025-06-01 13:16:11,931 main: ********************************************************************************
2025-06-01 13:16:11,931 main: Processing observation 30138
2025-06-01 13:16:11,931 main: ********************************************************************************
2025-06-01 13:16:11,935 process_obs: ObsID 30138 already processed, skipping
2025-06-01 13:16:11,935 main:
2025-06-01 13:16:11,935 main: ********************************************************************************
2025-06-01 13:16:11,935 main: Processing observation 28743
2025-06-01 13:16:11,935 main: ********************************************************************************
2025-06-01 13:16:11,938 process_obs: ObsID 28743 already processed, skipping
2025-06-01 13:16:11,938 main:
2025-06-01 13:16:11,938 main: ********************************************************************************
2025-06-01 13:16:11,938 main: Processing observation 30950
2025-06-01 13:16:11,938 main: ********************************************************************************
2025-06-01 12:16:14,470 get_centroid_resids_from_file: Reading centroid residuals from /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/centroid_resids.pkl
2025-06-01 12:16:14,858 write_centroid_resids: Centroid residuals file exists, skipping
2025-06-01 12:16:14,858 plot_crs_time: Plot file exists, skipping
2025-06-01 12:16:14,858 plot_crs_scatter: Plot file exists, skipping
2025-06-01 12:16:15,729 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/n_kalman_delta_roll.png
2025-06-01 12:16:18,705 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/index.html
2025-06-01 12:16:18,707 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/info.json
2025-06-01 12:16:18,709 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/index.html
2025-06-01 12:16:18,727 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/index.html
2025-06-01 12:16:18,728 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/centroid_resids.pkl
2025-06-01 12:16:18,728 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/centroid_resids.pkl
2025-06-01 12:16:18,729 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/centroid_resids_time.png
2025-06-01 12:16:18,729 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/centroid_resids_time.png
2025-06-01 12:16:18,730 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/centroid_resids_scatter.png
2025-06-01 12:16:18,730 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/centroid_resids_scatter.png
2025-06-01 12:16:18,731 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/n_kalman_delta_roll.png
2025-06-01 12:16:18,731 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/n_kalman_delta_roll.png
2025-06-01 12:16:18,732 make_obsid_dir_links: Removing existing file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/info.json
2025-06-01 12:16:18,732 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/info.json
2025-06-01 12:16:18,733 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30950/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30950/kalman_plot_done
2025-06-01 12:16:18,733 main:
2025-06-01 12:16:18,733 main: ********************************************************************************
2025-06-01 12:16:18,733 main: Processing observation 42378
2025-06-01 12:16:18,733 main: ********************************************************************************
2025-06-01 12:16:18,737 process_obs: ObsID 42378 already processed, skipping
2025-06-01 12:16:18,737 main:
2025-06-01 12:16:18,737 main: ********************************************************************************
2025-06-01 12:16:18,737 main: Processing observation 42377
2025-06-01 12:16:18,737 main: ********************************************************************************
2025-06-01 12:16:18,740 process_obs: ObsID 42377 already processed, skipping
2025-06-01 12:16:18,740 main:
2025-06-01 12:16:18,740 main: ********************************************************************************
2025-06-01 12:16:18,740 main: Processing observation 42376
2025-06-01 12:16:18,740 main: ********************************************************************************
2025-06-01 12:16:18,743 process_obs: ObsID 42376 already processed, skipping
2025-06-01 12:16:18,744 main:
2025-06-01 12:16:18,744 main: ********************************************************************************
2025-06-01 12:16:18,744 main: Processing observation 42375
2025-06-01 12:16:18,744 main: ********************************************************************************
2025-06-01 12:16:21,571 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/centroid_resids.pkl with 8 slots
2025-06-01 12:16:21,768 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/centroid_resids_time.png
2025-06-01 12:16:22,317 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/centroid_resids_scatter.png
2025-06-01 12:16:22,410 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-06-01 12:16:22,567 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/n_kalman_delta_roll.png
2025-06-01 12:16:25,118 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/index.html
2025-06-01 12:16:25,119 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/info.json
2025-06-01 12:16:25,122 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42375/index.html
2025-06-01 12:16:25,123 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42375/centroid_resids.pkl
2025-06-01 12:16:25,124 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42375/centroid_resids_time.png
2025-06-01 12:16:25,124 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42375/centroid_resids_scatter.png
2025-06-01 12:16:25,125 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42375/n_kalman_delta_roll.png
2025-06-01 12:16:25,125 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42375/kalman_plot_done
2025-06-01 12:16:25,126 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42375/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42375/info.json
2025-06-01 12:16:25,127 main:
2025-06-01 12:16:25,127 main: ********************************************************************************
2025-06-01 12:16:25,127 main: Processing observation 30951
2025-06-01 12:16:25,127 main: ********************************************************************************
2025-06-01 12:16:28,205 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/centroid_resids.pkl with 5 slots
2025-06-01 12:16:28,257 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/centroid_resids_time.png
2025-06-01 12:16:28,501 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/centroid_resids_scatter.png
2025-06-01 12:16:29,274 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/n_kalman_delta_roll.png
2025-06-01 12:16:29,438 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/index.html
2025-06-01 12:16:29,439 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/info.json
2025-06-01 12:16:29,442 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30951/index.html
2025-06-01 12:16:29,443 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30951/centroid_resids.pkl
2025-06-01 12:16:29,443 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30951/centroid_resids_time.png
2025-06-01 12:16:29,444 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30951/centroid_resids_scatter.png
2025-06-01 12:16:29,444 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30951/n_kalman_delta_roll.png
2025-06-01 12:16:29,445 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30951/kalman_plot_done
2025-06-01 12:16:29,446 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30951/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30951/info.json
2025-06-01 12:16:29,446 main:
2025-06-01 12:16:29,446 main: ********************************************************************************
2025-06-01 12:16:29,446 main: Processing observation 42374
2025-06-01 12:16:29,446 main: ********************************************************************************
2025-06-01 12:16:32,418 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/centroid_resids.pkl with 6 slots
2025-06-01 12:16:32,469 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/centroid_resids_time.png
2025-06-01 12:16:32,700 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/centroid_resids_scatter.png
2025-06-01 12:16:32,773 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-06-01 12:16:32,889 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/n_kalman_delta_roll.png
2025-06-01 12:16:33,031 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/index.html
2025-06-01 12:16:33,033 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/info.json
2025-06-01 12:16:33,035 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42374/index.html
2025-06-01 12:16:33,036 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42374/centroid_resids.pkl
2025-06-01 12:16:33,036 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42374/centroid_resids_time.png
2025-06-01 12:16:33,037 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42374/centroid_resids_scatter.png
2025-06-01 12:16:33,038 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42374/n_kalman_delta_roll.png
2025-06-01 12:16:33,038 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42374/kalman_plot_done
2025-06-01 12:16:33,039 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42374/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42374/info.json
2025-06-01 12:16:33,039 main:
2025-06-01 12:16:33,039 main: ********************************************************************************
2025-06-01 12:16:33,039 main: Processing observation 29637
2025-06-01 12:16:33,039 main: ********************************************************************************
2025-06-01 12:16:35,935 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/centroid_resids.pkl with 5 slots
2025-06-01 12:16:36,000 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/centroid_resids_time.png
2025-06-01 12:16:36,271 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/centroid_resids_scatter.png
2025-06-01 12:16:37,102 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/n_kalman_delta_roll.png
2025-06-01 12:16:37,258 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/index.html
2025-06-01 12:16:37,260 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/info.json
2025-06-01 12:16:37,263 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/29/29637/index.html
2025-06-01 12:16:37,263 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/29/29637/centroid_resids.pkl
2025-06-01 12:16:37,264 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/29/29637/centroid_resids_time.png
2025-06-01 12:16:37,264 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/29/29637/centroid_resids_scatter.png
2025-06-01 12:16:37,265 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/29/29637/n_kalman_delta_roll.png
2025-06-01 12:16:37,266 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/29/29637/kalman_plot_done
2025-06-01 12:16:37,266 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/29637/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/29/29637/info.json
2025-06-01 12:16:37,267 main:
2025-06-01 12:16:37,267 main: ********************************************************************************
2025-06-01 12:16:37,267 main: Processing observation 30947
2025-06-01 12:16:37,267 main: ********************************************************************************
2025-06-01 12:16:40,449 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/centroid_resids.pkl with 5 slots
2025-06-01 12:16:40,498 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/centroid_resids_time.png
2025-06-01 12:16:40,758 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/centroid_resids_scatter.png
2025-06-01 12:16:41,701 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/n_kalman_delta_roll.png
2025-06-01 12:16:41,876 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/index.html
2025-06-01 12:16:41,878 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/info.json
2025-06-01 12:16:41,880 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30947/index.html
2025-06-01 12:16:41,881 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30947/centroid_resids.pkl
2025-06-01 12:16:41,881 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30947/centroid_resids_time.png
2025-06-01 12:16:41,882 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30947/centroid_resids_scatter.png
2025-06-01 12:16:41,883 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30947/n_kalman_delta_roll.png
2025-06-01 12:16:41,883 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30947/kalman_plot_done
2025-06-01 12:16:41,884 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30947/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30947/info.json
2025-06-01 12:16:41,884 main:
2025-06-01 12:16:41,884 main: ********************************************************************************
2025-06-01 12:16:41,884 main: Processing observation 42373
2025-06-01 12:16:41,884 main: ********************************************************************************
2025-06-01 12:16:44,908 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/centroid_resids.pkl with 7 slots
2025-06-01 12:16:44,968 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/centroid_resids_time.png
2025-06-01 12:16:45,219 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/centroid_resids_scatter.png
2025-06-01 12:16:45,290 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-06-01 12:16:45,405 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/n_kalman_delta_roll.png
2025-06-01 12:16:45,553 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/index.html
2025-06-01 12:16:45,556 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/info.json
2025-06-01 12:16:45,558 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42373/index.html
2025-06-01 12:16:45,559 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42373/centroid_resids.pkl
2025-06-01 12:16:45,559 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42373/centroid_resids_time.png
2025-06-01 12:16:45,560 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42373/centroid_resids_scatter.png
2025-06-01 12:16:45,561 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42373/n_kalman_delta_roll.png
2025-06-01 12:16:45,561 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/kalman_plot_done to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42373/kalman_plot_done
2025-06-01 12:16:45,562 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/42373/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/42/42373/info.json
2025-06-01 12:16:45,562 main:
2025-06-01 12:16:45,562 main: ********************************************************************************
2025-06-01 12:16:45,562 main: Processing observation 30948
2025-06-01 12:16:45,562 main: ********************************************************************************
2025-06-01 12:16:48,260 write_centroid_resids: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/centroid_resids.pkl with 5 slots
2025-06-01 12:16:48,315 plot_crs_time: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/centroid_resids_time.png
2025-06-01 12:16:48,582 plot_crs_scatter: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/centroid_resids_scatter.png
2025-06-01 12:16:48,702 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2025-06-01 12:16:48,992 plot_n_kalman_delta_roll: Writing plot file /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/n_kalman_delta_roll.png
2025-06-01 12:16:49,132 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/index.html
2025-06-01 12:16:49,134 write_info_json: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/info.json
2025-06-01 12:16:49,136 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/index.html to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30948/index.html
2025-06-01 12:16:49,137 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/centroid_resids.pkl to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30948/centroid_resids.pkl
2025-06-01 12:16:49,138 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/centroid_resids_time.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30948/centroid_resids_time.png
2025-06-01 12:16:49,138 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/centroid_resids_scatter.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30948/centroid_resids_scatter.png
2025-06-01 12:16:49,139 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/n_kalman_delta_roll.png to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30948/n_kalman_delta_roll.png
2025-06-01 12:16:49,140 make_obsid_dir_links: Linking /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30948/info.json to /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/30/30948/info.json
2025-06-01 12:16:49,140 main:
2025-06-01 12:16:49,140 main: ********************************************************************************
2025-06-01 12:16:49,140 main: Processing observation 28653
2025-06-01 12:16:49,140 main: ********************************************************************************
2025-06-01 12:16:51,515 __init__: ObsID 28653 has insufficient telemetry, skipping
2025-06-01 12:16:51,527 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/28653/index.html
2025-06-01 12:16:51,528 main:
2025-06-01 12:16:51,528 main: ********************************************************************************
2025-06-01 12:16:51,528 main: Processing observation 30114
2025-06-01 12:16:51,528 main: ********************************************************************************
2025-06-01 12:16:53,857 __init__: ObsID 30114 has no maneuver event in telemetry, skipping
2025-06-01 12:16:53,869 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/30114/index.html
2025-06-01 12:16:53,871 main:
2025-06-01 12:16:53,871 main: ********************************************************************************
2025-06-01 12:16:53,871 main: Processing observation 28037
2025-06-01 12:16:53,871 main: ********************************************************************************
2025-06-01 12:16:53,871 obs_link_from_info: No /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/28037/info.json file found, obs=None
2025-06-01 12:16:56,165 __init__: ObsID 28037 has no maneuver event in telemetry, skipping
2025-06-01 12:16:56,179 write_index_html: Writing /export/tom/centroid_reports/www/ASPECT_ICXC/centroid_reports/2025/MAY2625B/28037/index.html
2025-06-01 12:16:56,180 main: