Prev
Index
Next
centroid_dashboard: Fri Apr 24 13:17:34 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Fri Apr 24 13:17:34 2026 |
No errors
File contents:
2026-04-24 13:16:12,183 main: Processing from 2026:107:17:16:12.181 to 2026:114:17:16:12.181
2026-04-24 13:16:20,976 get_observations: Found observation 30250 at 2026:107:18:48:03.219 with 1 manvrs
2026-04-24 13:16:20,977 get_observations: Found observation 32297 at 2026:108:03:34:44.225 with 1 manvrs
2026-04-24 13:16:20,977 get_observations: Found observation 41543 at 2026:108:07:10:50.673 with 1 manvrs
2026-04-24 13:16:20,978 get_observations: Found observation 41542 at 2026:108:12:15:40.252 with 1 manvrs
2026-04-24 13:16:20,978 get_observations: Found observation 32305 at 2026:108:16:42:24.683 with 1 manvrs
2026-04-24 13:16:20,978 get_observations: Found observation 32296 at 2026:108:20:29:14.657 with 1 manvrs
2026-04-24 13:16:20,979 get_observations: Found observation 30259 at 2026:108:23:50:37.957 with 1 manvrs
2026-04-24 13:16:20,979 get_observations: Found observation 32299 at 2026:109:07:51:18.236 with 1 manvrs
2026-04-24 13:16:20,980 get_observations: Found observation 30257 at 2026:109:10:38:41.619 with 1 manvrs
2026-04-24 13:16:20,980 get_observations: Found observation 32292 at 2026:109:18:57:04.754 with 1 manvrs
2026-04-24 13:16:20,980 get_observations: Found observation 32298 at 2026:109:22:16:52.381 with 1 manvrs
2026-04-24 13:16:20,981 get_observations: Found observation 32306 at 2026:110:01:59:58.200 with 1 manvrs
2026-04-24 13:16:20,981 get_observations: Found observation 31419 at 2026:110:03:48:20.813 with 1 manvrs
2026-04-24 13:16:20,982 get_observations: Found observation 29878 at 2026:110:09:56:55.239 with 1 manvrs
2026-04-24 13:16:20,982 get_observations: Found observation 29880 at 2026:110:14:57:12.397 with 1 manvrs
2026-04-24 13:16:20,982 get_observations: Found observation 41541 at 2026:110:21:54:48.530 with 1 manvrs
2026-04-24 13:16:20,983 get_observations: Found observation 41540 at 2026:110:23:26:21.224 with 1 manvrs
2026-04-24 13:16:20,983 get_observations: Found observation 41539 at 2026:111:02:55:40.252 with 1 manvrs
2026-04-24 13:16:20,984 get_observations: Found observation 41538 at 2026:111:06:10:40.252 with 1 manvrs
2026-04-24 13:16:20,984 get_observations: Found observation 41537 at 2026:111:07:15:19.088 with 1 manvrs
2026-04-24 13:16:20,985 get_observations: Found observation 31864 at 2026:111:08:27:40.800 with 1 manvrs
2026-04-24 13:16:20,985 get_observations: Found observation 30180 at 2026:111:13:00:22.836 with 1 manvrs
2026-04-24 13:16:20,986 get_observations: Found observation 30026 at 2026:111:16:58:43.849 with 1 manvrs
2026-04-24 13:16:20,986 get_observations: Found observation 29863 at 2026:111:23:05:39.794 with 1 manvrs
2026-04-24 13:16:20,986 get_observations: Found observation 32311 at 2026:112:12:54:20.449 with 1 manvrs
2026-04-24 13:16:20,987 get_observations: Found observation 32309 at 2026:112:19:51:48.037 with 1 manvrs
2026-04-24 13:16:20,987 get_observations: Found observation 31516 at 2026:113:00:40:53.146 with 1 manvrs
2026-04-24 13:16:20,988 get_observations: Found observation 32310 at 2026:113:05:13:20.917 with 1 manvrs
2026-04-24 13:16:20,988 get_observations: Found observation 31399 at 2026:113:08:30:22.198 with 1 manvrs
2026-04-24 13:16:20,988 get_observations: Found observation 41536 at 2026:113:11:56:08.483 with 1 manvrs
2026-04-24 13:16:20,989 get_observations: Found observation 41535 at 2026:113:12:59:34.314 with 1 manvrs
2026-04-24 13:16:20,989 get_observations: Found observation 41534 at 2026:113:17:55:40.252 with 1 manvrs
2026-04-24 13:16:20,990 get_observations: Found observation 41533 at 2026:113:21:54:40.252 with 1 manvrs
2026-04-24 13:16:20,990 get_observations: Found observation 32312 at 2026:113:23:35:50.205 with 1 manvrs
2026-04-24 13:16:20,990 get_observations: Found observation 30024 at 2026:114:05:27:29.527 with 1 manvrs
2026-04-24 13:16:20,991 get_observations: Found observation 32313 at 2026:114:09:39:12.814 with 1 manvrs
2026-04-24 13:16:20,991 get_observations: Found observation 31734 at 2026:114:15:17:19.167 with 1 manvrs
2026-04-24 13:16:20,992 main: Found 37 observations
2026-04-24 13:16:20,992 main: ********************************************************************************
2026-04-24 13:16:20,992 main: Processing observation 30250
2026-04-24 13:16:20,992 main: ********************************************************************************
2026-04-24 13:16:20,995 obs_link_from_info: Found prev obsid 32300
2026-04-24 13:16:20,999 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,000 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,004 process_obs: ObsID 30250 already processed, skipping
2026-04-24 13:16:21,004 main:
2026-04-24 13:16:21,004 main: ********************************************************************************
2026-04-24 13:16:21,004 main: Processing observation 32297
2026-04-24 13:16:21,004 main: ********************************************************************************
2026-04-24 13:16:21,005 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,006 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,011 process_obs: ObsID 32297 already processed, skipping
2026-04-24 13:16:21,011 main:
2026-04-24 13:16:21,011 main: ********************************************************************************
2026-04-24 13:16:21,011 main: Processing observation 41543
2026-04-24 13:16:21,011 main: ********************************************************************************
2026-04-24 13:16:21,012 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,013 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,016 process_obs: ObsID 41543 already processed, skipping
2026-04-24 13:16:21,016 main:
2026-04-24 13:16:21,016 main: ********************************************************************************
2026-04-24 13:16:21,016 main: Processing observation 41542
2026-04-24 13:16:21,016 main: ********************************************************************************
2026-04-24 13:16:21,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,018 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,021 process_obs: ObsID 41542 already processed, skipping
2026-04-24 13:16:21,021 main:
2026-04-24 13:16:21,022 main: ********************************************************************************
2026-04-24 13:16:21,022 main: Processing observation 32305
2026-04-24 13:16:21,022 main: ********************************************************************************
2026-04-24 13:16:21,022 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,023 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,027 process_obs: ObsID 32305 already processed, skipping
2026-04-24 13:16:21,027 main:
2026-04-24 13:16:21,027 main: ********************************************************************************
2026-04-24 13:16:21,027 main: Processing observation 32296
2026-04-24 13:16:21,027 main: ********************************************************************************
2026-04-24 13:16:21,028 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,029 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,032 process_obs: ObsID 32296 already processed, skipping
2026-04-24 13:16:21,032 main:
2026-04-24 13:16:21,032 main: ********************************************************************************
2026-04-24 13:16:21,032 main: Processing observation 30259
2026-04-24 13:16:21,032 main: ********************************************************************************
2026-04-24 13:16:21,033 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,034 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,037 process_obs: ObsID 30259 already processed, skipping
2026-04-24 13:16:21,037 main:
2026-04-24 13:16:21,037 main: ********************************************************************************
2026-04-24 13:16:21,037 main: Processing observation 32299
2026-04-24 13:16:21,037 main: ********************************************************************************
2026-04-24 13:16:21,038 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,039 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,043 process_obs: ObsID 32299 already processed, skipping
2026-04-24 13:16:21,043 main:
2026-04-24 13:16:21,043 main: ********************************************************************************
2026-04-24 13:16:21,043 main: Processing observation 30257
2026-04-24 13:16:21,043 main: ********************************************************************************
2026-04-24 13:16:21,044 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,045 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,048 process_obs: ObsID 30257 already processed, skipping
2026-04-24 13:16:21,048 main:
2026-04-24 13:16:21,048 main: ********************************************************************************
2026-04-24 13:16:21,048 main: Processing observation 32292
2026-04-24 13:16:21,048 main: ********************************************************************************
2026-04-24 13:16:21,049 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,050 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,053 process_obs: ObsID 32292 already processed, skipping
2026-04-24 13:16:21,053 main:
2026-04-24 13:16:21,053 main: ********************************************************************************
2026-04-24 13:16:21,053 main: Processing observation 32298
2026-04-24 13:16:21,054 main: ********************************************************************************
2026-04-24 13:16:21,054 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,055 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-24 13:16:21,059 process_obs: ObsID 32298 already processed, skipping
2026-04-24 13:16:21,059 main:
2026-04-24 13:16:21,059 main: ********************************************************************************
2026-04-24 13:16:21,059 main: Processing observation 32306
2026-04-24 13:16:21,059 main: ********************************************************************************
2026-04-24 13:16:21,060 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,061 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,064 process_obs: ObsID 32306 already processed, skipping
2026-04-24 13:16:21,065 main:
2026-04-24 13:16:21,065 main: ********************************************************************************
2026-04-24 13:16:21,065 main: Processing observation 31419
2026-04-24 13:16:21,065 main: ********************************************************************************
2026-04-24 13:16:21,065 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,066 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,070 process_obs: ObsID 31419 already processed, skipping
2026-04-24 13:16:21,070 main:
2026-04-24 13:16:21,070 main: ********************************************************************************
2026-04-24 13:16:21,070 main: Processing observation 29878
2026-04-24 13:16:21,070 main: ********************************************************************************
2026-04-24 13:16:21,071 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,072 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,075 process_obs: ObsID 29878 already processed, skipping
2026-04-24 13:16:21,075 main:
2026-04-24 13:16:21,075 main: ********************************************************************************
2026-04-24 13:16:21,075 main: Processing observation 29880
2026-04-24 13:16:21,076 main: ********************************************************************************
2026-04-24 13:16:21,076 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,077 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,081 process_obs: ObsID 29880 already processed, skipping
2026-04-24 13:16:21,081 main:
2026-04-24 13:16:21,081 main: ********************************************************************************
2026-04-24 13:16:21,081 main: Processing observation 41541
2026-04-24 13:16:21,081 main: ********************************************************************************
2026-04-24 13:16:21,082 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,083 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,086 process_obs: ObsID 41541 already processed, skipping
2026-04-24 13:16:21,086 main:
2026-04-24 13:16:21,086 main: ********************************************************************************
2026-04-24 13:16:21,086 main: Processing observation 41540
2026-04-24 13:16:21,086 main: ********************************************************************************
2026-04-24 13:16:21,087 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,088 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,091 process_obs: ObsID 41540 already processed, skipping
2026-04-24 13:16:21,091 main:
2026-04-24 13:16:21,091 main: ********************************************************************************
2026-04-24 13:16:21,091 main: Processing observation 41539
2026-04-24 13:16:21,091 main: ********************************************************************************
2026-04-24 13:16:21,092 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,093 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,097 process_obs: ObsID 41539 already processed, skipping
2026-04-24 13:16:21,097 main:
2026-04-24 13:16:21,097 main: ********************************************************************************
2026-04-24 13:16:21,097 main: Processing observation 41538
2026-04-24 13:16:21,097 main: ********************************************************************************
2026-04-24 13:16:21,098 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,099 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,102 process_obs: ObsID 41538 already processed, skipping
2026-04-24 13:16:21,102 main:
2026-04-24 13:16:21,102 main: ********************************************************************************
2026-04-24 13:16:21,102 main: Processing observation 41537
2026-04-24 13:16:21,102 main: ********************************************************************************
2026-04-24 13:16:21,103 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,104 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,107 process_obs: ObsID 41537 already processed, skipping
2026-04-24 13:16:21,107 main:
2026-04-24 13:16:21,107 main: ********************************************************************************
2026-04-24 13:16:21,107 main: Processing observation 31864
2026-04-24 13:16:21,107 main: ********************************************************************************
2026-04-24 13:16:21,108 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,109 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,112 process_obs: ObsID 31864 already processed, skipping
2026-04-24 13:16:21,113 main:
2026-04-24 13:16:21,113 main: ********************************************************************************
2026-04-24 13:16:21,113 main: Processing observation 30180
2026-04-24 13:16:21,113 main: ********************************************************************************
2026-04-24 13:16:21,113 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,114 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 13:16:21,118 process_obs: ObsID 30180 already processed, skipping
2026-04-24 13:16:21,118 main:
2026-04-24 13:16:21,118 main: ********************************************************************************
2026-04-24 13:16:21,118 main: Processing observation 30026
2026-04-24 13:16:21,118 main: ********************************************************************************
2026-04-24 13:16:21,119 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 13:16:21,120 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:25,145 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/centroid_resids.pkl
2026-04-24 12:16:25,161 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-24 12:16:25,162 plot_crs_time: Plot file exists, skipping
2026-04-24 12:16:25,162 plot_crs_scatter: Plot file exists, skipping
2026-04-24 12:16:25,775 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-24 12:16:26,607 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/n_kalman_delta_roll.png
2026-04-24 12:16:30,481 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/index.html
2026-04-24 12:16:30,483 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/info.json
2026-04-24 12:16:30,486 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30026/index.html
2026-04-24 12:16:30,491 main:
2026-04-24 12:16:30,491 main: ********************************************************************************
2026-04-24 12:16:30,491 main: Processing observation 29863
2026-04-24 12:16:30,491 main: ********************************************************************************
2026-04-24 12:16:30,495 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:30,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:33,195 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29863/centroid_resids.pkl
2026-04-24 12:16:33,263 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-24 12:16:33,263 plot_crs_time: Plot file exists, skipping
2026-04-24 12:16:33,264 plot_crs_scatter: Plot file exists, skipping
2026-04-24 12:16:34,532 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29863/n_kalman_delta_roll.png
2026-04-24 12:16:34,706 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29863/index.html
2026-04-24 12:16:34,707 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29863/info.json
2026-04-24 12:16:34,722 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29863/index.html
2026-04-24 12:16:34,723 main:
2026-04-24 12:16:34,723 main: ********************************************************************************
2026-04-24 12:16:34,724 main: Processing observation 32311
2026-04-24 12:16:34,724 main: ********************************************************************************
2026-04-24 12:16:34,725 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:34,728 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:34,741 process_obs: ObsID 32311 already processed, skipping
2026-04-24 12:16:34,741 main:
2026-04-24 12:16:34,741 main: ********************************************************************************
2026-04-24 12:16:34,741 main: Processing observation 32309
2026-04-24 12:16:34,742 main: ********************************************************************************
2026-04-24 12:16:34,753 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:34,754 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:34,761 process_obs: ObsID 32309 already processed, skipping
2026-04-24 12:16:34,761 main:
2026-04-24 12:16:34,761 main: ********************************************************************************
2026-04-24 12:16:34,761 main: Processing observation 31516
2026-04-24 12:16:34,761 main: ********************************************************************************
2026-04-24 12:16:34,763 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:34,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:37,151 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-24 12:16:37,784 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31516/centroid_resids.pkl with 5 slots
2026-04-24 12:16:37,842 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31516/centroid_resids_time.png
2026-04-24 12:16:38,167 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31516/centroid_resids_scatter.png
2026-04-24 12:16:38,969 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31516/n_kalman_delta_roll.png
2026-04-24 12:16:41,590 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31516/index.html
2026-04-24 12:16:41,591 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31516/info.json
2026-04-24 12:16:41,594 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31516/index.html
2026-04-24 12:16:41,595 main:
2026-04-24 12:16:41,595 main: ********************************************************************************
2026-04-24 12:16:41,595 main: Processing observation 32310
2026-04-24 12:16:41,595 main: ********************************************************************************
2026-04-24 12:16:41,596 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:41,598 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:43,836 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-24 12:16:44,683 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32310/centroid_resids.pkl with 5 slots
2026-04-24 12:16:44,732 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32310/centroid_resids_time.png
2026-04-24 12:16:44,979 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32310/centroid_resids_scatter.png
2026-04-24 12:16:45,673 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32310/n_kalman_delta_roll.png
2026-04-24 12:16:45,815 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32310/index.html
2026-04-24 12:16:45,816 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32310/info.json
2026-04-24 12:16:45,819 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32310/index.html
2026-04-24 12:16:45,820 main:
2026-04-24 12:16:45,820 main: ********************************************************************************
2026-04-24 12:16:45,820 main: Processing observation 31399
2026-04-24 12:16:45,820 main: ********************************************************************************
2026-04-24 12:16:45,821 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:45,822 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:47,961 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-24 12:16:48,544 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/centroid_resids.pkl with 5 slots
2026-04-24 12:16:48,588 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/centroid_resids_time.png
2026-04-24 12:16:48,846 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/centroid_resids_scatter.png
2026-04-24 12:16:48,984 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-24 12:16:49,140 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/n_kalman_delta_roll.png
2026-04-24 12:16:49,267 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/index.html
2026-04-24 12:16:49,268 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/info.json
2026-04-24 12:16:49,271 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31399/index.html
2026-04-24 12:16:49,272 main:
2026-04-24 12:16:49,272 main: ********************************************************************************
2026-04-24 12:16:49,272 main: Processing observation 41536
2026-04-24 12:16:49,272 main: ********************************************************************************
2026-04-24 12:16:49,273 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:49,274 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:51,397 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-24 12:16:52,391 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41536/centroid_resids.pkl with 8 slots
2026-04-24 12:16:52,458 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41536/centroid_resids_time.png
2026-04-24 12:16:52,753 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41536/centroid_resids_scatter.png
2026-04-24 12:16:52,828 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-24 12:16:52,992 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41536/n_kalman_delta_roll.png
2026-04-24 12:16:53,142 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41536/index.html
2026-04-24 12:16:53,144 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41536/info.json
2026-04-24 12:16:53,146 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41536/index.html
2026-04-24 12:16:53,147 main:
2026-04-24 12:16:53,147 main: ********************************************************************************
2026-04-24 12:16:53,147 main: Processing observation 41535
2026-04-24 12:16:53,147 main: ********************************************************************************
2026-04-24 12:16:53,149 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:53,150 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:55,263 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-24 12:16:55,702 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41535/centroid_resids.pkl with 8 slots
2026-04-24 12:16:55,793 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41535/centroid_resids_time.png
2026-04-24 12:16:56,172 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41535/centroid_resids_scatter.png
2026-04-24 12:16:56,320 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-24 12:16:56,432 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41535/n_kalman_delta_roll.png
2026-04-24 12:16:56,574 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41535/index.html
2026-04-24 12:16:56,576 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41535/info.json
2026-04-24 12:16:56,578 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41535/index.html
2026-04-24 12:16:56,579 main:
2026-04-24 12:16:56,579 main: ********************************************************************************
2026-04-24 12:16:56,579 main: Processing observation 41534
2026-04-24 12:16:56,579 main: ********************************************************************************
2026-04-24 12:16:56,580 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:16:56,582 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:16:58,652 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-24 12:16:59,375 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41534/centroid_resids.pkl with 8 slots
2026-04-24 12:16:59,450 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41534/centroid_resids_time.png
2026-04-24 12:16:59,806 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41534/centroid_resids_scatter.png
2026-04-24 12:16:59,940 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-24 12:17:00,114 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41534/n_kalman_delta_roll.png
2026-04-24 12:17:00,291 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41534/index.html
2026-04-24 12:17:00,293 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41534/info.json
2026-04-24 12:17:00,297 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41534/index.html
2026-04-24 12:17:00,298 main:
2026-04-24 12:17:00,298 main: ********************************************************************************
2026-04-24 12:17:00,298 main: Processing observation 41533
2026-04-24 12:17:00,298 main: ********************************************************************************
2026-04-24 12:17:00,299 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:17:00,300 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:17:03,351 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-24 12:17:03,770 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41533/centroid_resids.pkl with 8 slots
2026-04-24 12:17:04,086 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41533/centroid_resids_time.png
2026-04-24 12:17:04,465 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41533/centroid_resids_scatter.png
2026-04-24 12:17:04,616 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-24 12:17:04,727 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41533/n_kalman_delta_roll.png
2026-04-24 12:17:05,437 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41533/index.html
2026-04-24 12:17:05,441 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41533/info.json
2026-04-24 12:17:05,449 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41533/index.html
2026-04-24 12:17:05,452 main:
2026-04-24 12:17:05,452 main: ********************************************************************************
2026-04-24 12:17:05,452 main: Processing observation 32312
2026-04-24 12:17:05,452 main: ********************************************************************************
2026-04-24 12:17:05,455 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:17:05,462 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:17:09,206 __init__: ObsID 32312 has insufficient telemetry, skipping
2026-04-24 12:17:09,207 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/index.html
2026-04-24 12:17:09,211 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/info.json
2026-04-24 12:17:09,212 main:
2026-04-24 12:17:09,212 main: ********************************************************************************
2026-04-24 12:17:09,212 main: Processing observation 30024
2026-04-24 12:17:09,212 main: ********************************************************************************
2026-04-24 12:17:09,213 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:17:09,214 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:17:11,307 __init__: ObsID 30024 has insufficient telemetry, skipping
2026-04-24 12:17:11,307 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/index.html
2026-04-24 12:17:11,311 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/info.json
2026-04-24 12:17:11,312 main:
2026-04-24 12:17:11,312 main: ********************************************************************************
2026-04-24 12:17:11,312 main: Processing observation 32313
2026-04-24 12:17:11,312 main: ********************************************************************************
2026-04-24 12:17:11,313 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:17:11,315 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:17:13,338 __init__: ObsID 32313 has no maneuver event in telemetry, skipping
2026-04-24 12:17:13,339 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/index.html
2026-04-24 12:17:13,344 info: could not get attribute kalman_start for obsid 32313
2026-04-24 12:17:13,344 info: could not get attribute kalman_stop for obsid 32313
2026-04-24 12:17:13,344 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/info.json
2026-04-24 12:17:13,345 main:
2026-04-24 12:17:13,345 main: ********************************************************************************
2026-04-24 12:17:13,345 main: Processing observation 31734
2026-04-24 12:17:13,345 main: ********************************************************************************
2026-04-24 12:17:13,345 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/info.json file found, obs=None
2026-04-24 12:17:13,346 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-24 12:17:13,347 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-24 12:17:15,342 __init__: ObsID 31734 has no maneuver event in telemetry, skipping
2026-04-24 12:17:15,342 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/index.html
2026-04-24 12:17:15,347 info: could not get attribute kalman_start for obsid 31734
2026-04-24 12:17:15,347 info: could not get attribute kalman_stop for obsid 31734
2026-04-24 12:17:15,347 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/info.json
2026-04-24 12:17:15,348 main:
2026-04-24 13:17:17,031 run_check: Starting centroid dashboard continuity check
2026-04-24 13:17:17,031 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-24 13:17:17,034 collect_observations: Processing year 2020
2026-04-24 13:17:18,846 collect_observations: Processing year 2021
2026-04-24 13:17:21,486 collect_observations: Processing year 2022
2026-04-24 13:17:24,602 collect_observations: Processing year 2023
2026-04-24 13:17:27,802 collect_observations: Processing year 2024
2026-04-24 13:17:30,671 collect_observations: Processing year 2025
2026-04-24 13:17:33,741 collect_observations: Processing year 2026
2026-04-24 13:17:34,485 collect_observations: Collected 13758 observations from 4-digit years
2026-04-24 13:17:34,488 sort_observations_by_date: Sorted observations by date
2026-04-24 13:17:34,488 check_continuity: Starting continuity check from most recent: ObsID 31734 (APR2026A) at 2026:114:14:43:38.562
2026-04-24 13:17:34,505 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-24 13:17:34,505 check_continuity: Chain complete: visited 13758 observations out of 13758 total
2026-04-24 13:17:34,506 run_check: ✓ Observation chain continuity check PASSED
2026-04-24 13:17:34,506 run_check: Summary: 13758 observations from 4-digit years, all properly linked