Prev
Index
Next
centroid_dashboard: Sat Apr 25 13:17:31 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Sat Apr 25 13:17:31 2026 |
No errors
File contents:
2026-04-25 13:16:10,120 main: Processing from 2026:108:17:16:10.119 to 2026:115:17:16:10.119
2026-04-25 13:16:17,719 get_observations: Found observation 32296 at 2026:108:20:29:14.657 with 1 manvrs
2026-04-25 13:16:17,719 get_observations: Found observation 30259 at 2026:108:23:50:37.957 with 1 manvrs
2026-04-25 13:16:17,720 get_observations: Found observation 32299 at 2026:109:07:51:18.236 with 1 manvrs
2026-04-25 13:16:17,720 get_observations: Found observation 30257 at 2026:109:10:38:41.619 with 1 manvrs
2026-04-25 13:16:17,721 get_observations: Found observation 32292 at 2026:109:18:57:04.754 with 1 manvrs
2026-04-25 13:16:17,721 get_observations: Found observation 32298 at 2026:109:22:16:52.381 with 1 manvrs
2026-04-25 13:16:17,721 get_observations: Found observation 32306 at 2026:110:01:59:58.200 with 1 manvrs
2026-04-25 13:16:17,722 get_observations: Found observation 31419 at 2026:110:03:48:20.813 with 1 manvrs
2026-04-25 13:16:17,722 get_observations: Found observation 29878 at 2026:110:09:56:55.239 with 1 manvrs
2026-04-25 13:16:17,723 get_observations: Found observation 29880 at 2026:110:14:57:12.397 with 1 manvrs
2026-04-25 13:16:17,723 get_observations: Found observation 41541 at 2026:110:21:54:48.530 with 1 manvrs
2026-04-25 13:16:17,723 get_observations: Found observation 41540 at 2026:110:23:26:21.224 with 1 manvrs
2026-04-25 13:16:17,724 get_observations: Found observation 41539 at 2026:111:02:55:40.252 with 1 manvrs
2026-04-25 13:16:17,724 get_observations: Found observation 41538 at 2026:111:06:10:40.252 with 1 manvrs
2026-04-25 13:16:17,725 get_observations: Found observation 41537 at 2026:111:07:15:19.088 with 1 manvrs
2026-04-25 13:16:17,725 get_observations: Found observation 31864 at 2026:111:08:27:40.800 with 1 manvrs
2026-04-25 13:16:17,726 get_observations: Found observation 30180 at 2026:111:13:00:22.836 with 1 manvrs
2026-04-25 13:16:17,726 get_observations: Found observation 30026 at 2026:111:16:58:43.849 with 1 manvrs
2026-04-25 13:16:17,726 get_observations: Found observation 29863 at 2026:111:23:05:39.794 with 1 manvrs
2026-04-25 13:16:17,727 get_observations: Found observation 32311 at 2026:112:12:54:20.449 with 1 manvrs
2026-04-25 13:16:17,727 get_observations: Found observation 32309 at 2026:112:19:51:48.037 with 1 manvrs
2026-04-25 13:16:17,728 get_observations: Found observation 31516 at 2026:113:00:40:53.146 with 1 manvrs
2026-04-25 13:16:17,728 get_observations: Found observation 32310 at 2026:113:05:13:20.917 with 1 manvrs
2026-04-25 13:16:17,729 get_observations: Found observation 31399 at 2026:113:08:30:22.198 with 1 manvrs
2026-04-25 13:16:17,729 get_observations: Found observation 41536 at 2026:113:11:56:08.483 with 1 manvrs
2026-04-25 13:16:17,729 get_observations: Found observation 41535 at 2026:113:12:59:34.314 with 1 manvrs
2026-04-25 13:16:17,730 get_observations: Found observation 41534 at 2026:113:17:55:40.252 with 1 manvrs
2026-04-25 13:16:17,730 get_observations: Found observation 41533 at 2026:113:21:54:40.252 with 1 manvrs
2026-04-25 13:16:17,731 get_observations: Found observation 32312 at 2026:113:23:35:50.205 with 1 manvrs
2026-04-25 13:16:17,731 get_observations: Found observation 30024 at 2026:114:05:27:29.527 with 1 manvrs
2026-04-25 13:16:17,731 get_observations: Found observation 32313 at 2026:114:09:39:12.814 with 1 manvrs
2026-04-25 13:16:17,732 get_observations: Found observation 31734 at 2026:114:15:17:19.167 with 1 manvrs
2026-04-25 13:16:17,732 get_observations: Found observation 32307 at 2026:115:02:41:28.729 with 1 manvrs
2026-04-25 13:16:17,733 get_observations: Found observation 32314 at 2026:115:06:06:59.496 with 1 manvrs
2026-04-25 13:16:17,733 get_observations: Found observation 31083 at 2026:115:09:26:38.721 with 1 manvrs
2026-04-25 13:16:17,733 get_observations: Found observation 32315 at 2026:115:14:42:57.679 with 1 manvrs
2026-04-25 13:16:17,734 main: Found 36 observations
2026-04-25 13:16:17,734 main: ********************************************************************************
2026-04-25 13:16:17,734 main: Processing observation 32296
2026-04-25 13:16:17,734 main: ********************************************************************************
2026-04-25 13:16:17,737 obs_link_from_info: Found prev obsid 32305
2026-04-25 13:16:17,740 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,741 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-25 13:16:17,744 process_obs: ObsID 32296 already processed, skipping
2026-04-25 13:16:17,744 main:
2026-04-25 13:16:17,744 main: ********************************************************************************
2026-04-25 13:16:17,744 main: Processing observation 30259
2026-04-25 13:16:17,744 main: ********************************************************************************
2026-04-25 13:16:17,745 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,746 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-25 13:16:17,749 process_obs: ObsID 30259 already processed, skipping
2026-04-25 13:16:17,749 main:
2026-04-25 13:16:17,749 main: ********************************************************************************
2026-04-25 13:16:17,749 main: Processing observation 32299
2026-04-25 13:16:17,749 main: ********************************************************************************
2026-04-25 13:16:17,750 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,751 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-25 13:16:17,754 process_obs: ObsID 32299 already processed, skipping
2026-04-25 13:16:17,754 main:
2026-04-25 13:16:17,754 main: ********************************************************************************
2026-04-25 13:16:17,754 main: Processing observation 30257
2026-04-25 13:16:17,754 main: ********************************************************************************
2026-04-25 13:16:17,755 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,756 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-25 13:16:17,759 process_obs: ObsID 30257 already processed, skipping
2026-04-25 13:16:17,759 main:
2026-04-25 13:16:17,759 main: ********************************************************************************
2026-04-25 13:16:17,759 main: Processing observation 32292
2026-04-25 13:16:17,759 main: ********************************************************************************
2026-04-25 13:16:17,760 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,761 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-25 13:16:17,764 process_obs: ObsID 32292 already processed, skipping
2026-04-25 13:16:17,764 main:
2026-04-25 13:16:17,764 main: ********************************************************************************
2026-04-25 13:16:17,764 main: Processing observation 32298
2026-04-25 13:16:17,764 main: ********************************************************************************
2026-04-25 13:16:17,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,766 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-25 13:16:17,769 process_obs: ObsID 32298 already processed, skipping
2026-04-25 13:16:17,769 main:
2026-04-25 13:16:17,769 main: ********************************************************************************
2026-04-25 13:16:17,769 main: Processing observation 32306
2026-04-25 13:16:17,769 main: ********************************************************************************
2026-04-25 13:16:17,770 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,771 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,774 process_obs: ObsID 32306 already processed, skipping
2026-04-25 13:16:17,774 main:
2026-04-25 13:16:17,774 main: ********************************************************************************
2026-04-25 13:16:17,774 main: Processing observation 31419
2026-04-25 13:16:17,774 main: ********************************************************************************
2026-04-25 13:16:17,775 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,776 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,780 process_obs: ObsID 31419 already processed, skipping
2026-04-25 13:16:17,780 main:
2026-04-25 13:16:17,780 main: ********************************************************************************
2026-04-25 13:16:17,780 main: Processing observation 29878
2026-04-25 13:16:17,780 main: ********************************************************************************
2026-04-25 13:16:17,781 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,782 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,785 process_obs: ObsID 29878 already processed, skipping
2026-04-25 13:16:17,785 main:
2026-04-25 13:16:17,785 main: ********************************************************************************
2026-04-25 13:16:17,785 main: Processing observation 29880
2026-04-25 13:16:17,785 main: ********************************************************************************
2026-04-25 13:16:17,786 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,787 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,790 process_obs: ObsID 29880 already processed, skipping
2026-04-25 13:16:17,790 main:
2026-04-25 13:16:17,790 main: ********************************************************************************
2026-04-25 13:16:17,790 main: Processing observation 41541
2026-04-25 13:16:17,790 main: ********************************************************************************
2026-04-25 13:16:17,791 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,792 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,796 process_obs: ObsID 41541 already processed, skipping
2026-04-25 13:16:17,796 main:
2026-04-25 13:16:17,796 main: ********************************************************************************
2026-04-25 13:16:17,796 main: Processing observation 41540
2026-04-25 13:16:17,796 main: ********************************************************************************
2026-04-25 13:16:17,797 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,798 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,801 process_obs: ObsID 41540 already processed, skipping
2026-04-25 13:16:17,801 main:
2026-04-25 13:16:17,801 main: ********************************************************************************
2026-04-25 13:16:17,801 main: Processing observation 41539
2026-04-25 13:16:17,801 main: ********************************************************************************
2026-04-25 13:16:17,802 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,803 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,806 process_obs: ObsID 41539 already processed, skipping
2026-04-25 13:16:17,806 main:
2026-04-25 13:16:17,806 main: ********************************************************************************
2026-04-25 13:16:17,806 main: Processing observation 41538
2026-04-25 13:16:17,806 main: ********************************************************************************
2026-04-25 13:16:17,807 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,808 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,810 process_obs: ObsID 41538 already processed, skipping
2026-04-25 13:16:17,810 main:
2026-04-25 13:16:17,810 main: ********************************************************************************
2026-04-25 13:16:17,810 main: Processing observation 41537
2026-04-25 13:16:17,810 main: ********************************************************************************
2026-04-25 13:16:17,811 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,812 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,815 process_obs: ObsID 41537 already processed, skipping
2026-04-25 13:16:17,815 main:
2026-04-25 13:16:17,815 main: ********************************************************************************
2026-04-25 13:16:17,815 main: Processing observation 31864
2026-04-25 13:16:17,815 main: ********************************************************************************
2026-04-25 13:16:17,816 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,817 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,820 process_obs: ObsID 31864 already processed, skipping
2026-04-25 13:16:17,820 main:
2026-04-25 13:16:17,820 main: ********************************************************************************
2026-04-25 13:16:17,820 main: Processing observation 30180
2026-04-25 13:16:17,820 main: ********************************************************************************
2026-04-25 13:16:17,821 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,822 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 13:16:17,825 process_obs: ObsID 30180 already processed, skipping
2026-04-25 13:16:17,825 main:
2026-04-25 13:16:17,825 main: ********************************************************************************
2026-04-25 13:16:17,825 main: Processing observation 30026
2026-04-25 13:16:17,825 main: ********************************************************************************
2026-04-25 13:16:17,826 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 13:16:17,827 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:20,277 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/centroid_resids.pkl
2026-04-25 12:16:20,283 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-25 12:16:20,283 plot_crs_time: Plot file exists, skipping
2026-04-25 12:16:20,283 plot_crs_scatter: Plot file exists, skipping
2026-04-25 12:16:20,459 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-25 12:16:20,723 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/n_kalman_delta_roll.png
2026-04-25 12:16:24,046 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/index.html
2026-04-25 12:16:24,047 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/info.json
2026-04-25 12:16:24,051 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30026/index.html
2026-04-25 12:16:24,053 main:
2026-04-25 12:16:24,053 main: ********************************************************************************
2026-04-25 12:16:24,053 main: Processing observation 29863
2026-04-25 12:16:24,053 main: ********************************************************************************
2026-04-25 12:16:24,055 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:24,056 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:24,072 process_obs: ObsID 29863 already processed, skipping
2026-04-25 12:16:24,072 main:
2026-04-25 12:16:24,072 main: ********************************************************************************
2026-04-25 12:16:24,072 main: Processing observation 32311
2026-04-25 12:16:24,072 main: ********************************************************************************
2026-04-25 12:16:24,073 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:24,074 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:24,081 process_obs: ObsID 32311 already processed, skipping
2026-04-25 12:16:24,081 main:
2026-04-25 12:16:24,081 main: ********************************************************************************
2026-04-25 12:16:24,081 main: Processing observation 32309
2026-04-25 12:16:24,081 main: ********************************************************************************
2026-04-25 12:16:24,083 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:24,086 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:24,091 process_obs: ObsID 32309 already processed, skipping
2026-04-25 12:16:24,091 main:
2026-04-25 12:16:24,091 main: ********************************************************************************
2026-04-25 12:16:24,091 main: Processing observation 31516
2026-04-25 12:16:24,091 main: ********************************************************************************
2026-04-25 12:16:24,093 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:24,095 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:24,119 process_obs: ObsID 31516 already processed, skipping
2026-04-25 12:16:24,119 main:
2026-04-25 12:16:24,119 main: ********************************************************************************
2026-04-25 12:16:24,119 main: Processing observation 32310
2026-04-25 12:16:24,119 main: ********************************************************************************
2026-04-25 12:16:24,120 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:24,121 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:24,140 process_obs: ObsID 32310 already processed, skipping
2026-04-25 12:16:24,140 main:
2026-04-25 12:16:24,140 main: ********************************************************************************
2026-04-25 12:16:24,140 main: Processing observation 31399
2026-04-25 12:16:24,140 main: ********************************************************************************
2026-04-25 12:16:24,141 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:24,146 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:30,770 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/centroid_resids.pkl
2026-04-25 12:16:30,795 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-25 12:16:30,796 plot_crs_time: Plot file exists, skipping
2026-04-25 12:16:30,797 plot_crs_scatter: Plot file exists, skipping
2026-04-25 12:16:31,622 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/n_kalman_delta_roll.png
2026-04-25 12:16:36,968 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/index.html
2026-04-25 12:16:36,971 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31399/info.json
2026-04-25 12:16:36,998 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31399/index.html
2026-04-25 12:16:37,002 main:
2026-04-25 12:16:37,002 main: ********************************************************************************
2026-04-25 12:16:37,002 main: Processing observation 41536
2026-04-25 12:16:37,002 main: ********************************************************************************
2026-04-25 12:16:37,004 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:37,006 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:37,028 process_obs: ObsID 41536 already processed, skipping
2026-04-25 12:16:37,029 main:
2026-04-25 12:16:37,029 main: ********************************************************************************
2026-04-25 12:16:37,029 main: Processing observation 41535
2026-04-25 12:16:37,029 main: ********************************************************************************
2026-04-25 12:16:37,031 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:37,035 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:37,059 process_obs: ObsID 41535 already processed, skipping
2026-04-25 12:16:37,059 main:
2026-04-25 12:16:37,059 main: ********************************************************************************
2026-04-25 12:16:37,059 main: Processing observation 41534
2026-04-25 12:16:37,059 main: ********************************************************************************
2026-04-25 12:16:37,061 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:37,064 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:37,081 process_obs: ObsID 41534 already processed, skipping
2026-04-25 12:16:37,082 main:
2026-04-25 12:16:37,082 main: ********************************************************************************
2026-04-25 12:16:37,082 main: Processing observation 41533
2026-04-25 12:16:37,082 main: ********************************************************************************
2026-04-25 12:16:37,085 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:37,089 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:37,114 process_obs: ObsID 41533 already processed, skipping
2026-04-25 12:16:37,114 main:
2026-04-25 12:16:37,114 main: ********************************************************************************
2026-04-25 12:16:37,114 main: Processing observation 32312
2026-04-25 12:16:37,114 main: ********************************************************************************
2026-04-25 12:16:37,119 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:37,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:42,016 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-25 12:16:42,948 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/centroid_resids.pkl with 5 slots
2026-04-25 12:16:43,013 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/centroid_resids_time.png
2026-04-25 12:16:43,455 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/centroid_resids_scatter.png
2026-04-25 12:16:44,888 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/n_kalman_delta_roll.png
2026-04-25 12:16:50,418 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/index.html
2026-04-25 12:16:50,419 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32312/info.json
2026-04-25 12:16:50,422 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32312/index.html
2026-04-25 12:16:50,423 main:
2026-04-25 12:16:50,423 main: ********************************************************************************
2026-04-25 12:16:50,423 main: Processing observation 30024
2026-04-25 12:16:50,423 main: ********************************************************************************
2026-04-25 12:16:50,424 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:50,425 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:52,556 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-25 12:16:53,037 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/centroid_resids.pkl with 5 slots
2026-04-25 12:16:53,082 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/centroid_resids_time.png
2026-04-25 12:16:53,344 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/centroid_resids_scatter.png
2026-04-25 12:16:54,233 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/n_kalman_delta_roll.png
2026-04-25 12:16:54,381 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/index.html
2026-04-25 12:16:54,382 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30024/info.json
2026-04-25 12:16:54,384 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30024/index.html
2026-04-25 12:16:54,385 main:
2026-04-25 12:16:54,385 main: ********************************************************************************
2026-04-25 12:16:54,385 main: Processing observation 32313
2026-04-25 12:16:54,385 main: ********************************************************************************
2026-04-25 12:16:54,386 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:54,387 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:16:56,521 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-25 12:16:56,802 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/centroid_resids.pkl with 5 slots
2026-04-25 12:16:56,860 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/centroid_resids_time.png
2026-04-25 12:16:57,137 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/centroid_resids_scatter.png
2026-04-25 12:16:58,058 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/n_kalman_delta_roll.png
2026-04-25 12:16:58,187 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/index.html
2026-04-25 12:16:58,189 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32313/info.json
2026-04-25 12:16:58,191 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32313/index.html
2026-04-25 12:16:58,192 main:
2026-04-25 12:16:58,192 main: ********************************************************************************
2026-04-25 12:16:58,192 main: Processing observation 31734
2026-04-25 12:16:58,192 main: ********************************************************************************
2026-04-25 12:16:58,193 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:16:58,194 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:17:00,443 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-25 12:17:00,978 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/centroid_resids.pkl with 5 slots
2026-04-25 12:17:01,043 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/centroid_resids_time.png
2026-04-25 12:17:01,386 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/centroid_resids_scatter.png
2026-04-25 12:17:01,638 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-25 12:17:01,747 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/n_kalman_delta_roll.png
2026-04-25 12:17:01,882 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/index.html
2026-04-25 12:17:01,884 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/info.json
2026-04-25 12:17:01,887 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31734/index.html
2026-04-25 12:17:01,888 main:
2026-04-25 12:17:01,888 main: ********************************************************************************
2026-04-25 12:17:01,888 main: Processing observation 32307
2026-04-25 12:17:01,888 main: ********************************************************************************
2026-04-25 12:17:01,901 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:17:01,902 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:17:04,731 __init__: ObsID 32307 has insufficient telemetry, skipping
2026-04-25 12:17:04,733 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/index.html
2026-04-25 12:17:04,738 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/info.json
2026-04-25 12:17:04,742 main:
2026-04-25 12:17:04,742 main: ********************************************************************************
2026-04-25 12:17:04,742 main: Processing observation 32314
2026-04-25 12:17:04,742 main: ********************************************************************************
2026-04-25 12:17:04,746 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:17:04,747 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:17:09,271 __init__: ObsID 32314 has insufficient telemetry, skipping
2026-04-25 12:17:09,275 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/index.html
2026-04-25 12:17:09,297 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/info.json
2026-04-25 12:17:09,307 main:
2026-04-25 12:17:09,307 main: ********************************************************************************
2026-04-25 12:17:09,307 main: Processing observation 31083
2026-04-25 12:17:09,307 main: ********************************************************************************
2026-04-25 12:17:09,319 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:17:09,335 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:17:11,509 __init__: ObsID 31083 has no maneuver event in telemetry, skipping
2026-04-25 12:17:11,510 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/index.html
2026-04-25 12:17:11,514 info: could not get attribute kalman_start for obsid 31083
2026-04-25 12:17:11,514 info: could not get attribute kalman_stop for obsid 31083
2026-04-25 12:17:11,515 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/info.json
2026-04-25 12:17:11,515 main:
2026-04-25 12:17:11,515 main: ********************************************************************************
2026-04-25 12:17:11,515 main: Processing observation 32315
2026-04-25 12:17:11,515 main: ********************************************************************************
2026-04-25 12:17:11,516 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/info.json file found, obs=None
2026-04-25 12:17:11,517 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-25 12:17:11,518 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-25 12:17:13,524 __init__: ObsID 32315 has no maneuver event in telemetry, skipping
2026-04-25 12:17:13,525 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/index.html
2026-04-25 12:17:13,529 info: could not get attribute kalman_start for obsid 32315
2026-04-25 12:17:13,529 info: could not get attribute kalman_stop for obsid 32315
2026-04-25 12:17:13,530 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/info.json
2026-04-25 12:17:13,530 main:
2026-04-25 13:17:14,779 run_check: Starting centroid dashboard continuity check
2026-04-25 13:17:14,779 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-25 13:17:14,780 collect_observations: Processing year 2020
2026-04-25 13:17:16,564 collect_observations: Processing year 2021
2026-04-25 13:17:19,191 collect_observations: Processing year 2022
2026-04-25 13:17:22,216 collect_observations: Processing year 2023
2026-04-25 13:17:25,120 collect_observations: Processing year 2024
2026-04-25 13:17:28,026 collect_observations: Processing year 2025
2026-04-25 13:17:31,028 collect_observations: Processing year 2026
2026-04-25 13:17:31,803 collect_observations: Collected 13762 observations from 4-digit years
2026-04-25 13:17:31,807 sort_observations_by_date: Sorted observations by date
2026-04-25 13:17:31,807 check_continuity: Starting continuity check from most recent: ObsID 32315 (APR2026A) at 2026:115:14:14:24.469
2026-04-25 13:17:31,823 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-25 13:17:31,823 check_continuity: Chain complete: visited 13762 observations out of 13762 total
2026-04-25 13:17:31,824 run_check: ✓ Observation chain continuity check PASSED
2026-04-25 13:17:31,824 run_check: Summary: 13762 observations from 4-digit years, all properly linked