Prev
Index
Next
centroid_dashboard: Sun Apr 26 13:20:27 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Sun Apr 26 13:20:27 2026 |
No errors
File contents:
2026-04-26 13:16:13,411 main: Processing from 2026:109:17:16:13.411 to 2026:116:17:16:13.411
2026-04-26 13:16:20,379 get_observations: Found observation 32292 at 2026:109:18:57:04.754 with 1 manvrs
2026-04-26 13:16:20,379 get_observations: Found observation 32298 at 2026:109:22:16:52.381 with 1 manvrs
2026-04-26 13:16:20,380 get_observations: Found observation 32306 at 2026:110:01:59:58.200 with 1 manvrs
2026-04-26 13:16:20,380 get_observations: Found observation 31419 at 2026:110:03:48:20.813 with 1 manvrs
2026-04-26 13:16:20,381 get_observations: Found observation 29878 at 2026:110:09:56:55.239 with 1 manvrs
2026-04-26 13:16:20,381 get_observations: Found observation 29880 at 2026:110:14:57:12.397 with 1 manvrs
2026-04-26 13:16:20,382 get_observations: Found observation 41541 at 2026:110:21:54:48.530 with 1 manvrs
2026-04-26 13:16:20,382 get_observations: Found observation 41540 at 2026:110:23:26:21.224 with 1 manvrs
2026-04-26 13:16:20,383 get_observations: Found observation 41539 at 2026:111:02:55:40.252 with 1 manvrs
2026-04-26 13:16:20,383 get_observations: Found observation 41538 at 2026:111:06:10:40.252 with 1 manvrs
2026-04-26 13:16:20,383 get_observations: Found observation 41537 at 2026:111:07:15:19.088 with 1 manvrs
2026-04-26 13:16:20,384 get_observations: Found observation 31864 at 2026:111:08:27:40.800 with 1 manvrs
2026-04-26 13:16:20,384 get_observations: Found observation 30180 at 2026:111:13:00:22.836 with 1 manvrs
2026-04-26 13:16:20,385 get_observations: Found observation 30026 at 2026:111:16:58:43.849 with 1 manvrs
2026-04-26 13:16:20,385 get_observations: Found observation 29863 at 2026:111:23:05:39.794 with 1 manvrs
2026-04-26 13:16:20,386 get_observations: Found observation 32311 at 2026:112:12:54:20.449 with 1 manvrs
2026-04-26 13:16:20,386 get_observations: Found observation 32309 at 2026:112:19:51:48.037 with 1 manvrs
2026-04-26 13:16:20,387 get_observations: Found observation 31516 at 2026:113:00:40:53.146 with 1 manvrs
2026-04-26 13:16:20,387 get_observations: Found observation 32310 at 2026:113:05:13:20.917 with 1 manvrs
2026-04-26 13:16:20,388 get_observations: Found observation 31399 at 2026:113:08:30:22.198 with 1 manvrs
2026-04-26 13:16:20,388 get_observations: Found observation 41536 at 2026:113:11:56:08.483 with 1 manvrs
2026-04-26 13:16:20,389 get_observations: Found observation 41535 at 2026:113:12:59:34.314 with 1 manvrs
2026-04-26 13:16:20,389 get_observations: Found observation 41534 at 2026:113:17:55:40.252 with 1 manvrs
2026-04-26 13:16:20,390 get_observations: Found observation 41533 at 2026:113:21:54:40.252 with 1 manvrs
2026-04-26 13:16:20,390 get_observations: Found observation 32312 at 2026:113:23:35:50.205 with 1 manvrs
2026-04-26 13:16:20,391 get_observations: Found observation 30024 at 2026:114:05:27:29.527 with 1 manvrs
2026-04-26 13:16:20,391 get_observations: Found observation 32313 at 2026:114:09:39:12.814 with 1 manvrs
2026-04-26 13:16:20,391 get_observations: Found observation 31734 at 2026:114:15:17:19.167 with 1 manvrs
2026-04-26 13:16:20,392 get_observations: Found observation 32307 at 2026:115:02:41:28.729 with 1 manvrs
2026-04-26 13:16:20,392 get_observations: Found observation 32314 at 2026:115:06:06:59.496 with 1 manvrs
2026-04-26 13:16:20,393 get_observations: Found observation 31083 at 2026:115:09:26:38.721 with 1 manvrs
2026-04-26 13:16:20,393 get_observations: Found observation 32315 at 2026:115:14:42:57.679 with 1 manvrs
2026-04-26 13:16:20,394 get_observations: Found observation 29530 at 2026:115:17:58:03.618 with 1 manvrs
2026-04-26 13:16:20,394 get_observations: Found observation 29867 at 2026:115:19:25:52.373 with 1 manvrs
2026-04-26 13:16:20,395 get_observations: Found observation 41532 at 2026:116:03:09:33.391 with 1 manvrs
2026-04-26 13:16:20,395 get_observations: Found observation 41531 at 2026:116:06:55:40.252 with 1 manvrs
2026-04-26 13:16:20,396 get_observations: Found observation 41530 at 2026:116:10:25:40.252 with 1 manvrs
2026-04-26 13:16:20,396 get_observations: Found observation 41529 at 2026:116:12:55:40.252 with 1 manvrs
2026-04-26 13:16:20,396 get_observations: Found observation 32308 at 2026:116:15:53:31.989 with 1 manvrs
2026-04-26 13:16:20,397 main: Found 39 observations
2026-04-26 13:16:20,397 main: ********************************************************************************
2026-04-26 13:16:20,397 main: Processing observation 32292
2026-04-26 13:16:20,397 main: ********************************************************************************
2026-04-26 13:16:20,401 obs_link_from_info: Found prev obsid 30257
2026-04-26 13:16:20,417 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,419 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-26 13:16:20,422 process_obs: ObsID 32292 already processed, skipping
2026-04-26 13:16:20,422 main:
2026-04-26 13:16:20,422 main: ********************************************************************************
2026-04-26 13:16:20,422 main: Processing observation 32298
2026-04-26 13:16:20,422 main: ********************************************************************************
2026-04-26 13:16:20,423 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,424 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-26 13:16:20,446 process_obs: ObsID 32298 already processed, skipping
2026-04-26 13:16:20,446 main:
2026-04-26 13:16:20,446 main: ********************************************************************************
2026-04-26 13:16:20,446 main: Processing observation 32306
2026-04-26 13:16:20,446 main: ********************************************************************************
2026-04-26 13:16:20,447 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,448 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,464 process_obs: ObsID 32306 already processed, skipping
2026-04-26 13:16:20,464 main:
2026-04-26 13:16:20,464 main: ********************************************************************************
2026-04-26 13:16:20,464 main: Processing observation 31419
2026-04-26 13:16:20,464 main: ********************************************************************************
2026-04-26 13:16:20,465 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,466 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,476 process_obs: ObsID 31419 already processed, skipping
2026-04-26 13:16:20,476 main:
2026-04-26 13:16:20,476 main: ********************************************************************************
2026-04-26 13:16:20,476 main: Processing observation 29878
2026-04-26 13:16:20,476 main: ********************************************************************************
2026-04-26 13:16:20,477 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,478 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,498 process_obs: ObsID 29878 already processed, skipping
2026-04-26 13:16:20,498 main:
2026-04-26 13:16:20,498 main: ********************************************************************************
2026-04-26 13:16:20,498 main: Processing observation 29880
2026-04-26 13:16:20,498 main: ********************************************************************************
2026-04-26 13:16:20,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,504 process_obs: ObsID 29880 already processed, skipping
2026-04-26 13:16:20,504 main:
2026-04-26 13:16:20,504 main: ********************************************************************************
2026-04-26 13:16:20,504 main: Processing observation 41541
2026-04-26 13:16:20,504 main: ********************************************************************************
2026-04-26 13:16:20,505 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,506 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,509 process_obs: ObsID 41541 already processed, skipping
2026-04-26 13:16:20,509 main:
2026-04-26 13:16:20,509 main: ********************************************************************************
2026-04-26 13:16:20,510 main: Processing observation 41540
2026-04-26 13:16:20,510 main: ********************************************************************************
2026-04-26 13:16:20,510 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,511 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,515 process_obs: ObsID 41540 already processed, skipping
2026-04-26 13:16:20,515 main:
2026-04-26 13:16:20,515 main: ********************************************************************************
2026-04-26 13:16:20,515 main: Processing observation 41539
2026-04-26 13:16:20,515 main: ********************************************************************************
2026-04-26 13:16:20,516 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,517 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,520 process_obs: ObsID 41539 already processed, skipping
2026-04-26 13:16:20,520 main:
2026-04-26 13:16:20,520 main: ********************************************************************************
2026-04-26 13:16:20,520 main: Processing observation 41538
2026-04-26 13:16:20,520 main: ********************************************************************************
2026-04-26 13:16:20,521 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,522 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,525 process_obs: ObsID 41538 already processed, skipping
2026-04-26 13:16:20,526 main:
2026-04-26 13:16:20,526 main: ********************************************************************************
2026-04-26 13:16:20,526 main: Processing observation 41537
2026-04-26 13:16:20,526 main: ********************************************************************************
2026-04-26 13:16:20,526 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,528 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,531 process_obs: ObsID 41537 already processed, skipping
2026-04-26 13:16:20,531 main:
2026-04-26 13:16:20,531 main: ********************************************************************************
2026-04-26 13:16:20,531 main: Processing observation 31864
2026-04-26 13:16:20,531 main: ********************************************************************************
2026-04-26 13:16:20,532 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,533 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,536 process_obs: ObsID 31864 already processed, skipping
2026-04-26 13:16:20,536 main:
2026-04-26 13:16:20,536 main: ********************************************************************************
2026-04-26 13:16:20,537 main: Processing observation 30180
2026-04-26 13:16:20,537 main: ********************************************************************************
2026-04-26 13:16:20,537 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,538 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 13:16:20,542 process_obs: ObsID 30180 already processed, skipping
2026-04-26 13:16:20,542 main:
2026-04-26 13:16:20,542 main: ********************************************************************************
2026-04-26 13:16:20,542 main: Processing observation 30026
2026-04-26 13:16:20,542 main: ********************************************************************************
2026-04-26 13:16:20,543 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 13:16:20,544 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:23,761 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/centroid_resids.pkl
2026-04-26 12:16:23,768 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-26 12:16:23,768 plot_crs_time: Plot file exists, skipping
2026-04-26 12:16:23,769 plot_crs_scatter: Plot file exists, skipping
2026-04-26 12:16:24,013 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-26 12:16:24,799 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/n_kalman_delta_roll.png
2026-04-26 12:16:34,676 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/index.html
2026-04-26 12:16:34,678 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/info.json
2026-04-26 12:16:34,680 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30026/index.html
2026-04-26 12:16:34,681 main:
2026-04-26 12:16:34,681 main: ********************************************************************************
2026-04-26 12:16:34,681 main: Processing observation 29863
2026-04-26 12:16:34,681 main: ********************************************************************************
2026-04-26 12:16:34,682 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,683 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,687 process_obs: ObsID 29863 already processed, skipping
2026-04-26 12:16:34,687 main:
2026-04-26 12:16:34,687 main: ********************************************************************************
2026-04-26 12:16:34,688 main: Processing observation 32311
2026-04-26 12:16:34,688 main: ********************************************************************************
2026-04-26 12:16:34,688 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,689 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,693 process_obs: ObsID 32311 already processed, skipping
2026-04-26 12:16:34,693 main:
2026-04-26 12:16:34,693 main: ********************************************************************************
2026-04-26 12:16:34,693 main: Processing observation 32309
2026-04-26 12:16:34,693 main: ********************************************************************************
2026-04-26 12:16:34,694 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,695 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,698 process_obs: ObsID 32309 already processed, skipping
2026-04-26 12:16:34,698 main:
2026-04-26 12:16:34,698 main: ********************************************************************************
2026-04-26 12:16:34,698 main: Processing observation 31516
2026-04-26 12:16:34,698 main: ********************************************************************************
2026-04-26 12:16:34,699 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,700 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,704 process_obs: ObsID 31516 already processed, skipping
2026-04-26 12:16:34,704 main:
2026-04-26 12:16:34,704 main: ********************************************************************************
2026-04-26 12:16:34,704 main: Processing observation 32310
2026-04-26 12:16:34,704 main: ********************************************************************************
2026-04-26 12:16:34,705 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,706 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,709 process_obs: ObsID 32310 already processed, skipping
2026-04-26 12:16:34,709 main:
2026-04-26 12:16:34,709 main: ********************************************************************************
2026-04-26 12:16:34,709 main: Processing observation 31399
2026-04-26 12:16:34,709 main: ********************************************************************************
2026-04-26 12:16:34,710 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,711 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,724 process_obs: ObsID 31399 already processed, skipping
2026-04-26 12:16:34,724 main:
2026-04-26 12:16:34,724 main: ********************************************************************************
2026-04-26 12:16:34,724 main: Processing observation 41536
2026-04-26 12:16:34,724 main: ********************************************************************************
2026-04-26 12:16:34,725 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,726 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,729 process_obs: ObsID 41536 already processed, skipping
2026-04-26 12:16:34,729 main:
2026-04-26 12:16:34,729 main: ********************************************************************************
2026-04-26 12:16:34,729 main: Processing observation 41535
2026-04-26 12:16:34,729 main: ********************************************************************************
2026-04-26 12:16:34,730 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,731 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,735 process_obs: ObsID 41535 already processed, skipping
2026-04-26 12:16:34,735 main:
2026-04-26 12:16:34,735 main: ********************************************************************************
2026-04-26 12:16:34,735 main: Processing observation 41534
2026-04-26 12:16:34,735 main: ********************************************************************************
2026-04-26 12:16:34,736 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,737 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,740 process_obs: ObsID 41534 already processed, skipping
2026-04-26 12:16:34,740 main:
2026-04-26 12:16:34,740 main: ********************************************************************************
2026-04-26 12:16:34,740 main: Processing observation 41533
2026-04-26 12:16:34,740 main: ********************************************************************************
2026-04-26 12:16:34,741 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,742 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,745 process_obs: ObsID 41533 already processed, skipping
2026-04-26 12:16:34,745 main:
2026-04-26 12:16:34,745 main: ********************************************************************************
2026-04-26 12:16:34,745 main: Processing observation 32312
2026-04-26 12:16:34,745 main: ********************************************************************************
2026-04-26 12:16:34,746 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,747 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,760 process_obs: ObsID 32312 already processed, skipping
2026-04-26 12:16:34,760 main:
2026-04-26 12:16:34,760 main: ********************************************************************************
2026-04-26 12:16:34,760 main: Processing observation 30024
2026-04-26 12:16:34,760 main: ********************************************************************************
2026-04-26 12:16:34,761 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,762 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,778 process_obs: ObsID 30024 already processed, skipping
2026-04-26 12:16:34,778 main:
2026-04-26 12:16:34,778 main: ********************************************************************************
2026-04-26 12:16:34,778 main: Processing observation 32313
2026-04-26 12:16:34,778 main: ********************************************************************************
2026-04-26 12:16:34,779 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,780 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:34,794 process_obs: ObsID 32313 already processed, skipping
2026-04-26 12:16:34,794 main:
2026-04-26 12:16:34,794 main: ********************************************************************************
2026-04-26 12:16:34,795 main: Processing observation 31734
2026-04-26 12:16:34,795 main: ********************************************************************************
2026-04-26 12:16:34,795 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:34,796 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:39,218 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/centroid_resids.pkl
2026-04-26 12:16:39,254 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-26 12:16:39,254 plot_crs_time: Plot file exists, skipping
2026-04-26 12:16:39,254 plot_crs_scatter: Plot file exists, skipping
2026-04-26 12:16:39,328 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-26 12:16:39,440 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/n_kalman_delta_roll.png
2026-04-26 12:16:46,138 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/index.html
2026-04-26 12:16:46,144 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31734/info.json
2026-04-26 12:16:46,175 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31734/index.html
2026-04-26 12:16:46,179 main:
2026-04-26 12:16:46,179 main: ********************************************************************************
2026-04-26 12:16:46,179 main: Processing observation 32307
2026-04-26 12:16:46,179 main: ********************************************************************************
2026-04-26 12:16:46,183 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:46,187 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:49,966 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-26 12:16:50,286 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/centroid_resids.pkl with 5 slots
2026-04-26 12:16:50,331 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/centroid_resids_time.png
2026-04-26 12:16:50,646 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/centroid_resids_scatter.png
2026-04-26 12:16:51,461 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/n_kalman_delta_roll.png
2026-04-26 12:16:51,602 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/index.html
2026-04-26 12:16:51,603 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32307/info.json
2026-04-26 12:16:51,606 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32307/index.html
2026-04-26 12:16:51,607 main:
2026-04-26 12:16:51,607 main: ********************************************************************************
2026-04-26 12:16:51,607 main: Processing observation 32314
2026-04-26 12:16:51,607 main: ********************************************************************************
2026-04-26 12:16:51,608 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:51,609 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:53,737 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-26 12:16:54,321 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/centroid_resids.pkl with 5 slots
2026-04-26 12:16:54,367 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/centroid_resids_time.png
2026-04-26 12:16:54,788 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/centroid_resids_scatter.png
2026-04-26 12:16:55,562 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/n_kalman_delta_roll.png
2026-04-26 12:16:55,702 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/index.html
2026-04-26 12:16:55,703 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32314/info.json
2026-04-26 12:16:55,706 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32314/index.html
2026-04-26 12:16:55,706 main:
2026-04-26 12:16:55,707 main: ********************************************************************************
2026-04-26 12:16:55,707 main: Processing observation 31083
2026-04-26 12:16:55,707 main: ********************************************************************************
2026-04-26 12:16:55,708 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:55,709 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:16:57,878 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-26 12:16:58,431 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/centroid_resids.pkl with 5 slots
2026-04-26 12:16:58,480 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/centroid_resids_time.png
2026-04-26 12:16:58,818 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/centroid_resids_scatter.png
2026-04-26 12:16:58,979 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-26 12:16:59,093 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/n_kalman_delta_roll.png
2026-04-26 12:16:59,210 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/index.html
2026-04-26 12:16:59,211 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31083/info.json
2026-04-26 12:16:59,214 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31083/index.html
2026-04-26 12:16:59,215 main:
2026-04-26 12:16:59,215 main: ********************************************************************************
2026-04-26 12:16:59,215 main: Processing observation 32315
2026-04-26 12:16:59,215 main: ********************************************************************************
2026-04-26 12:16:59,216 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:16:59,217 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:01,456 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-26 12:17:01,775 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/centroid_resids.pkl with 5 slots
2026-04-26 12:17:01,829 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/centroid_resids_time.png
2026-04-26 12:17:02,098 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/centroid_resids_scatter.png
2026-04-26 12:17:02,276 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-26 12:17:02,419 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/n_kalman_delta_roll.png
2026-04-26 12:17:02,566 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/index.html
2026-04-26 12:17:02,568 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32315/info.json
2026-04-26 12:17:02,571 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32315/index.html
2026-04-26 12:17:02,572 main:
2026-04-26 12:17:02,573 main: ********************************************************************************
2026-04-26 12:17:02,573 main: Processing observation 29530
2026-04-26 12:17:02,573 main: ********************************************************************************
2026-04-26 12:17:02,586 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:17:02,587 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:05,028 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-26 12:17:05,426 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/centroid_resids.pkl with 5 slots
2026-04-26 12:17:05,475 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/centroid_resids_time.png
2026-04-26 12:17:05,721 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/centroid_resids_scatter.png
2026-04-26 12:17:05,916 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-26 12:17:06,084 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/n_kalman_delta_roll.png
2026-04-26 12:17:06,302 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/index.html
2026-04-26 12:17:06,313 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29530/info.json
2026-04-26 12:17:06,338 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29530/index.html
2026-04-26 12:17:06,346 main:
2026-04-26 12:17:06,346 main: ********************************************************************************
2026-04-26 12:17:06,346 main: Processing observation 29867
2026-04-26 12:17:06,346 main: ********************************************************************************
2026-04-26 12:17:06,358 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:17:06,374 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:10,756 __init__: ObsID 29867 has insufficient telemetry, skipping
2026-04-26 12:17:10,757 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29867/index.html
2026-04-26 12:17:10,762 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29867/info.json
2026-04-26 12:17:10,763 main:
2026-04-26 12:17:10,763 main: ********************************************************************************
2026-04-26 12:17:10,763 main: Processing observation 41532
2026-04-26 12:17:10,763 main: ********************************************************************************
2026-04-26 12:17:10,764 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:17:10,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:12,805 __init__: ObsID 41532 has insufficient telemetry, skipping
2026-04-26 12:17:12,806 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41532/index.html
2026-04-26 12:17:12,810 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41532/info.json
2026-04-26 12:17:12,811 main:
2026-04-26 12:17:12,811 main: ********************************************************************************
2026-04-26 12:17:12,811 main: Processing observation 41531
2026-04-26 12:17:12,811 main: ********************************************************************************
2026-04-26 12:17:12,812 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:17:12,813 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:14,900 __init__: ObsID 41531 has insufficient telemetry, skipping
2026-04-26 12:17:14,901 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41531/index.html
2026-04-26 12:17:14,905 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41531/info.json
2026-04-26 12:17:14,906 main:
2026-04-26 12:17:14,906 main: ********************************************************************************
2026-04-26 12:17:14,906 main: Processing observation 41530
2026-04-26 12:17:14,906 main: ********************************************************************************
2026-04-26 12:17:14,907 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:17:14,908 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:16,989 __init__: ObsID 41530 has insufficient telemetry, skipping
2026-04-26 12:17:16,990 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41530/index.html
2026-04-26 12:17:16,994 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41530/info.json
2026-04-26 12:17:16,995 main:
2026-04-26 12:17:16,995 main: ********************************************************************************
2026-04-26 12:17:16,995 main: Processing observation 41529
2026-04-26 12:17:16,995 main: ********************************************************************************
2026-04-26 12:17:16,996 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:17:16,997 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:19,071 __init__: ObsID 41529 has no maneuver event in telemetry, skipping
2026-04-26 12:17:19,071 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41529/index.html
2026-04-26 12:17:19,075 info: could not get attribute kalman_start for obsid 41529
2026-04-26 12:17:19,075 info: could not get attribute kalman_stop for obsid 41529
2026-04-26 12:17:19,076 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41529/info.json
2026-04-26 12:17:19,076 main:
2026-04-26 12:17:19,076 main: ********************************************************************************
2026-04-26 12:17:19,076 main: Processing observation 32308
2026-04-26 12:17:19,076 main: ********************************************************************************
2026-04-26 12:17:19,077 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32308/info.json file found, obs=None
2026-04-26 12:17:19,078 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-26 12:17:19,079 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-26 12:17:21,145 __init__: ObsID 32308 has no maneuver event in telemetry, skipping
2026-04-26 12:17:21,145 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32308/index.html
2026-04-26 12:17:21,150 info: could not get attribute kalman_start for obsid 32308
2026-04-26 12:17:21,150 info: could not get attribute kalman_stop for obsid 32308
2026-04-26 12:17:21,150 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32308/info.json
2026-04-26 12:17:21,150 main:
2026-04-26 13:17:22,461 run_check: Starting centroid dashboard continuity check
2026-04-26 13:17:22,461 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-26 13:17:22,471 collect_observations: Processing year 2020
2026-04-26 13:17:42,462 collect_observations: Processing year 2021
2026-04-26 13:18:11,252 collect_observations: Processing year 2022
2026-04-26 13:18:42,172 collect_observations: Processing year 2023
2026-04-26 13:19:16,344 collect_observations: Processing year 2024
2026-04-26 13:19:47,996 collect_observations: Processing year 2025
2026-04-26 13:20:20,022 collect_observations: Processing year 2026
2026-04-26 13:20:27,748 collect_observations: Collected 13769 observations from 4-digit years
2026-04-26 13:20:27,752 sort_observations_by_date: Sorted observations by date
2026-04-26 13:20:27,752 check_continuity: Starting continuity check from most recent: ObsID 32308 (APR2026A) at 2026:116:15:33:09.748
2026-04-26 13:20:27,770 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-26 13:20:27,770 check_continuity: Chain complete: visited 13769 observations out of 13769 total
2026-04-26 13:20:27,771 run_check: ✓ Observation chain continuity check PASSED
2026-04-26 13:20:27,771 run_check: Summary: 13769 observations from 4-digit years, all properly linked