Prev   Index   Next

centroid_dashboard: Wed Apr 22 13:19:57 2026

File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log

Task Status AgeMaxAge Last Date
centroid_dashboard OK 0.891.0 Wed Apr 22 13:19:57 2026

No errors

File contents:

2026-04-22 13:16:09,733 main: Processing from 2026:105:17:16:09.732 to 2026:112:17:16:09.732
2026-04-22 13:16:17,399 get_observations: Found observation 41550 at 2026:105:19:55:40.252 with 1 manvrs
2026-04-22 13:16:17,399 get_observations: Found observation 41549 at 2026:105:22:55:40.252 with 1 manvrs
2026-04-22 13:16:17,399 get_observations: Found observation 32303 at 2026:106:00:58:53.771 with 1 manvrs
2026-04-22 13:16:17,400 get_observations: Found observation 31420 at 2026:106:05:22:23.241 with 2 manvrs
2026-04-22 13:16:17,400 get_observations: Found observation 32304 at 2026:106:11:55:21.883 with 2 manvrs
2026-04-22 13:16:17,401 get_observations: Found observation 41546 at 2026:106:15:43:54.727 with 1 manvrs
2026-04-22 13:16:17,401 get_observations: Found observation 32293 at 2026:106:16:45:04.825 with 1 manvrs
2026-04-22 13:16:17,402 get_observations: Found observation 31223 at 2026:106:20:31:47.176 with 1 manvrs
2026-04-22 13:16:17,402 get_observations: Found observation 30543 at 2026:107:04:28:04.145 with 2 manvrs
2026-04-22 13:16:17,402 get_observations: Found observation 32294 at 2026:107:07:36:27.788 with 2 manvrs
2026-04-22 13:16:17,403 get_observations: Found observation 32300 at 2026:107:11:06:29.416 with 1 manvrs
2026-04-22 13:16:17,403 get_observations: Found observation 30250 at 2026:107:18:48:03.219 with 1 manvrs
2026-04-22 13:16:17,404 get_observations: Found observation 32297 at 2026:108:03:34:44.225 with 1 manvrs
2026-04-22 13:16:17,404 get_observations: Found observation 41543 at 2026:108:07:10:50.673 with 1 manvrs
2026-04-22 13:16:17,404 get_observations: Found observation 41542 at 2026:108:12:15:40.252 with 1 manvrs
2026-04-22 13:16:17,405 get_observations: Found observation 32305 at 2026:108:16:42:24.683 with 1 manvrs
2026-04-22 13:16:17,405 get_observations: Found observation 32296 at 2026:108:20:29:14.657 with 1 manvrs
2026-04-22 13:16:17,406 get_observations: Found observation 30259 at 2026:108:23:50:37.957 with 1 manvrs
2026-04-22 13:16:17,406 get_observations: Found observation 32299 at 2026:109:07:51:18.236 with 1 manvrs
2026-04-22 13:16:17,407 get_observations: Found observation 30257 at 2026:109:10:38:41.619 with 1 manvrs
2026-04-22 13:16:17,407 get_observations: Found observation 32292 at 2026:109:18:57:04.754 with 1 manvrs
2026-04-22 13:16:17,408 get_observations: Found observation 32298 at 2026:109:22:16:52.381 with 1 manvrs
2026-04-22 13:16:17,408 get_observations: Found observation 32306 at 2026:110:01:59:58.200 with 1 manvrs
2026-04-22 13:16:17,408 get_observations: Found observation 31419 at 2026:110:03:48:20.813 with 1 manvrs
2026-04-22 13:16:17,409 get_observations: Found observation 29878 at 2026:110:09:56:55.239 with 1 manvrs
2026-04-22 13:16:17,409 get_observations: Found observation 29880 at 2026:110:14:57:12.397 with 1 manvrs
2026-04-22 13:16:17,410 get_observations: Found observation 41541 at 2026:110:21:54:48.530 with 1 manvrs
2026-04-22 13:16:17,410 get_observations: Found observation 41540 at 2026:110:23:26:21.224 with 1 manvrs
2026-04-22 13:16:17,410 get_observations: Found observation 41539 at 2026:111:02:55:40.252 with 1 manvrs
2026-04-22 13:16:17,411 get_observations: Found observation 41538 at 2026:111:06:10:40.252 with 1 manvrs
2026-04-22 13:16:17,411 get_observations: Found observation 41537 at 2026:111:07:15:19.088 with 1 manvrs
2026-04-22 13:16:17,412 get_observations: Found observation 31864 at 2026:111:08:27:40.800 with 1 manvrs
2026-04-22 13:16:17,412 get_observations: Found observation 30180 at 2026:111:13:00:22.836 with 1 manvrs
2026-04-22 13:16:17,413 get_observations: Found observation 30026 at 2026:111:16:58:43.849 with 1 manvrs
2026-04-22 13:16:17,413 get_observations: Found observation 29863 at 2026:111:23:05:39.794 with 1 manvrs
2026-04-22 13:16:17,413 get_observations: Found observation 32311 at 2026:112:12:54:20.449 with 1 manvrs
2026-04-22 13:16:17,414 main: Found 36 observations
2026-04-22 13:16:17,414 main: ********************************************************************************
2026-04-22 13:16:17,414 main: Processing observation 41550
2026-04-22 13:16:17,414 main: ********************************************************************************
2026-04-22 13:16:17,417 obs_link_from_info: Found prev obsid 41551
2026-04-22 13:16:17,431 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,432 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,435 process_obs: ObsID 41550 already processed, skipping
2026-04-22 13:16:17,435 main:
2026-04-22 13:16:17,435 main: ********************************************************************************
2026-04-22 13:16:17,435 main: Processing observation 41549
2026-04-22 13:16:17,435 main: ********************************************************************************
2026-04-22 13:16:17,436 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,437 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,440 process_obs: ObsID 41549 already processed, skipping
2026-04-22 13:16:17,441 main:
2026-04-22 13:16:17,441 main: ********************************************************************************
2026-04-22 13:16:17,441 main: Processing observation 32303
2026-04-22 13:16:17,441 main: ********************************************************************************
2026-04-22 13:16:17,442 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,443 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,446 process_obs: ObsID 32303 already processed, skipping
2026-04-22 13:16:17,446 main:
2026-04-22 13:16:17,446 main: ********************************************************************************
2026-04-22 13:16:17,446 main: Processing observation 31420
2026-04-22 13:16:17,446 main: ********************************************************************************
2026-04-22 13:16:17,447 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,448 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,451 process_obs: ObsID 31420 already processed, skipping
2026-04-22 13:16:17,451 main:
2026-04-22 13:16:17,451 main: ********************************************************************************
2026-04-22 13:16:17,451 main: Processing observation 32304
2026-04-22 13:16:17,451 main: ********************************************************************************
2026-04-22 13:16:17,452 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,453 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,457 process_obs: ObsID 32304 already processed, skipping
2026-04-22 13:16:17,457 main:
2026-04-22 13:16:17,457 main: ********************************************************************************
2026-04-22 13:16:17,457 main: Processing observation 41546
2026-04-22 13:16:17,457 main: ********************************************************************************
2026-04-22 13:16:17,458 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,459 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,462 process_obs: ObsID 41546 already processed, skipping
2026-04-22 13:16:17,462 main:
2026-04-22 13:16:17,462 main: ********************************************************************************
2026-04-22 13:16:17,462 main: Processing observation 32293
2026-04-22 13:16:17,462 main: ********************************************************************************
2026-04-22 13:16:17,463 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,464 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,466 process_obs: ObsID 32293 already processed, skipping
2026-04-22 13:16:17,466 main:
2026-04-22 13:16:17,467 main: ********************************************************************************
2026-04-22 13:16:17,467 main: Processing observation 31223
2026-04-22 13:16:17,467 main: ********************************************************************************
2026-04-22 13:16:17,467 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,468 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,471 process_obs: ObsID 31223 already processed, skipping
2026-04-22 13:16:17,472 main:
2026-04-22 13:16:17,472 main: ********************************************************************************
2026-04-22 13:16:17,472 main: Processing observation 30543
2026-04-22 13:16:17,472 main: ********************************************************************************
2026-04-22 13:16:17,472 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,473 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,477 process_obs: ObsID 30543 already processed, skipping
2026-04-22 13:16:17,477 main:
2026-04-22 13:16:17,477 main: ********************************************************************************
2026-04-22 13:16:17,477 main: Processing observation 32294
2026-04-22 13:16:17,477 main: ********************************************************************************
2026-04-22 13:16:17,478 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,479 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,482 process_obs: ObsID 32294 already processed, skipping
2026-04-22 13:16:17,482 main:
2026-04-22 13:16:17,482 main: ********************************************************************************
2026-04-22 13:16:17,482 main: Processing observation 32300
2026-04-22 13:16:17,482 main: ********************************************************************************
2026-04-22 13:16:17,483 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,484 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,487 process_obs: ObsID 32300 already processed, skipping
2026-04-22 13:16:17,487 main:
2026-04-22 13:16:17,487 main: ********************************************************************************
2026-04-22 13:16:17,487 main: Processing observation 30250
2026-04-22 13:16:17,487 main: ********************************************************************************
2026-04-22 13:16:17,488 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,489 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,492 process_obs: ObsID 30250 already processed, skipping
2026-04-22 13:16:17,492 main:
2026-04-22 13:16:17,492 main: ********************************************************************************
2026-04-22 13:16:17,492 main: Processing observation 32297
2026-04-22 13:16:17,492 main: ********************************************************************************
2026-04-22 13:16:17,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,494 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,497 process_obs: ObsID 32297 already processed, skipping
2026-04-22 13:16:17,497 main:
2026-04-22 13:16:17,497 main: ********************************************************************************
2026-04-22 13:16:17,497 main: Processing observation 41543
2026-04-22 13:16:17,497 main: ********************************************************************************
2026-04-22 13:16:17,498 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,502 process_obs: ObsID 41543 already processed, skipping
2026-04-22 13:16:17,502 main:
2026-04-22 13:16:17,502 main: ********************************************************************************
2026-04-22 13:16:17,502 main: Processing observation 41542
2026-04-22 13:16:17,502 main: ********************************************************************************
2026-04-22 13:16:17,503 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,504 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,507 process_obs: ObsID 41542 already processed, skipping
2026-04-22 13:16:17,507 main:
2026-04-22 13:16:17,507 main: ********************************************************************************
2026-04-22 13:16:17,507 main: Processing observation 32305
2026-04-22 13:16:17,507 main: ********************************************************************************
2026-04-22 13:16:17,508 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,509 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,512 process_obs: ObsID 32305 already processed, skipping
2026-04-22 13:16:17,512 main:
2026-04-22 13:16:17,512 main: ********************************************************************************
2026-04-22 13:16:17,512 main: Processing observation 32296
2026-04-22 13:16:17,512 main: ********************************************************************************
2026-04-22 13:16:17,513 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,514 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,517 process_obs: ObsID 32296 already processed, skipping
2026-04-22 13:16:17,517 main:
2026-04-22 13:16:17,517 main: ********************************************************************************
2026-04-22 13:16:17,517 main: Processing observation 30259
2026-04-22 13:16:17,517 main: ********************************************************************************
2026-04-22 13:16:17,518 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,519 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,522 process_obs: ObsID 30259 already processed, skipping
2026-04-22 13:16:17,522 main:
2026-04-22 13:16:17,522 main: ********************************************************************************
2026-04-22 13:16:17,522 main: Processing observation 32299
2026-04-22 13:16:17,522 main: ********************************************************************************
2026-04-22 13:16:17,523 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,524 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,527 process_obs: ObsID 32299 already processed, skipping
2026-04-22 13:16:17,527 main:
2026-04-22 13:16:17,527 main: ********************************************************************************
2026-04-22 13:16:17,527 main: Processing observation 30257
2026-04-22 13:16:17,527 main: ********************************************************************************
2026-04-22 13:16:17,528 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,529 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,533 process_obs: ObsID 30257 already processed, skipping
2026-04-22 13:16:17,533 main:
2026-04-22 13:16:17,533 main: ********************************************************************************
2026-04-22 13:16:17,533 main: Processing observation 32292
2026-04-22 13:16:17,533 main: ********************************************************************************
2026-04-22 13:16:17,534 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,535 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,538 process_obs: ObsID 32292 already processed, skipping
2026-04-22 13:16:17,538 main:
2026-04-22 13:16:17,538 main: ********************************************************************************
2026-04-22 13:16:17,538 main: Processing observation 32298
2026-04-22 13:16:17,538 main: ********************************************************************************
2026-04-22 13:16:17,539 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,540 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR1326A/last.html
2026-04-22 13:16:17,543 process_obs: ObsID 32298 already processed, skipping
2026-04-22 13:16:17,543 main:
2026-04-22 13:16:17,543 main: ********************************************************************************
2026-04-22 13:16:17,543 main: Processing observation 32306
2026-04-22 13:16:17,543 main: ********************************************************************************
2026-04-22 13:16:17,544 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,545 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 13:16:17,548 process_obs: ObsID 32306 already processed, skipping
2026-04-22 13:16:17,548 main:
2026-04-22 13:16:17,548 main: ********************************************************************************
2026-04-22 13:16:17,548 main: Processing observation 31419
2026-04-22 13:16:17,548 main: ********************************************************************************
2026-04-22 13:16:17,549 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,550 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 13:16:17,553 process_obs: ObsID 31419 already processed, skipping
2026-04-22 13:16:17,554 main:
2026-04-22 13:16:17,554 main: ********************************************************************************
2026-04-22 13:16:17,554 main: Processing observation 29878
2026-04-22 13:16:17,554 main: ********************************************************************************
2026-04-22 13:16:17,554 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,556 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 13:16:17,559 process_obs: ObsID 29878 already processed, skipping
2026-04-22 13:16:17,559 main:
2026-04-22 13:16:17,559 main: ********************************************************************************
2026-04-22 13:16:17,559 main: Processing observation 29880
2026-04-22 13:16:17,559 main: ********************************************************************************
2026-04-22 13:16:17,560 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 13:16:17,561 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:20,100 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:20,504 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29880/centroid_resids.pkl with 5 slots
2026-04-22 12:16:20,561 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29880/centroid_resids_time.png
2026-04-22 12:16:21,078 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29880/centroid_resids_scatter.png
2026-04-22 12:16:22,389 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29880/n_kalman_delta_roll.png
2026-04-22 12:16:25,199 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29880/index.html
2026-04-22 12:16:25,201 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29880/info.json
2026-04-22 12:16:25,204 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29880/index.html
2026-04-22 12:16:25,205 main:
2026-04-22 12:16:25,205 main: ********************************************************************************
2026-04-22 12:16:25,205 main: Processing observation 41541
2026-04-22 12:16:25,205 main: ********************************************************************************
2026-04-22 12:16:25,206 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:25,207 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:27,355 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:28,135 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41541/centroid_resids.pkl with 7 slots
2026-04-22 12:16:28,194 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41541/centroid_resids_time.png
2026-04-22 12:16:28,511 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41541/centroid_resids_scatter.png
2026-04-22 12:16:28,875 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-22 12:16:29,047 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41541/n_kalman_delta_roll.png
2026-04-22 12:16:29,226 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41541/index.html
2026-04-22 12:16:29,231 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41541/info.json
2026-04-22 12:16:29,253 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41541/index.html
2026-04-22 12:16:29,254 main:
2026-04-22 12:16:29,254 main: ********************************************************************************
2026-04-22 12:16:29,254 main: Processing observation 41540
2026-04-22 12:16:29,254 main: ********************************************************************************
2026-04-22 12:16:29,255 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:29,259 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:31,923 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:34,177 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41540/centroid_resids.pkl with 7 slots
2026-04-22 12:16:34,241 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41540/centroid_resids_time.png
2026-04-22 12:16:34,560 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41540/centroid_resids_scatter.png
2026-04-22 12:16:34,675 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-22 12:16:34,815 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41540/n_kalman_delta_roll.png
2026-04-22 12:16:34,953 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41540/index.html
2026-04-22 12:16:35,221 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41540/info.json
2026-04-22 12:16:35,224 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41540/index.html
2026-04-22 12:16:35,225 main:
2026-04-22 12:16:35,225 main: ********************************************************************************
2026-04-22 12:16:35,225 main: Processing observation 41539
2026-04-22 12:16:35,225 main: ********************************************************************************
2026-04-22 12:16:35,226 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:35,227 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:37,699 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:38,301 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41539/centroid_resids.pkl with 7 slots
2026-04-22 12:16:38,371 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41539/centroid_resids_time.png
2026-04-22 12:16:38,708 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41539/centroid_resids_scatter.png
2026-04-22 12:16:38,819 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-22 12:16:38,959 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41539/n_kalman_delta_roll.png
2026-04-22 12:16:39,242 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41539/index.html
2026-04-22 12:16:39,259 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41539/info.json
2026-04-22 12:16:39,275 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41539/index.html
2026-04-22 12:16:39,284 main:
2026-04-22 12:16:39,284 main: ********************************************************************************
2026-04-22 12:16:39,284 main: Processing observation 41538
2026-04-22 12:16:39,284 main: ********************************************************************************
2026-04-22 12:16:39,286 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:39,294 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:41,909 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:42,575 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41538/centroid_resids.pkl with 8 slots
2026-04-22 12:16:42,640 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41538/centroid_resids_time.png
2026-04-22 12:16:42,901 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41538/centroid_resids_scatter.png
2026-04-22 12:16:42,967 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-22 12:16:43,079 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41538/n_kalman_delta_roll.png
2026-04-22 12:16:43,210 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41538/index.html
2026-04-22 12:16:43,212 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41538/info.json
2026-04-22 12:16:43,214 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41538/index.html
2026-04-22 12:16:43,215 main:
2026-04-22 12:16:43,215 main: ********************************************************************************
2026-04-22 12:16:43,215 main: Processing observation 41537
2026-04-22 12:16:43,215 main: ********************************************************************************
2026-04-22 12:16:43,216 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:43,217 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:45,288 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:46,022 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41537/centroid_resids.pkl with 8 slots
2026-04-22 12:16:46,087 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41537/centroid_resids_time.png
2026-04-22 12:16:46,343 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41537/centroid_resids_scatter.png
2026-04-22 12:16:46,416 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-22 12:16:46,559 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41537/n_kalman_delta_roll.png
2026-04-22 12:16:46,702 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41537/index.html
2026-04-22 12:16:46,704 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/41537/info.json
2026-04-22 12:16:46,706 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41537/index.html
2026-04-22 12:16:46,707 main:
2026-04-22 12:16:46,707 main: ********************************************************************************
2026-04-22 12:16:46,707 main: Processing observation 31864
2026-04-22 12:16:46,707 main: ********************************************************************************
2026-04-22 12:16:46,708 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:46,709 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:48,832 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:49,663 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31864/centroid_resids.pkl with 5 slots
2026-04-22 12:16:49,715 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31864/centroid_resids_time.png
2026-04-22 12:16:49,971 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31864/centroid_resids_scatter.png
2026-04-22 12:16:50,933 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31864/n_kalman_delta_roll.png
2026-04-22 12:16:51,087 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31864/index.html
2026-04-22 12:16:51,089 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/31864/info.json
2026-04-22 12:16:51,103 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31864/index.html
2026-04-22 12:16:51,104 main:
2026-04-22 12:16:51,104 main: ********************************************************************************
2026-04-22 12:16:51,104 main: Processing observation 30180
2026-04-22 12:16:51,104 main: ********************************************************************************
2026-04-22 12:16:51,106 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:51,107 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:53,200 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:54,032 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30180/centroid_resids.pkl with 5 slots
2026-04-22 12:16:54,083 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30180/centroid_resids_time.png
2026-04-22 12:16:54,337 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30180/centroid_resids_scatter.png
2026-04-22 12:16:55,245 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30180/n_kalman_delta_roll.png
2026-04-22 12:16:55,396 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30180/index.html
2026-04-22 12:16:55,397 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30180/info.json
2026-04-22 12:16:55,430 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30180/index.html
2026-04-22 12:16:55,431 main:
2026-04-22 12:16:55,431 main: ********************************************************************************
2026-04-22 12:16:55,431 main: Processing observation 30026
2026-04-22 12:16:55,431 main: ********************************************************************************
2026-04-22 12:16:55,432 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:55,433 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:16:57,584 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-22 12:16:58,173 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/centroid_resids.pkl with 5 slots
2026-04-22 12:16:58,231 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/centroid_resids_time.png
2026-04-22 12:16:58,540 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/centroid_resids_scatter.png
2026-04-22 12:16:58,713 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-22 12:16:58,839 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/n_kalman_delta_roll.png
2026-04-22 12:16:58,960 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/index.html
2026-04-22 12:16:58,962 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/30026/info.json
2026-04-22 12:16:58,964 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30026/index.html
2026-04-22 12:16:58,965 main:
2026-04-22 12:16:58,965 main: ********************************************************************************
2026-04-22 12:16:58,965 main: Processing observation 29863
2026-04-22 12:16:58,965 main: ********************************************************************************
2026-04-22 12:16:58,966 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:16:58,967 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:17:01,195 __init__: ObsID 29863 has no maneuver event in telemetry, skipping
2026-04-22 12:17:01,196 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29863/index.html
2026-04-22 12:17:01,202 info: could not get attribute kalman_start for obsid 29863
2026-04-22 12:17:01,202 info: could not get attribute kalman_stop for obsid 29863
2026-04-22 12:17:01,202 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/29863/info.json
2026-04-22 12:17:01,203 main:
2026-04-22 12:17:01,203 main: ********************************************************************************
2026-04-22 12:17:01,203 main: Processing observation 32311
2026-04-22 12:17:01,203 main: ********************************************************************************
2026-04-22 12:17:01,204 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32311/info.json file found, obs=None
2026-04-22 12:17:01,206 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-22 12:17:01,208 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/last.html
2026-04-22 12:17:03,944 __init__: ObsID 32311 has no maneuver event in telemetry, skipping
2026-04-22 12:17:03,949 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32311/index.html
2026-04-22 12:17:03,957 info: could not get attribute kalman_start for obsid 32311
2026-04-22 12:17:03,957 info: could not get attribute kalman_stop for obsid 32311
2026-04-22 12:17:03,957 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2026A/32311/info.json
2026-04-22 12:17:03,964 main:
2026-04-22 13:17:05,535 run_check: Starting centroid dashboard continuity check
2026-04-22 13:17:05,535 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-22 13:17:05,546 collect_observations: Processing year 2020
2026-04-22 13:17:25,264 collect_observations: Processing year 2021
2026-04-22 13:17:51,240 collect_observations: Processing year 2022
2026-04-22 13:18:23,522 collect_observations: Processing year 2023
2026-04-22 13:18:54,115 collect_observations: Processing year 2024
2026-04-22 13:19:24,362 collect_observations: Processing year 2025
2026-04-22 13:19:49,829 collect_observations: Processing year 2026
2026-04-22 13:19:56,587 collect_observations: Collected 13746 observations from 4-digit years
2026-04-22 13:19:56,595 sort_observations_by_date: Sorted observations by date
2026-04-22 13:19:56,595 check_continuity: Starting continuity check from most recent: ObsID 32311 (APR2026A) at 2026:112:12:06:45.542
2026-04-22 13:19:56,616 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-22 13:19:56,616 check_continuity: Chain complete: visited 13746 observations out of 13746 total
2026-04-22 13:19:56,617 run_check: ✓ Observation chain continuity check PASSED
2026-04-22 13:19:56,617 run_check: Summary: 13746 observations from 4-digit years, all properly linked