Prev
Index
Next
centroid_dashboard: Fri Apr 10 13:20:07 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Fri Apr 10 13:20:07 2026 |
No errors
File contents:
2026-04-10 13:16:07,217 main: Processing from 2026:093:17:16:07.216 to 2026:100:17:16:07.216
2026-04-10 13:16:14,367 get_observations: Found observation 30341 at 2026:093:19:21:11.854 with 1 manvrs
2026-04-10 13:16:14,367 get_observations: Found observation 31446 at 2026:093:22:43:19.190 with 1 manvrs
2026-04-10 13:16:14,368 get_observations: Found observation 31082 at 2026:094:01:13:54.564 with 1 manvrs
2026-04-10 13:16:14,368 get_observations: Found observation 32274 at 2026:094:09:50:31.604 with 1 manvrs
2026-04-10 13:16:14,369 get_observations: Found observation 31437 at 2026:094:20:25:19.737 with 1 manvrs
2026-04-10 13:16:14,369 get_observations: Found observation 31260 at 2026:094:23:42:51.001 with 1 manvrs
2026-04-10 13:16:14,369 get_observations: Found observation 41573 at 2026:095:01:47:13.289 with 1 manvrs
2026-04-10 13:16:14,370 get_observations: Found observation 41572 at 2026:095:05:10:40.252 with 1 manvrs
2026-04-10 13:16:14,370 get_observations: Found observation 41571 at 2026:095:07:55:40.252 with 1 manvrs
2026-04-10 13:16:14,371 get_observations: Found observation 31382 at 2026:095:11:45:54.739 with 1 manvrs
2026-04-10 13:16:14,371 get_observations: Found observation 31383 at 2026:095:12:27:44.739 with 1 manvrs
2026-04-10 13:16:14,372 get_observations: Found observation 32260 at 2026:095:13:43:24.390 with 1 manvrs
2026-04-10 13:16:14,372 get_observations: Found observation 30343 at 2026:095:17:12:32.443 with 1 manvrs
2026-04-10 13:16:14,372 get_observations: Found observation 31105 at 2026:095:22:16:19.245 with 1 manvrs
2026-04-10 13:16:14,373 get_observations: Found observation 32134 at 2026:096:04:33:56.558 with 1 manvrs
2026-04-10 13:16:14,373 get_observations: Found observation 30423 at 2026:096:08:46:14.335 with 1 manvrs
2026-04-10 13:16:14,374 get_observations: Found observation 29658 at 2026:096:17:29:13.326 with 1 manvrs
2026-04-10 13:16:14,374 get_observations: Found observation 30487 at 2026:096:21:26:45.228 with 1 manvrs
2026-04-10 13:16:14,375 get_observations: Found observation 32278 at 2026:097:01:40:57.126 with 1 manvrs
2026-04-10 13:16:14,375 get_observations: Found observation 32286 at 2026:097:05:21:49.027 with 1 manvrs
2026-04-10 13:16:14,376 get_observations: Found observation 32279 at 2026:097:09:36:00.923 with 1 manvrs
2026-04-10 13:16:14,376 get_observations: Found observation 32287 at 2026:097:13:16:52.826 with 1 manvrs
2026-04-10 13:16:14,376 get_observations: Found observation 41570 at 2026:097:17:20:54.548 with 1 manvrs
2026-04-10 13:16:14,377 get_observations: Found observation 41569 at 2026:097:18:55:33.459 with 1 manvrs
2026-04-10 13:16:14,377 get_observations: Found observation 41568 at 2026:097:20:55:40.252 with 1 manvrs
2026-04-10 13:16:14,378 get_observations: Found observation 41567 at 2026:098:00:55:40.252 with 1 manvrs
2026-04-10 13:16:14,378 get_observations: Found observation 32288 at 2026:098:02:48:37.740 with 1 manvrs
2026-04-10 13:16:14,379 get_observations: Found observation 30152 at 2026:098:06:42:27.885 with 1 manvrs
2026-04-10 13:16:14,379 get_observations: Found observation 30103 at 2026:098:15:04:13.568 with 1 manvrs
2026-04-10 13:16:14,379 get_observations: Found observation 32277 at 2026:098:23:12:56.189 with 1 manvrs
2026-04-10 13:16:14,380 get_observations: Found observation 29666 at 2026:099:05:25:43.714 with 1 manvrs
2026-04-10 13:16:14,380 get_observations: Found observation 30539 at 2026:099:09:02:38.079 with 1 manvrs
2026-04-10 13:16:14,381 get_observations: Found observation 32281 at 2026:099:14:52:39.718 with 1 manvrs
2026-04-10 13:16:14,381 get_observations: Found observation 30540 at 2026:099:19:10:48.114 with 1 manvrs
2026-04-10 13:16:14,382 get_observations: Found observation 32282 at 2026:100:01:08:56.489 with 1 manvrs
2026-04-10 13:16:14,382 get_observations: Found observation 32289 at 2026:100:05:08:43.951 with 1 manvrs
2026-04-10 13:16:14,382 get_observations: Found observation 41566 at 2026:100:08:27:26.393 with 1 manvrs
2026-04-10 13:16:14,383 get_observations: Found observation 41565 at 2026:100:09:58:33.098 with 1 manvrs
2026-04-10 13:16:14,383 get_observations: Found observation 41564 at 2026:100:11:29:39.801 with 1 manvrs
2026-04-10 13:16:14,384 get_observations: Found observation 41563 at 2026:100:12:55:40.252 with 1 manvrs
2026-04-10 13:16:14,384 get_observations: Found observation 41562 at 2026:100:16:20:40.252 with 1 manvrs
2026-04-10 13:16:14,385 main: Found 41 observations
2026-04-10 13:16:14,385 main: ********************************************************************************
2026-04-10 13:16:14,385 main: Processing observation 30341
2026-04-10 13:16:14,385 main: ********************************************************************************
2026-04-10 13:16:14,425 obs_link_from_info: Found prev obsid 32267
2026-04-10 13:16:14,447 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,448 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,451 process_obs: ObsID 30341 already processed, skipping
2026-04-10 13:16:14,451 main:
2026-04-10 13:16:14,451 main: ********************************************************************************
2026-04-10 13:16:14,451 main: Processing observation 31446
2026-04-10 13:16:14,451 main: ********************************************************************************
2026-04-10 13:16:14,452 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,453 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,470 process_obs: ObsID 31446 already processed, skipping
2026-04-10 13:16:14,470 main:
2026-04-10 13:16:14,470 main: ********************************************************************************
2026-04-10 13:16:14,470 main: Processing observation 31082
2026-04-10 13:16:14,470 main: ********************************************************************************
2026-04-10 13:16:14,471 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,472 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,485 process_obs: ObsID 31082 already processed, skipping
2026-04-10 13:16:14,486 main:
2026-04-10 13:16:14,486 main: ********************************************************************************
2026-04-10 13:16:14,486 main: Processing observation 32274
2026-04-10 13:16:14,486 main: ********************************************************************************
2026-04-10 13:16:14,487 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,488 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,491 process_obs: ObsID 32274 already processed, skipping
2026-04-10 13:16:14,492 main:
2026-04-10 13:16:14,492 main: ********************************************************************************
2026-04-10 13:16:14,492 main: Processing observation 31437
2026-04-10 13:16:14,492 main: ********************************************************************************
2026-04-10 13:16:14,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,496 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,513 process_obs: ObsID 31437 already processed, skipping
2026-04-10 13:16:14,514 main:
2026-04-10 13:16:14,514 main: ********************************************************************************
2026-04-10 13:16:14,514 main: Processing observation 31260
2026-04-10 13:16:14,514 main: ********************************************************************************
2026-04-10 13:16:14,515 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,517 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,538 process_obs: ObsID 31260 already processed, skipping
2026-04-10 13:16:14,538 main:
2026-04-10 13:16:14,538 main: ********************************************************************************
2026-04-10 13:16:14,538 main: Processing observation 41573
2026-04-10 13:16:14,538 main: ********************************************************************************
2026-04-10 13:16:14,539 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,540 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,558 process_obs: ObsID 41573 already processed, skipping
2026-04-10 13:16:14,558 main:
2026-04-10 13:16:14,558 main: ********************************************************************************
2026-04-10 13:16:14,558 main: Processing observation 41572
2026-04-10 13:16:14,558 main: ********************************************************************************
2026-04-10 13:16:14,559 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,560 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,573 process_obs: ObsID 41572 already processed, skipping
2026-04-10 13:16:14,574 main:
2026-04-10 13:16:14,574 main: ********************************************************************************
2026-04-10 13:16:14,574 main: Processing observation 41571
2026-04-10 13:16:14,574 main: ********************************************************************************
2026-04-10 13:16:14,575 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,576 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,597 process_obs: ObsID 41571 already processed, skipping
2026-04-10 13:16:14,598 main:
2026-04-10 13:16:14,598 main: ********************************************************************************
2026-04-10 13:16:14,598 main: Processing observation 31382
2026-04-10 13:16:14,598 main: ********************************************************************************
2026-04-10 13:16:14,599 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,600 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,616 process_obs: ObsID 31382 already processed, skipping
2026-04-10 13:16:14,616 main:
2026-04-10 13:16:14,616 main: ********************************************************************************
2026-04-10 13:16:14,616 main: Processing observation 31383
2026-04-10 13:16:14,616 main: ********************************************************************************
2026-04-10 13:16:14,617 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,618 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,641 process_obs: ObsID 31383 already processed, skipping
2026-04-10 13:16:14,642 main:
2026-04-10 13:16:14,642 main: ********************************************************************************
2026-04-10 13:16:14,642 main: Processing observation 32260
2026-04-10 13:16:14,642 main: ********************************************************************************
2026-04-10 13:16:14,643 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,644 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,666 process_obs: ObsID 32260 already processed, skipping
2026-04-10 13:16:14,666 main:
2026-04-10 13:16:14,666 main: ********************************************************************************
2026-04-10 13:16:14,666 main: Processing observation 30343
2026-04-10 13:16:14,666 main: ********************************************************************************
2026-04-10 13:16:14,668 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,670 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-10 13:16:14,693 process_obs: ObsID 30343 already processed, skipping
2026-04-10 13:16:14,694 main:
2026-04-10 13:16:14,694 main: ********************************************************************************
2026-04-10 13:16:14,694 main: Processing observation 31105
2026-04-10 13:16:14,694 main: ********************************************************************************
2026-04-10 13:16:14,695 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,698 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,714 process_obs: ObsID 31105 already processed, skipping
2026-04-10 13:16:14,714 main:
2026-04-10 13:16:14,714 main: ********************************************************************************
2026-04-10 13:16:14,714 main: Processing observation 32134
2026-04-10 13:16:14,714 main: ********************************************************************************
2026-04-10 13:16:14,715 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,718 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,738 process_obs: ObsID 32134 already processed, skipping
2026-04-10 13:16:14,738 main:
2026-04-10 13:16:14,738 main: ********************************************************************************
2026-04-10 13:16:14,738 main: Processing observation 30423
2026-04-10 13:16:14,738 main: ********************************************************************************
2026-04-10 13:16:14,739 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,740 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,798 process_obs: ObsID 30423 already processed, skipping
2026-04-10 13:16:14,798 main:
2026-04-10 13:16:14,798 main: ********************************************************************************
2026-04-10 13:16:14,798 main: Processing observation 29658
2026-04-10 13:16:14,798 main: ********************************************************************************
2026-04-10 13:16:14,801 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,803 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,814 process_obs: ObsID 29658 already processed, skipping
2026-04-10 13:16:14,814 main:
2026-04-10 13:16:14,814 main: ********************************************************************************
2026-04-10 13:16:14,814 main: Processing observation 30487
2026-04-10 13:16:14,814 main: ********************************************************************************
2026-04-10 13:16:14,815 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,816 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,833 process_obs: ObsID 30487 already processed, skipping
2026-04-10 13:16:14,834 main:
2026-04-10 13:16:14,834 main: ********************************************************************************
2026-04-10 13:16:14,834 main: Processing observation 32278
2026-04-10 13:16:14,834 main: ********************************************************************************
2026-04-10 13:16:14,835 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,836 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,861 process_obs: ObsID 32278 already processed, skipping
2026-04-10 13:16:14,861 main:
2026-04-10 13:16:14,862 main: ********************************************************************************
2026-04-10 13:16:14,862 main: Processing observation 32286
2026-04-10 13:16:14,862 main: ********************************************************************************
2026-04-10 13:16:14,863 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,864 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,885 process_obs: ObsID 32286 already processed, skipping
2026-04-10 13:16:14,886 main:
2026-04-10 13:16:14,886 main: ********************************************************************************
2026-04-10 13:16:14,886 main: Processing observation 32279
2026-04-10 13:16:14,886 main: ********************************************************************************
2026-04-10 13:16:14,887 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,888 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,909 process_obs: ObsID 32279 already processed, skipping
2026-04-10 13:16:14,910 main:
2026-04-10 13:16:14,910 main: ********************************************************************************
2026-04-10 13:16:14,910 main: Processing observation 32287
2026-04-10 13:16:14,910 main: ********************************************************************************
2026-04-10 13:16:14,911 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,912 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,924 process_obs: ObsID 32287 already processed, skipping
2026-04-10 13:16:14,924 main:
2026-04-10 13:16:14,924 main: ********************************************************************************
2026-04-10 13:16:14,924 main: Processing observation 41570
2026-04-10 13:16:14,924 main: ********************************************************************************
2026-04-10 13:16:14,925 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,926 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,939 process_obs: ObsID 41570 already processed, skipping
2026-04-10 13:16:14,939 main:
2026-04-10 13:16:14,939 main: ********************************************************************************
2026-04-10 13:16:14,939 main: Processing observation 41569
2026-04-10 13:16:14,939 main: ********************************************************************************
2026-04-10 13:16:14,940 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,941 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,954 process_obs: ObsID 41569 already processed, skipping
2026-04-10 13:16:14,954 main:
2026-04-10 13:16:14,954 main: ********************************************************************************
2026-04-10 13:16:14,954 main: Processing observation 41568
2026-04-10 13:16:14,954 main: ********************************************************************************
2026-04-10 13:16:14,955 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,956 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,974 process_obs: ObsID 41568 already processed, skipping
2026-04-10 13:16:14,974 main:
2026-04-10 13:16:14,974 main: ********************************************************************************
2026-04-10 13:16:14,974 main: Processing observation 41567
2026-04-10 13:16:14,974 main: ********************************************************************************
2026-04-10 13:16:14,975 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,976 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 13:16:14,987 process_obs: ObsID 41567 already processed, skipping
2026-04-10 13:16:14,987 main:
2026-04-10 13:16:14,987 main: ********************************************************************************
2026-04-10 13:16:14,987 main: Processing observation 32288
2026-04-10 13:16:14,987 main: ********************************************************************************
2026-04-10 13:16:14,988 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 13:16:14,989 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:17,243 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32288/centroid_resids.pkl
2026-04-10 12:16:17,247 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-10 12:16:17,247 plot_crs_time: Plot file exists, skipping
2026-04-10 12:16:17,247 plot_crs_scatter: Plot file exists, skipping
2026-04-10 12:16:17,395 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-10 12:16:17,708 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32288/n_kalman_delta_roll.png
2026-04-10 12:16:19,908 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32288/index.html
2026-04-10 12:16:19,910 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32288/info.json
2026-04-10 12:16:19,928 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32288/index.html
2026-04-10 12:16:19,929 main:
2026-04-10 12:16:19,929 main: ********************************************************************************
2026-04-10 12:16:19,929 main: Processing observation 30152
2026-04-10 12:16:19,929 main: ********************************************************************************
2026-04-10 12:16:19,930 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:19,931 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:19,935 process_obs: ObsID 30152 already processed, skipping
2026-04-10 12:16:19,935 main:
2026-04-10 12:16:19,935 main: ********************************************************************************
2026-04-10 12:16:19,935 main: Processing observation 30103
2026-04-10 12:16:19,935 main: ********************************************************************************
2026-04-10 12:16:19,936 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:19,937 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:21,884 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30103/centroid_resids.pkl
2026-04-10 12:16:21,890 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-10 12:16:21,891 plot_crs_time: Plot file exists, skipping
2026-04-10 12:16:21,891 plot_crs_scatter: Plot file exists, skipping
2026-04-10 12:16:22,897 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30103/n_kalman_delta_roll.png
2026-04-10 12:16:26,109 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30103/index.html
2026-04-10 12:16:26,130 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30103/info.json
2026-04-10 12:16:26,173 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30103/index.html
2026-04-10 12:16:26,187 main:
2026-04-10 12:16:26,187 main: ********************************************************************************
2026-04-10 12:16:26,187 main: Processing observation 32277
2026-04-10 12:16:26,187 main: ********************************************************************************
2026-04-10 12:16:26,201 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:26,223 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:31,005 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-10 12:16:31,535 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32277/centroid_resids.pkl with 5 slots
2026-04-10 12:16:31,597 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32277/centroid_resids_time.png
2026-04-10 12:16:32,237 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32277/centroid_resids_scatter.png
2026-04-10 12:16:33,267 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32277/n_kalman_delta_roll.png
2026-04-10 12:16:33,643 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32277/index.html
2026-04-10 12:16:33,646 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32277/info.json
2026-04-10 12:16:33,648 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32277/index.html
2026-04-10 12:16:33,653 main:
2026-04-10 12:16:33,653 main: ********************************************************************************
2026-04-10 12:16:33,653 main: Processing observation 29666
2026-04-10 12:16:33,653 main: ********************************************************************************
2026-04-10 12:16:33,655 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:33,656 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:36,221 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-10 12:16:36,553 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29666/centroid_resids.pkl with 5 slots
2026-04-10 12:16:36,601 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29666/centroid_resids_time.png
2026-04-10 12:16:36,856 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29666/centroid_resids_scatter.png
2026-04-10 12:16:37,778 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29666/n_kalman_delta_roll.png
2026-04-10 12:16:38,037 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29666/index.html
2026-04-10 12:16:38,039 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29666/info.json
2026-04-10 12:16:38,041 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29666/index.html
2026-04-10 12:16:38,042 main:
2026-04-10 12:16:38,042 main: ********************************************************************************
2026-04-10 12:16:38,042 main: Processing observation 30539
2026-04-10 12:16:38,042 main: ********************************************************************************
2026-04-10 12:16:38,043 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:38,045 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:40,223 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-10 12:16:40,573 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30539/centroid_resids.pkl with 5 slots
2026-04-10 12:16:40,625 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30539/centroid_resids_time.png
2026-04-10 12:16:40,917 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30539/centroid_resids_scatter.png
2026-04-10 12:16:41,832 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30539/n_kalman_delta_roll.png
2026-04-10 12:16:41,972 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30539/index.html
2026-04-10 12:16:41,973 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30539/info.json
2026-04-10 12:16:41,976 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30539/index.html
2026-04-10 12:16:41,977 main:
2026-04-10 12:16:41,977 main: ********************************************************************************
2026-04-10 12:16:41,977 main: Processing observation 32281
2026-04-10 12:16:41,977 main: ********************************************************************************
2026-04-10 12:16:41,978 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:41,979 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:44,083 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-10 12:16:44,606 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32281/centroid_resids.pkl with 5 slots
2026-04-10 12:16:44,655 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32281/centroid_resids_time.png
2026-04-10 12:16:44,927 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32281/centroid_resids_scatter.png
2026-04-10 12:16:45,853 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32281/n_kalman_delta_roll.png
2026-04-10 12:16:46,004 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32281/index.html
2026-04-10 12:16:46,005 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32281/info.json
2026-04-10 12:16:46,008 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32281/index.html
2026-04-10 12:16:46,009 main:
2026-04-10 12:16:46,009 main: ********************************************************************************
2026-04-10 12:16:46,009 main: Processing observation 30540
2026-04-10 12:16:46,009 main: ********************************************************************************
2026-04-10 12:16:46,010 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:46,011 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:48,135 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-10 12:16:48,423 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30540/centroid_resids.pkl with 5 slots
2026-04-10 12:16:48,486 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30540/centroid_resids_time.png
2026-04-10 12:16:48,783 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30540/centroid_resids_scatter.png
2026-04-10 12:16:49,791 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30540/n_kalman_delta_roll.png
2026-04-10 12:16:49,937 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30540/index.html
2026-04-10 12:16:49,939 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30540/info.json
2026-04-10 12:16:49,941 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30540/index.html
2026-04-10 12:16:49,942 main:
2026-04-10 12:16:49,942 main: ********************************************************************************
2026-04-10 12:16:49,942 main: Processing observation 32282
2026-04-10 12:16:49,942 main: ********************************************************************************
2026-04-10 12:16:49,943 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:49,944 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:51,943 __init__: ObsID 32282 has no maneuver event in telemetry, skipping
2026-04-10 12:16:51,944 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32282/index.html
2026-04-10 12:16:51,948 info: could not get attribute kalman_start for obsid 32282
2026-04-10 12:16:51,948 info: could not get attribute kalman_stop for obsid 32282
2026-04-10 12:16:51,948 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32282/info.json
2026-04-10 12:16:51,949 main:
2026-04-10 12:16:51,949 main: ********************************************************************************
2026-04-10 12:16:51,949 main: Processing observation 32289
2026-04-10 12:16:51,949 main: ********************************************************************************
2026-04-10 12:16:51,950 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:51,951 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:53,916 __init__: ObsID 32289 has no maneuver event in telemetry, skipping
2026-04-10 12:16:53,917 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32289/index.html
2026-04-10 12:16:53,922 info: could not get attribute kalman_start for obsid 32289
2026-04-10 12:16:53,922 info: could not get attribute kalman_stop for obsid 32289
2026-04-10 12:16:53,922 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32289/info.json
2026-04-10 12:16:53,923 main:
2026-04-10 12:16:53,923 main: ********************************************************************************
2026-04-10 12:16:53,923 main: Processing observation 41566
2026-04-10 12:16:53,923 main: ********************************************************************************
2026-04-10 12:16:53,924 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:53,925 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:55,996 __init__: ObsID 41566 has no maneuver event in telemetry, skipping
2026-04-10 12:16:55,997 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41566/index.html
2026-04-10 12:16:56,001 info: could not get attribute kalman_start for obsid 41566
2026-04-10 12:16:56,001 info: could not get attribute kalman_stop for obsid 41566
2026-04-10 12:16:56,001 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41566/info.json
2026-04-10 12:16:56,002 main:
2026-04-10 12:16:56,002 main: ********************************************************************************
2026-04-10 12:16:56,002 main: Processing observation 41565
2026-04-10 12:16:56,002 main: ********************************************************************************
2026-04-10 12:16:56,003 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:56,004 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:16:58,041 __init__: ObsID 41565 has no maneuver event in telemetry, skipping
2026-04-10 12:16:58,041 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41565/index.html
2026-04-10 12:16:58,046 info: could not get attribute kalman_start for obsid 41565
2026-04-10 12:16:58,046 info: could not get attribute kalman_stop for obsid 41565
2026-04-10 12:16:58,046 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41565/info.json
2026-04-10 12:16:58,047 main:
2026-04-10 12:16:58,047 main: ********************************************************************************
2026-04-10 12:16:58,047 main: Processing observation 41564
2026-04-10 12:16:58,047 main: ********************************************************************************
2026-04-10 12:16:58,048 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:16:58,049 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:17:00,094 __init__: ObsID 41564 has no maneuver event in telemetry, skipping
2026-04-10 12:17:00,095 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41564/index.html
2026-04-10 12:17:00,099 info: could not get attribute kalman_start for obsid 41564
2026-04-10 12:17:00,099 info: could not get attribute kalman_stop for obsid 41564
2026-04-10 12:17:00,099 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41564/info.json
2026-04-10 12:17:00,100 main:
2026-04-10 12:17:00,100 main: ********************************************************************************
2026-04-10 12:17:00,100 main: Processing observation 41563
2026-04-10 12:17:00,100 main: ********************************************************************************
2026-04-10 12:17:00,101 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:17:00,102 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:17:02,240 __init__: ObsID 41563 has no maneuver event in telemetry, skipping
2026-04-10 12:17:02,240 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41563/index.html
2026-04-10 12:17:02,246 info: could not get attribute kalman_start for obsid 41563
2026-04-10 12:17:02,246 info: could not get attribute kalman_stop for obsid 41563
2026-04-10 12:17:02,246 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41563/info.json
2026-04-10 12:17:02,247 main:
2026-04-10 12:17:02,248 main: ********************************************************************************
2026-04-10 12:17:02,248 main: Processing observation 41562
2026-04-10 12:17:02,248 main: ********************************************************************************
2026-04-10 12:17:02,248 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41562/info.json file found, obs=None
2026-04-10 12:17:02,250 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-10 12:17:02,253 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-10 12:17:04,922 __init__: ObsID 41562 has no maneuver event in telemetry, skipping
2026-04-10 12:17:04,923 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41562/index.html
2026-04-10 12:17:04,927 info: could not get attribute kalman_start for obsid 41562
2026-04-10 12:17:04,927 info: could not get attribute kalman_stop for obsid 41562
2026-04-10 12:17:04,927 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/41562/info.json
2026-04-10 12:17:04,928 main:
2026-04-10 13:17:06,844 run_check: Starting centroid dashboard continuity check
2026-04-10 13:17:06,844 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-10 13:17:06,891 collect_observations: Processing year 2020
2026-04-10 13:17:26,632 collect_observations: Processing year 2021
2026-04-10 13:17:53,549 collect_observations: Processing year 2022
2026-04-10 13:18:26,721 collect_observations: Processing year 2023
2026-04-10 13:18:58,495 collect_observations: Processing year 2024
2026-04-10 13:19:30,944 collect_observations: Processing year 2025
2026-04-10 13:19:59,199 collect_observations: Processing year 2026
2026-04-10 13:20:07,178 collect_observations: Collected 13676 observations from 4-digit years
2026-04-10 13:20:07,184 sort_observations_by_date: Sorted observations by date
2026-04-10 13:20:07,184 check_continuity: Starting continuity check from most recent: ObsID 41562 (APR0626A) at 2026:100:15:43:59.294
2026-04-10 13:20:07,204 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-10 13:20:07,204 check_continuity: Chain complete: visited 13676 observations out of 13676 total
2026-04-10 13:20:07,205 run_check: ✓ Observation chain continuity check PASSED
2026-04-10 13:20:07,205 run_check: Summary: 13676 observations from 4-digit years, all properly linked