Prev
Index
Next
centroid_dashboard: Tue Apr 7 13:17:36 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Tue Apr 7 13:17:36 2026 |
No errors
File contents:
2026-04-07 13:16:12,637 main: Processing from 2026:090:17:16:12.637 to 2026:097:17:16:12.637
2026-04-07 13:16:19,006 get_observations: Found observation 32262 at 2026:090:18:00:09.850 with 1 manvrs
2026-04-07 13:16:19,007 get_observations: Found observation 32269 at 2026:090:21:29:14.614 with 1 manvrs
2026-04-07 13:16:19,007 get_observations: Found observation 32263 at 2026:091:03:08:17.699 with 1 manvrs
2026-04-07 13:16:19,008 get_observations: Found observation 32270 at 2026:091:06:37:21.552 with 1 manvrs
2026-04-07 13:16:19,008 get_observations: Found observation 32264 at 2026:091:12:11:23.997 with 1 manvrs
2026-04-07 13:16:19,009 get_observations: Found observation 32271 at 2026:091:15:40:26.445 with 1 manvrs
2026-04-07 13:16:19,009 get_observations: Found observation 32265 at 2026:091:21:14:27.812 with 1 manvrs
2026-04-07 13:16:19,009 get_observations: Found observation 32272 at 2026:092:00:43:29.767 with 1 manvrs
2026-04-07 13:16:19,010 get_observations: Found observation 31152 at 2026:092:05:58:53.106 with 1 manvrs
2026-04-07 13:16:19,010 get_observations: Found observation 41580 at 2026:092:09:59:11.859 with 1 manvrs
2026-04-07 13:16:19,011 get_observations: Found observation 41579 at 2026:092:11:55:40.252 with 1 manvrs
2026-04-07 13:16:19,011 get_observations: Found observation 41578 at 2026:092:13:55:40.252 with 1 manvrs
2026-04-07 13:16:19,011 get_observations: Found observation 41577 at 2026:092:15:55:40.252 with 1 manvrs
2026-04-07 13:16:19,012 get_observations: Found observation 41576 at 2026:092:16:55:40.252 with 1 manvrs
2026-04-07 13:16:19,012 get_observations: Found observation 41575 at 2026:092:18:04:40.252 with 1 manvrs
2026-04-07 13:16:19,013 get_observations: Found observation 41574 at 2026:092:19:02:40.252 with 1 manvrs
2026-04-07 13:16:19,013 get_observations: Found observation 32273 at 2026:092:20:06:20.408 with 1 manvrs
2026-04-07 13:16:19,013 get_observations: Found observation 30177 at 2026:092:23:34:38.451 with 1 manvrs
2026-04-07 13:16:19,014 get_observations: Found observation 30337 at 2026:093:03:02:56.494 with 1 manvrs
2026-04-07 13:16:19,014 get_observations: Found observation 32266 at 2026:093:08:06:14.537 with 1 manvrs
2026-04-07 13:16:19,015 get_observations: Found observation 30340 at 2026:093:11:17:53.643 with 1 manvrs
2026-04-07 13:16:19,015 get_observations: Found observation 32267 at 2026:093:16:09:32.748 with 1 manvrs
2026-04-07 13:16:19,016 get_observations: Found observation 30341 at 2026:093:19:21:11.854 with 1 manvrs
2026-04-07 13:16:19,016 get_observations: Found observation 31446 at 2026:093:22:43:19.190 with 1 manvrs
2026-04-07 13:16:19,016 get_observations: Found observation 31082 at 2026:094:01:13:54.564 with 1 manvrs
2026-04-07 13:16:19,017 get_observations: Found observation 32274 at 2026:094:09:50:31.604 with 1 manvrs
2026-04-07 13:16:19,017 get_observations: Found observation 31437 at 2026:094:20:25:19.737 with 1 manvrs
2026-04-07 13:16:19,018 get_observations: Found observation 31260 at 2026:094:23:42:51.001 with 1 manvrs
2026-04-07 13:16:19,018 get_observations: Found observation 41573 at 2026:095:01:47:13.289 with 1 manvrs
2026-04-07 13:16:19,018 get_observations: Found observation 41572 at 2026:095:05:10:40.252 with 1 manvrs
2026-04-07 13:16:19,019 get_observations: Found observation 41571 at 2026:095:07:55:40.252 with 1 manvrs
2026-04-07 13:16:19,019 get_observations: Found observation 31382 at 2026:095:11:45:54.739 with 1 manvrs
2026-04-07 13:16:19,020 get_observations: Found observation 31383 at 2026:095:12:27:44.739 with 1 manvrs
2026-04-07 13:16:19,020 get_observations: Found observation 32260 at 2026:095:13:43:24.390 with 1 manvrs
2026-04-07 13:16:19,021 get_observations: Found observation 30343 at 2026:095:17:12:32.443 with 1 manvrs
2026-04-07 13:16:19,021 get_observations: Found observation 31105 at 2026:095:22:16:19.245 with 1 manvrs
2026-04-07 13:16:19,021 get_observations: Found observation 32134 at 2026:096:04:33:56.558 with 1 manvrs
2026-04-07 13:16:19,022 get_observations: Found observation 30423 at 2026:096:08:46:14.335 with 1 manvrs
2026-04-07 13:16:19,022 get_observations: Found observation 29658 at 2026:096:17:29:13.326 with 1 manvrs
2026-04-07 13:16:19,023 get_observations: Found observation 30487 at 2026:096:21:26:45.228 with 1 manvrs
2026-04-07 13:16:19,023 get_observations: Found observation 32278 at 2026:097:01:40:57.126 with 1 manvrs
2026-04-07 13:16:19,023 get_observations: Found observation 32286 at 2026:097:05:21:49.027 with 1 manvrs
2026-04-07 13:16:19,024 get_observations: Found observation 32279 at 2026:097:09:36:00.923 with 1 manvrs
2026-04-07 13:16:19,024 get_observations: Found observation 32287 at 2026:097:13:16:52.826 with 1 manvrs
2026-04-07 13:16:19,025 main: Found 44 observations
2026-04-07 13:16:19,025 main: ********************************************************************************
2026-04-07 13:16:19,025 main: Processing observation 32262
2026-04-07 13:16:19,025 main: ********************************************************************************
2026-04-07 13:16:19,088 obs_link_from_info: Found prev obsid 32268
2026-04-07 13:16:19,092 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,093 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,096 process_obs: ObsID 32262 already processed, skipping
2026-04-07 13:16:19,096 main:
2026-04-07 13:16:19,096 main: ********************************************************************************
2026-04-07 13:16:19,096 main: Processing observation 32269
2026-04-07 13:16:19,096 main: ********************************************************************************
2026-04-07 13:16:19,097 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,099 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,102 process_obs: ObsID 32269 already processed, skipping
2026-04-07 13:16:19,102 main:
2026-04-07 13:16:19,102 main: ********************************************************************************
2026-04-07 13:16:19,102 main: Processing observation 32263
2026-04-07 13:16:19,102 main: ********************************************************************************
2026-04-07 13:16:19,103 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,104 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,107 process_obs: ObsID 32263 already processed, skipping
2026-04-07 13:16:19,107 main:
2026-04-07 13:16:19,107 main: ********************************************************************************
2026-04-07 13:16:19,107 main: Processing observation 32270
2026-04-07 13:16:19,107 main: ********************************************************************************
2026-04-07 13:16:19,108 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,110 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,113 process_obs: ObsID 32270 already processed, skipping
2026-04-07 13:16:19,113 main:
2026-04-07 13:16:19,113 main: ********************************************************************************
2026-04-07 13:16:19,113 main: Processing observation 32264
2026-04-07 13:16:19,113 main: ********************************************************************************
2026-04-07 13:16:19,114 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,115 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,118 process_obs: ObsID 32264 already processed, skipping
2026-04-07 13:16:19,118 main:
2026-04-07 13:16:19,118 main: ********************************************************************************
2026-04-07 13:16:19,118 main: Processing observation 32271
2026-04-07 13:16:19,118 main: ********************************************************************************
2026-04-07 13:16:19,119 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,120 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,123 process_obs: ObsID 32271 already processed, skipping
2026-04-07 13:16:19,123 main:
2026-04-07 13:16:19,123 main: ********************************************************************************
2026-04-07 13:16:19,123 main: Processing observation 32265
2026-04-07 13:16:19,123 main: ********************************************************************************
2026-04-07 13:16:19,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,125 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,128 process_obs: ObsID 32265 already processed, skipping
2026-04-07 13:16:19,129 main:
2026-04-07 13:16:19,129 main: ********************************************************************************
2026-04-07 13:16:19,129 main: Processing observation 32272
2026-04-07 13:16:19,129 main: ********************************************************************************
2026-04-07 13:16:19,130 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,131 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 13:16:19,134 process_obs: ObsID 32272 already processed, skipping
2026-04-07 13:16:19,134 main:
2026-04-07 13:16:19,134 main: ********************************************************************************
2026-04-07 13:16:19,134 main: Processing observation 31152
2026-04-07 13:16:19,134 main: ********************************************************************************
2026-04-07 13:16:19,135 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 13:16:19,136 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:21,676 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31152/centroid_resids.pkl
2026-04-07 12:16:21,679 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-07 12:16:21,680 plot_crs_time: Plot file exists, skipping
2026-04-07 12:16:21,680 plot_crs_scatter: Plot file exists, skipping
2026-04-07 12:16:23,515 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31152/n_kalman_delta_roll.png
2026-04-07 12:16:27,430 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31152/index.html
2026-04-07 12:16:27,436 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31152/info.json
2026-04-07 12:16:27,441 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31152/index.html
2026-04-07 12:16:27,445 main:
2026-04-07 12:16:27,445 main: ********************************************************************************
2026-04-07 12:16:27,445 main: Processing observation 41580
2026-04-07 12:16:27,445 main: ********************************************************************************
2026-04-07 12:16:27,449 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:27,452 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:27,468 process_obs: ObsID 41580 already processed, skipping
2026-04-07 12:16:27,468 main:
2026-04-07 12:16:27,468 main: ********************************************************************************
2026-04-07 12:16:27,468 main: Processing observation 41579
2026-04-07 12:16:27,468 main: ********************************************************************************
2026-04-07 12:16:27,472 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:27,476 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:27,493 process_obs: ObsID 41579 already processed, skipping
2026-04-07 12:16:27,493 main:
2026-04-07 12:16:27,493 main: ********************************************************************************
2026-04-07 12:16:27,493 main: Processing observation 41578
2026-04-07 12:16:27,493 main: ********************************************************************************
2026-04-07 12:16:27,496 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:27,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:27,511 process_obs: ObsID 41578 already processed, skipping
2026-04-07 12:16:27,511 main:
2026-04-07 12:16:27,511 main: ********************************************************************************
2026-04-07 12:16:27,511 main: Processing observation 41577
2026-04-07 12:16:27,511 main: ********************************************************************************
2026-04-07 12:16:27,514 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:27,518 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:27,537 process_obs: ObsID 41577 already processed, skipping
2026-04-07 12:16:27,537 main:
2026-04-07 12:16:27,537 main: ********************************************************************************
2026-04-07 12:16:27,537 main: Processing observation 41576
2026-04-07 12:16:27,537 main: ********************************************************************************
2026-04-07 12:16:27,561 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:27,593 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:27,709 process_obs: ObsID 41576 already processed, skipping
2026-04-07 12:16:27,709 main:
2026-04-07 12:16:27,709 main: ********************************************************************************
2026-04-07 12:16:27,709 main: Processing observation 41575
2026-04-07 12:16:27,709 main: ********************************************************************************
2026-04-07 12:16:27,733 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:27,761 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:27,817 process_obs: ObsID 41575 already processed, skipping
2026-04-07 12:16:27,817 main:
2026-04-07 12:16:27,817 main: ********************************************************************************
2026-04-07 12:16:27,817 main: Processing observation 41574
2026-04-07 12:16:27,817 main: ********************************************************************************
2026-04-07 12:16:27,841 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:27,873 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:27,981 process_obs: ObsID 41574 already processed, skipping
2026-04-07 12:16:27,981 main:
2026-04-07 12:16:27,981 main: ********************************************************************************
2026-04-07 12:16:27,981 main: Processing observation 32273
2026-04-07 12:16:27,981 main: ********************************************************************************
2026-04-07 12:16:27,993 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,097 process_obs: ObsID 32273 already processed, skipping
2026-04-07 12:16:28,097 main:
2026-04-07 12:16:28,097 main: ********************************************************************************
2026-04-07 12:16:28,097 main: Processing observation 30177
2026-04-07 12:16:28,097 main: ********************************************************************************
2026-04-07 12:16:28,112 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,137 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,245 process_obs: ObsID 30177 already processed, skipping
2026-04-07 12:16:28,245 main:
2026-04-07 12:16:28,245 main: ********************************************************************************
2026-04-07 12:16:28,245 main: Processing observation 30337
2026-04-07 12:16:28,245 main: ********************************************************************************
2026-04-07 12:16:28,265 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,297 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,399 process_obs: ObsID 30337 already processed, skipping
2026-04-07 12:16:28,399 main:
2026-04-07 12:16:28,399 main: ********************************************************************************
2026-04-07 12:16:28,399 main: Processing observation 32266
2026-04-07 12:16:28,399 main: ********************************************************************************
2026-04-07 12:16:28,421 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,449 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,545 process_obs: ObsID 32266 already processed, skipping
2026-04-07 12:16:28,545 main:
2026-04-07 12:16:28,545 main: ********************************************************************************
2026-04-07 12:16:28,545 main: Processing observation 30340
2026-04-07 12:16:28,545 main: ********************************************************************************
2026-04-07 12:16:28,565 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,597 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,693 process_obs: ObsID 30340 already processed, skipping
2026-04-07 12:16:28,693 main:
2026-04-07 12:16:28,693 main: ********************************************************************************
2026-04-07 12:16:28,693 main: Processing observation 32267
2026-04-07 12:16:28,693 main: ********************************************************************************
2026-04-07 12:16:28,709 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,716 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,747 process_obs: ObsID 32267 already processed, skipping
2026-04-07 12:16:28,747 main:
2026-04-07 12:16:28,747 main: ********************************************************************************
2026-04-07 12:16:28,747 main: Processing observation 30341
2026-04-07 12:16:28,747 main: ********************************************************************************
2026-04-07 12:16:28,763 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,765 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,773 process_obs: ObsID 30341 already processed, skipping
2026-04-07 12:16:28,774 main:
2026-04-07 12:16:28,774 main: ********************************************************************************
2026-04-07 12:16:28,774 main: Processing observation 31446
2026-04-07 12:16:28,774 main: ********************************************************************************
2026-04-07 12:16:28,777 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,779 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:28,849 process_obs: ObsID 31446 already processed, skipping
2026-04-07 12:16:28,849 main:
2026-04-07 12:16:28,849 main: ********************************************************************************
2026-04-07 12:16:28,849 main: Processing observation 31082
2026-04-07 12:16:28,849 main: ********************************************************************************
2026-04-07 12:16:28,865 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:28,893 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:31,629 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31082/centroid_resids.pkl
2026-04-07 12:16:31,643 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-07 12:16:31,643 plot_crs_time: Plot file exists, skipping
2026-04-07 12:16:31,644 plot_crs_scatter: Plot file exists, skipping
2026-04-07 12:16:32,987 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31082/n_kalman_delta_roll.png
2026-04-07 12:16:36,199 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31082/index.html
2026-04-07 12:16:36,201 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/31082/info.json
2026-04-07 12:16:36,205 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31082/index.html
2026-04-07 12:16:36,206 main:
2026-04-07 12:16:36,206 main: ********************************************************************************
2026-04-07 12:16:36,206 main: Processing observation 32274
2026-04-07 12:16:36,206 main: ********************************************************************************
2026-04-07 12:16:36,207 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:36,209 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:38,461 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/32274/centroid_resids.pkl
2026-04-07 12:16:38,496 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-07 12:16:38,496 plot_crs_time: Plot file exists, skipping
2026-04-07 12:16:38,497 plot_crs_scatter: Plot file exists, skipping
2026-04-07 12:16:39,483 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/32274/n_kalman_delta_roll.png
2026-04-07 12:16:39,623 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/32274/index.html
2026-04-07 12:16:39,624 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/32274/info.json
2026-04-07 12:16:39,666 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32274/index.html
2026-04-07 12:16:39,666 main:
2026-04-07 12:16:39,667 main: ********************************************************************************
2026-04-07 12:16:39,667 main: Processing observation 31437
2026-04-07 12:16:39,667 main: ********************************************************************************
2026-04-07 12:16:39,668 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,669 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,715 process_obs: ObsID 31437 already processed, skipping
2026-04-07 12:16:39,716 main:
2026-04-07 12:16:39,716 main: ********************************************************************************
2026-04-07 12:16:39,716 main: Processing observation 31260
2026-04-07 12:16:39,716 main: ********************************************************************************
2026-04-07 12:16:39,717 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,718 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,731 process_obs: ObsID 31260 already processed, skipping
2026-04-07 12:16:39,731 main:
2026-04-07 12:16:39,731 main: ********************************************************************************
2026-04-07 12:16:39,731 main: Processing observation 41573
2026-04-07 12:16:39,731 main: ********************************************************************************
2026-04-07 12:16:39,732 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,733 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,818 process_obs: ObsID 41573 already processed, skipping
2026-04-07 12:16:39,818 main:
2026-04-07 12:16:39,818 main: ********************************************************************************
2026-04-07 12:16:39,818 main: Processing observation 41572
2026-04-07 12:16:39,818 main: ********************************************************************************
2026-04-07 12:16:39,819 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,820 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,836 process_obs: ObsID 41572 already processed, skipping
2026-04-07 12:16:39,836 main:
2026-04-07 12:16:39,836 main: ********************************************************************************
2026-04-07 12:16:39,836 main: Processing observation 41571
2026-04-07 12:16:39,836 main: ********************************************************************************
2026-04-07 12:16:39,837 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,838 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,855 process_obs: ObsID 41571 already processed, skipping
2026-04-07 12:16:39,855 main:
2026-04-07 12:16:39,855 main: ********************************************************************************
2026-04-07 12:16:39,855 main: Processing observation 31382
2026-04-07 12:16:39,855 main: ********************************************************************************
2026-04-07 12:16:39,856 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,857 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,868 process_obs: ObsID 31382 already processed, skipping
2026-04-07 12:16:39,868 main:
2026-04-07 12:16:39,868 main: ********************************************************************************
2026-04-07 12:16:39,868 main: Processing observation 31383
2026-04-07 12:16:39,868 main: ********************************************************************************
2026-04-07 12:16:39,869 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,870 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,888 process_obs: ObsID 31383 already processed, skipping
2026-04-07 12:16:39,888 main:
2026-04-07 12:16:39,888 main: ********************************************************************************
2026-04-07 12:16:39,888 main: Processing observation 32260
2026-04-07 12:16:39,888 main: ********************************************************************************
2026-04-07 12:16:39,889 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,890 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:39,901 process_obs: ObsID 32260 already processed, skipping
2026-04-07 12:16:39,901 main:
2026-04-07 12:16:39,901 main: ********************************************************************************
2026-04-07 12:16:39,901 main: Processing observation 30343
2026-04-07 12:16:39,901 main: ********************************************************************************
2026-04-07 12:16:39,902 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:39,903 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/last.html
2026-04-07 12:16:42,215 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/30343/centroid_resids.pkl
2026-04-07 12:16:42,241 write_centroid_resids: Centroid residuals file exists, skipping
2026-04-07 12:16:42,241 plot_crs_time: Plot file exists, skipping
2026-04-07 12:16:42,241 plot_crs_scatter: Plot file exists, skipping
2026-04-07 12:16:43,116 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/30343/n_kalman_delta_roll.png
2026-04-07 12:16:45,735 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/30343/index.html
2026-04-07 12:16:45,737 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAR3026A/30343/info.json
2026-04-07 12:16:45,798 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30343/index.html
2026-04-07 12:16:45,799 main:
2026-04-07 12:16:45,799 main: ********************************************************************************
2026-04-07 12:16:45,799 main: Processing observation 31105
2026-04-07 12:16:45,799 main: ********************************************************************************
2026-04-07 12:16:45,801 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:45,802 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:16:48,341 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-07 12:16:48,800 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/31105/centroid_resids.pkl with 5 slots
2026-04-07 12:16:48,853 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/31105/centroid_resids_time.png
2026-04-07 12:16:50,355 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/31105/centroid_resids_scatter.png
2026-04-07 12:16:51,314 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/31105/n_kalman_delta_roll.png
2026-04-07 12:16:51,454 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/31105/index.html
2026-04-07 12:16:51,455 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/31105/info.json
2026-04-07 12:16:51,458 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31105/index.html
2026-04-07 12:16:51,459 main:
2026-04-07 12:16:51,459 main: ********************************************************************************
2026-04-07 12:16:51,459 main: Processing observation 32134
2026-04-07 12:16:51,459 main: ********************************************************************************
2026-04-07 12:16:51,460 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:51,461 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:16:53,542 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-07 12:16:54,148 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32134/centroid_resids.pkl with 5 slots
2026-04-07 12:16:54,194 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32134/centroid_resids_time.png
2026-04-07 12:16:54,463 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32134/centroid_resids_scatter.png
2026-04-07 12:16:55,421 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32134/n_kalman_delta_roll.png
2026-04-07 12:16:55,571 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32134/index.html
2026-04-07 12:16:55,573 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32134/info.json
2026-04-07 12:16:55,575 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32134/index.html
2026-04-07 12:16:55,576 main:
2026-04-07 12:16:55,576 main: ********************************************************************************
2026-04-07 12:16:55,576 main: Processing observation 30423
2026-04-07 12:16:55,576 main: ********************************************************************************
2026-04-07 12:16:55,577 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:55,578 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:16:57,763 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-07 12:16:58,711 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30423/centroid_resids.pkl with 5 slots
2026-04-07 12:16:58,768 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30423/centroid_resids_time.png
2026-04-07 12:16:59,054 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30423/centroid_resids_scatter.png
2026-04-07 12:16:59,269 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-04-07 12:16:59,422 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30423/n_kalman_delta_roll.png
2026-04-07 12:16:59,550 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30423/index.html
2026-04-07 12:16:59,552 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30423/info.json
2026-04-07 12:16:59,554 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30423/index.html
2026-04-07 12:16:59,555 main:
2026-04-07 12:16:59,555 main: ********************************************************************************
2026-04-07 12:16:59,555 main: Processing observation 29658
2026-04-07 12:16:59,555 main: ********************************************************************************
2026-04-07 12:16:59,627 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:16:59,628 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:17:01,882 get_centroid_resids: Computing centroid residuals from telemetry
2026-04-07 12:17:02,412 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29658/centroid_resids.pkl with 4 slots
2026-04-07 12:17:02,449 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29658/centroid_resids_time.png
2026-04-07 12:17:02,681 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29658/centroid_resids_scatter.png
2026-04-07 12:17:03,584 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29658/n_kalman_delta_roll.png
2026-04-07 12:17:03,922 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29658/index.html
2026-04-07 12:17:03,926 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/29658/info.json
2026-04-07 12:17:03,964 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29658/index.html
2026-04-07 12:17:03,973 main:
2026-04-07 12:17:03,973 main: ********************************************************************************
2026-04-07 12:17:03,973 main: Processing observation 30487
2026-04-07 12:17:03,973 main: ********************************************************************************
2026-04-07 12:17:03,989 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:17:04,006 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:17:06,714 __init__: ObsID 30487 has insufficient telemetry, skipping
2026-04-07 12:17:06,716 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30487/index.html
2026-04-07 12:17:06,723 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/30487/info.json
2026-04-07 12:17:06,724 main:
2026-04-07 12:17:06,724 main: ********************************************************************************
2026-04-07 12:17:06,724 main: Processing observation 32278
2026-04-07 12:17:06,724 main: ********************************************************************************
2026-04-07 12:17:06,994 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:17:07,017 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:17:11,525 __init__: ObsID 32278 has insufficient telemetry, skipping
2026-04-07 12:17:11,526 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32278/index.html
2026-04-07 12:17:11,530 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32278/info.json
2026-04-07 12:17:11,531 main:
2026-04-07 12:17:11,531 main: ********************************************************************************
2026-04-07 12:17:11,531 main: Processing observation 32286
2026-04-07 12:17:11,531 main: ********************************************************************************
2026-04-07 12:17:11,532 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:17:11,533 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:17:13,650 __init__: ObsID 32286 has insufficient telemetry, skipping
2026-04-07 12:17:13,651 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32286/index.html
2026-04-07 12:17:13,655 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32286/info.json
2026-04-07 12:17:13,656 main:
2026-04-07 12:17:13,656 main: ********************************************************************************
2026-04-07 12:17:13,656 main: Processing observation 32279
2026-04-07 12:17:13,656 main: ********************************************************************************
2026-04-07 12:17:13,657 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:17:13,658 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:17:15,776 __init__: ObsID 32279 has insufficient telemetry, skipping
2026-04-07 12:17:15,777 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32279/index.html
2026-04-07 12:17:15,781 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32279/info.json
2026-04-07 12:17:15,782 main:
2026-04-07 12:17:15,782 main: ********************************************************************************
2026-04-07 12:17:15,782 main: Processing observation 32287
2026-04-07 12:17:15,782 main: ********************************************************************************
2026-04-07 12:17:15,782 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32287/info.json file found, obs=None
2026-04-07 12:17:15,783 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-04-07 12:17:15,785 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/last.html
2026-04-07 12:17:17,873 __init__: ObsID 32287 has no maneuver event in telemetry, skipping
2026-04-07 12:17:17,873 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32287/index.html
2026-04-07 12:17:17,878 info: could not get attribute kalman_start for obsid 32287
2026-04-07 12:17:17,878 info: could not get attribute kalman_stop for obsid 32287
2026-04-07 12:17:17,878 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR0626A/32287/info.json
2026-04-07 12:17:17,879 main:
2026-04-07 13:17:19,269 run_check: Starting centroid dashboard continuity check
2026-04-07 13:17:19,269 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-04-07 13:17:19,270 collect_observations: Processing year 2020
2026-04-07 13:17:21,042 collect_observations: Processing year 2021
2026-04-07 13:17:23,583 collect_observations: Processing year 2022
2026-04-07 13:17:26,683 collect_observations: Processing year 2023
2026-04-07 13:17:29,581 collect_observations: Processing year 2024
2026-04-07 13:17:32,555 collect_observations: Processing year 2025
2026-04-07 13:17:35,874 collect_observations: Processing year 2026
2026-04-07 13:17:36,485 collect_observations: Collected 13657 observations from 4-digit years
2026-04-07 13:17:36,488 sort_observations_by_date: Sorted observations by date
2026-04-07 13:17:36,488 check_continuity: Starting continuity check from most recent: ObsID 32287 (APR0626A) at 2026:097:12:43:46.671
2026-04-07 13:17:36,505 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-04-07 13:17:36,505 check_continuity: Chain complete: visited 13657 observations out of 13657 total
2026-04-07 13:17:36,506 run_check: ✓ Observation chain continuity check PASSED
2026-04-07 13:17:36,506 run_check: Summary: 13657 observations from 4-digit years, all properly linked