Prev   Index   Next

kalman_watch3: Sat Apr 25 08:34:30 2026

File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log

Task Status AgeMaxAge Last Date
kalman_watch3 OK 0.091.0 Sat Apr 25 08:34:30 2026

No errors

File contents:

2026-04-25 08:31:22,459 log_run_info: ******************************************
2026-04-25 08:31:22,459 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-04-25 08:31:22,459 log_run_info: Version: 0.6.2
2026-04-25 08:31:22,459 log_run_info: Time: Sat Apr 25 08:31:22 2026
2026-04-25 08:31:22,459 log_run_info: User: aca
2026-04-25 08:31:22,459 log_run_info: Machine: kady.cfa.harvard.edu
2026-04-25 08:31:22,459 log_run_info: Processing args:
2026-04-25 08:31:22,459 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-04-25 08:31:22,459 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-04-25 08:31:22,459 log_run_info: 'lookback': 14,
2026-04-25 08:31:22,459 log_run_info: 'make_html': True,
2026-04-25 08:31:22,459 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-04-25 08:31:22,459 log_run_info: 'stop': None}
2026-04-25 08:31:22,459 log_run_info: ******************************************
2026-04-25 08:31:22,462 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-04-25 08:31:22,485 get_evts_perigee: Getting perigee events between 2026:101:12:31:22.460 and 2026:115:12:31:22.460
2026-04-25 08:31:26,164 get_evts_perigee: Found 0 new perigee event(s)
2026-04-25 08:31:26,164 main: No new perigee events, exiting
2026-04-25 08:31:32,632 get_manvrs_perigee: Getting maneuvers from 2026:070:12:31:32.631 to 2026:114:12:31:32.632
2026-04-25 08:31:36,251 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:070:12:31:32.631 to 2026:114:12:31:32.632
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:071:12:51:40.701 to 2026:071:13:48:41.127
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:076:19:25:09.132 to 2026:076:20:00:25.757
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:079:10:02:30.722 to 2026:079:10:12:05.747
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:083:17:47:18.196 to 2026:083:17:52:54.396
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:084:18:38:35.577 to 2026:084:18:59:39.402
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:087:10:27:06.293 to 2026:087:10:35:40.843
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:090:01:04:18.658 to 2026:090:01:21:41.083
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:094:00:46:07.330 to 2026:094:00:55:35.180
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:100:09:37:04.267 to 2026:100:09:40:21.067
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:100:11:08:09.567 to 2026:100:11:15:41.592
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:100:12:34:59.643 to 2026:100:12:41:59.893
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:104:22:08:03.568 to 2026:104:22:13:45.918
2026-04-25 08:31:45,274 get_manvrs_perigee: Excluding Earth block from 2026:111:05:38:05.079 to 2026:111:05:50:29.229
2026-04-25 08:31:45,352 get_mon_dataset: Getting MON data from 2026:071:10:36:59.601 to 2026:071:11:15:55.576
2026-04-25 08:31:45,352 get_aca_images_cached: Getting ACA images from 2026:071:10:36:59.601 to 2026:071:11:15:55.576
2026-04-25 08:31:45,834 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-04-25 08:34:05,217 get_mon_dataset: Getting MON data from 2026:071:12:50:00.251 to 2026:071:12:51:40.701
2026-04-25 08:34:05,217 get_aca_images_cached: Getting ACA images from 2026:071:12:50:00.251 to 2026:071:12:51:40.701
2026-04-25 08:34:05,424 get_mon_dataset: Getting MON data from 2026:071:13:48:41.127 to 2026:071:13:50:06.202
2026-04-25 08:34:05,424 get_aca_images_cached: Getting ACA images from 2026:071:13:48:41.127 to 2026:071:13:50:06.202
2026-04-25 08:34:05,582 get_mon_dataset: Getting MON data from 2026:074:03:07:42.066 to 2026:074:03:45:56.016
2026-04-25 08:34:05,582 get_aca_images_cached: Getting ACA images from 2026:074:03:07:42.066 to 2026:074:03:45:56.016
2026-04-25 08:34:05,781 get_mon_dataset: Getting MON data from 2026:076:19:11:34.257 to 2026:076:19:25:09.132
2026-04-25 08:34:05,781 get_aca_images_cached: Getting ACA images from 2026:076:19:11:34.257 to 2026:076:19:25:09.132
2026-04-25 08:34:05,960 get_mon_dataset: Getting MON data from 2026:076:20:00:25.757 to 2026:076:20:01:35.457
2026-04-25 08:34:05,960 get_aca_images_cached: Getting ACA images from 2026:076:20:00:25.757 to 2026:076:20:01:35.457
2026-04-25 08:34:06,121 get_mon_dataset: Getting MON data from 2026:076:20:29:08.782 to 2026:076:20:36:20.307
2026-04-25 08:34:06,122 get_aca_images_cached: Getting ACA images from 2026:076:20:29:08.782 to 2026:076:20:36:20.307
2026-04-25 08:34:06,159 get_mon_dataset: Not enough images for slot 0 found 0)
2026-04-25 08:34:06,160 get_mon_dataset: Not enough images for slot 1 found 0)
2026-04-25 08:34:06,161 get_mon_dataset: Not enough images for slot 2 found 0)
2026-04-25 08:34:06,162 get_mon_dataset: Not enough images for slot 3 found 0)
2026-04-25 08:34:06,163 get_mon_dataset: Not enough images for slot 4 found 0)
2026-04-25 08:34:06,164 get_mon_dataset: Not enough images for slot 5 found 0)
2026-04-25 08:34:06,165 get_mon_dataset: Not enough images for slot 6 found 0)
2026-04-25 08:34:06,166 get_mon_dataset: Not enough images for slot 7 found 0)
2026-04-25 08:34:06,167 get_mon_dataset: Getting MON data from 2026:079:09:53:06.972 to 2026:079:10:02:30.722
2026-04-25 08:34:06,167 get_aca_images_cached: Getting ACA images from 2026:079:09:53:06.972 to 2026:079:10:02:30.722
2026-04-25 08:34:06,354 get_mon_dataset: Getting MON data from 2026:079:10:12:05.747 to 2026:079:10:30:55.297
2026-04-25 08:34:06,354 get_aca_images_cached: Getting ACA images from 2026:079:10:12:05.747 to 2026:079:10:30:55.297
2026-04-25 08:34:06,589 get_mon_dataset: Getting MON data from 2026:079:11:24:09.197 to 2026:079:11:31:20.722
2026-04-25 08:34:06,589 get_aca_images_cached: Getting ACA images from 2026:079:11:24:09.197 to 2026:079:11:31:20.722
2026-04-25 08:34:06,675 get_mon_dataset: Not enough images for slot 0 found 0)
2026-04-25 08:34:06,676 get_mon_dataset: Not enough images for slot 1 found 0)
2026-04-25 08:34:06,677 get_mon_dataset: Not enough images for slot 2 found 0)
2026-04-25 08:34:06,678 get_mon_dataset: Not enough images for slot 3 found 0)
2026-04-25 08:34:06,678 get_mon_dataset: Not enough images for slot 4 found 0)
2026-04-25 08:34:06,679 get_mon_dataset: Not enough images for slot 5 found 0)
2026-04-25 08:34:06,680 get_mon_dataset: Not enough images for slot 6 found 0)
2026-04-25 08:34:06,681 get_mon_dataset: Not enough images for slot 7 found 0)
2026-04-25 08:34:06,682 get_mon_dataset: Getting MON data from 2026:082:02:43:23.062 to 2026:082:03:20:56.012
2026-04-25 08:34:06,682 get_aca_images_cached: Getting ACA images from 2026:082:02:43:23.062 to 2026:082:03:20:56.012
2026-04-25 08:34:06,918 get_mon_dataset: Getting MON data from 2026:082:03:40:40.912 to 2026:082:04:27:45.812
2026-04-25 08:34:06,918 get_aca_images_cached: Getting ACA images from 2026:082:03:40:40.912 to 2026:082:04:27:45.812
2026-04-25 08:34:07,144 get_mon_dataset: Getting MON data from 2026:084:18:34:50.077 to 2026:084:18:38:35.577
2026-04-25 08:34:07,145 get_aca_images_cached: Getting ACA images from 2026:084:18:34:50.077 to 2026:084:18:38:35.577
2026-04-25 08:34:07,304 get_mon_dataset: Getting MON data from 2026:084:18:59:39.402 to 2026:084:19:25:55.852
2026-04-25 08:34:07,304 get_aca_images_cached: Getting ACA images from 2026:084:18:59:39.402 to 2026:084:19:25:55.852
2026-04-25 08:34:07,508 get_mon_dataset: Getting MON data from 2026:087:10:21:00.368 to 2026:087:10:27:06.293
2026-04-25 08:34:07,509 get_aca_images_cached: Getting ACA images from 2026:087:10:21:00.368 to 2026:087:10:27:06.293
2026-04-25 08:34:07,677 get_mon_dataset: Getting MON data from 2026:087:10:35:40.843 to 2026:087:11:04:16.693
2026-04-25 08:34:07,677 get_aca_images_cached: Getting ACA images from 2026:087:10:35:40.843 to 2026:087:11:04:16.693
2026-04-25 08:34:07,866 get_mon_dataset: Getting MON data from 2026:089:23:38:36.232 to 2026:090:00:05:56.232
2026-04-25 08:34:07,866 get_aca_images_cached: Getting ACA images from 2026:089:23:38:36.232 to 2026:090:00:05:56.232
2026-04-25 08:34:08,058 get_mon_dataset: Getting MON data from 2026:090:00:53:48.282 to 2026:090:01:04:18.658
2026-04-25 08:34:08,058 get_aca_images_cached: Getting ACA images from 2026:090:00:53:48.282 to 2026:090:01:04:18.658
2026-04-25 08:34:08,224 get_mon_dataset: Getting MON data from 2026:090:01:21:41.083 to 2026:090:01:25:56.308
2026-04-25 08:34:08,224 get_aca_images_cached: Getting ACA images from 2026:090:01:21:41.083 to 2026:090:01:25:56.308
2026-04-25 08:34:08,379 get_mon_dataset: Getting MON data from 2026:090:01:56:36.183 to 2026:090:02:35:55.733
2026-04-25 08:34:08,379 get_aca_images_cached: Getting ACA images from 2026:090:01:56:36.183 to 2026:090:02:35:55.733
2026-04-25 08:34:08,577 get_mon_dataset: Getting MON data from 2026:092:15:23:26.572 to 2026:092:15:55:56.123
2026-04-25 08:34:08,577 get_aca_images_cached: Getting ACA images from 2026:092:15:23:26.572 to 2026:092:15:55:56.123
2026-04-25 08:34:08,765 get_mon_dataset: Getting MON data from 2026:092:16:28:17.473 to 2026:092:16:55:55.923
2026-04-25 08:34:08,765 get_aca_images_cached: Getting ACA images from 2026:092:16:28:17.473 to 2026:092:16:55:55.923
2026-04-25 08:34:08,953 get_mon_dataset: Getting MON data from 2026:092:17:22:50.298 to 2026:092:18:04:55.898
2026-04-25 08:34:08,954 get_aca_images_cached: Getting ACA images from 2026:092:17:22:50.298 to 2026:092:18:04:55.898
2026-04-25 08:34:09,153 get_mon_dataset: Getting MON data from 2026:095:07:16:09.438 to 2026:095:07:55:55.638
2026-04-25 08:34:09,153 get_aca_images_cached: Getting ACA images from 2026:095:07:16:09.438 to 2026:095:07:55:55.638
2026-04-25 08:34:09,360 get_mon_dataset: Getting MON data from 2026:098:00:15:23.653 to 2026:098:00:55:55.978
2026-04-25 08:34:09,360 get_aca_images_cached: Getting ACA images from 2026:098:00:15:23.653 to 2026:098:00:55:55.978
2026-04-25 08:34:09,848 get_mon_dataset: Getting MON data from 2026:100:15:43:53.068 to 2026:100:16:20:56.294
2026-04-25 08:34:09,848 get_aca_images_cached: Getting ACA images from 2026:100:15:43:53.068 to 2026:100:16:20:56.294
2026-04-25 08:34:10,059 get_mon_dataset: Getting MON data from 2026:103:05:23:47.583 to 2026:103:05:55:55.608
2026-04-25 08:34:10,059 get_aca_images_cached: Getting ACA images from 2026:103:05:23:47.583 to 2026:103:05:55:55.608
2026-04-25 08:34:10,417 get_mon_dataset: Getting MON data from 2026:105:22:38:48.899 to 2026:105:22:55:55.949
2026-04-25 08:34:10,417 get_aca_images_cached: Getting ACA images from 2026:105:22:38:48.899 to 2026:105:22:55:55.949
2026-04-25 08:34:10,598 get_mon_dataset: Getting MON data from 2026:108:11:44:44.688 to 2026:108:12:15:55.313
2026-04-25 08:34:10,598 get_aca_images_cached: Getting ACA images from 2026:108:11:44:44.688 to 2026:108:12:15:55.313
2026-04-25 08:34:11,064 get_mon_dataset: Getting MON data from 2026:111:05:33:26.279 to 2026:111:05:38:05.079
2026-04-25 08:34:11,064 get_aca_images_cached: Getting ACA images from 2026:111:05:33:26.279 to 2026:111:05:38:05.079
2026-04-25 08:34:11,226 get_mon_dataset: Getting MON data from 2026:111:05:50:29.229 to 2026:111:06:10:56.154
2026-04-25 08:34:11,227 get_aca_images_cached: Getting ACA images from 2026:111:05:50:29.229 to 2026:111:06:10:56.154
2026-04-25 08:34:11,410 get_mon_dataset: Getting MON data from 2026:113:21:22:35.944 to 2026:113:21:54:56.270
2026-04-25 08:34:11,410 get_aca_images_cached: Getting ACA images from 2026:113:21:22:35.944 to 2026:113:21:54:56.270
2026-04-25 08:34:11,861 get_kalman_drops_nman: processing NMAN data
2026-04-25 08:34:11,872 get_kalman_drops_nman: Skipping NMAN from 2026:071:12:50:00.251 to 2026:071:12:51:40.701 due to insufficient monitor window data within 100 minutes of perigee
2026-04-25 08:34:11,877 get_kalman_drops_nman: Skipping NMAN from 2026:071:13:48:41.127 to 2026:071:13:50:06.202 due to insufficient monitor window data within 100 minutes of perigee
2026-04-25 08:34:11,898 get_kalman_drops_nman: Skipping NMAN from 2026:076:20:00:25.757 to 2026:076:20:01:35.457 due to insufficient monitor window data within 100 minutes of perigee
2026-04-25 08:34:11,937 get_kalman_drops_nman: Skipping NMAN from 2026:084:18:34:50.077 to 2026:084:18:38:35.577 due to insufficient monitor window data within 100 minutes of perigee
2026-04-25 08:34:11,980 get_kalman_drops_nman: Skipping NMAN from 2026:090:01:21:41.083 to 2026:090:01:25:56.308 due to insufficient monitor window data within 100 minutes of perigee
2026-04-25 08:34:12,083 get_kalman_drops_nman: Skipping NMAN from 2026:111:05:33:26.279 to 2026:111:05:38:05.079 due to insufficient monitor window data within 100 minutes of perigee
2026-04-25 07:34:12,579 _get_tlm: Getting telemetry for 2026:071:12:41:57.120
2026-04-25 07:34:13,276 obss: Getting observations from kadi commands for 2026/Mar-12
2026-04-25 07:34:13,288 _get_tlm: Getting telemetry for 2026:074:04:09:29.826
2026-04-25 07:34:13,546 obss: Getting observations from kadi commands for 2026/Mar-15
2026-04-25 07:34:13,561 _get_tlm: Getting telemetry for 2026:076:19:36:34.978
2026-04-25 07:34:13,804 obss: Getting observations from kadi commands for 2026/Mar-17
2026-04-25 07:34:13,817 _get_tlm: Getting telemetry for 2026:079:11:03:52.694
2026-04-25 07:34:14,057 obss: Getting observations from kadi commands for 2026/Mar-20
2026-04-25 07:34:14,070 _get_tlm: Getting telemetry for 2026:082:02:32:10.520
2026-04-25 07:34:14,313 obss: Getting observations from kadi commands for 2026/Mar-23
2026-04-25 07:34:14,324 _get_tlm: Getting telemetry for 2026:084:18:01:03.087
2026-04-25 07:34:14,579 obss: Getting observations from kadi commands for 2026/Mar-25
2026-04-25 07:34:14,593 _get_tlm: Getting telemetry for 2026:087:09:29:33.757
2026-04-25 07:34:14,855 obss: Getting observations from kadi commands for 2026/Mar-28
2026-04-25 07:34:14,869 _get_tlm: Getting telemetry for 2026:090:00:57:20.919
2026-04-25 07:34:15,184 obss: Getting observations from kadi commands for 2026/Mar-31
2026-04-25 07:34:15,194 _get_tlm: Getting telemetry for 2026:092:16:24:41.004
2026-04-25 07:34:15,433 obss: Getting observations from kadi commands for 2026/Apr-02
2026-04-25 07:34:15,443 _get_tlm: Getting telemetry for 2026:095:07:52:03.676
2026-04-25 07:34:15,683 obss: Getting observations from kadi commands for 2026/Apr-05
2026-04-25 07:34:15,696 _get_tlm: Getting telemetry for 2026:097:23:19:48.174
2026-04-25 07:34:16,180 obss: Getting observations from kadi commands for 2026/Apr-07
2026-04-25 07:34:16,194 _get_tlm: Getting telemetry for 2026:100:14:47:35.160
2026-04-25 07:34:16,444 obss: Getting observations from kadi commands for 2026/Apr-10
2026-04-25 07:34:16,457 _get_tlm: Getting telemetry for 2026:103:06:14:57.453
2026-04-25 07:34:16,693 obss: Getting observations from kadi commands for 2026/Apr-13
2026-04-25 07:34:16,707 _get_tlm: Getting telemetry for 2026:105:21:42:12.836
2026-04-25 07:34:17,226 obss: Getting observations from kadi commands for 2026/Apr-15
2026-04-25 07:34:17,241 _get_tlm: Getting telemetry for 2026:108:13:10:18.144
2026-04-25 07:34:17,475 obss: Getting observations from kadi commands for 2026/Apr-18
2026-04-25 07:34:17,489 _get_tlm: Getting telemetry for 2026:111:04:39:17.091
2026-04-25 07:34:17,745 obss: Getting observations from kadi commands for 2026/Apr-21
2026-04-25 07:34:17,758 _get_tlm: Getting telemetry for 2026:113:20:08:06.571
2026-04-25 07:34:18,006 obss: Getting observations from kadi commands for 2026/Apr-23
2026-04-25 07:34:25,710 get_color_marker_for_perigee_plotly: Perigee 2026:071:12:41:57.120 color='rgb(229, 134, 6)' marker='circle'
2026-04-25 07:34:25,710 get_color_marker_for_perigee_plotly: Perigee 2026:074:04:09:29.826 color='rgb(93, 105, 177)' marker='square'
2026-04-25 07:34:25,710 get_color_marker_for_perigee_plotly: Perigee 2026:076:19:36:34.978 color='rgb(82, 188, 163)' marker='diamond'
2026-04-25 07:34:25,711 get_color_marker_for_perigee_plotly: Perigee 2026:079:11:03:52.694 color='rgb(153, 201, 69)' marker='triangle-up'
2026-04-25 07:34:25,711 get_color_marker_for_perigee_plotly: Perigee 2026:082:02:32:10.520 color='rgb(204, 97, 176)' marker='triangle-down'
2026-04-25 07:34:25,711 get_color_marker_for_perigee_plotly: Perigee 2026:084:18:01:03.087 color='rgb(36, 121, 108)' marker='triangle-left'
2026-04-25 07:34:25,711 get_color_marker_for_perigee_plotly: Perigee 2026:087:09:29:33.757 color='rgb(218, 165, 27)' marker='triangle-right'
2026-04-25 07:34:25,711 get_color_marker_for_perigee_plotly: Perigee 2026:090:00:57:20.919 color='rgb(47, 138, 196)' marker='circle'
2026-04-25 07:34:25,712 get_color_marker_for_perigee_plotly: Perigee 2026:092:16:24:41.004 color='rgb(118, 78, 159)' marker='square'
2026-04-25 07:34:25,712 get_color_marker_for_perigee_plotly: Perigee 2026:095:07:52:03.676 color='rgb(237, 100, 90)' marker='diamond'
2026-04-25 07:34:25,712 get_color_marker_for_perigee_plotly: Perigee 2026:097:23:19:48.174 color='rgb(165, 170, 153)' marker='triangle-up'
2026-04-25 07:34:25,712 get_color_marker_for_perigee_plotly: Perigee 2026:100:14:47:35.160 color='rgb(229, 134, 6)' marker='triangle-down'
2026-04-25 07:34:25,712 get_color_marker_for_perigee_plotly: Perigee 2026:103:06:14:57.453 color='rgb(93, 105, 177)' marker='triangle-left'
2026-04-25 07:34:25,713 get_color_marker_for_perigee_plotly: Perigee 2026:105:21:42:12.836 color='rgb(82, 188, 163)' marker='triangle-right'
2026-04-25 07:34:25,713 get_color_marker_for_perigee_plotly: Perigee 2026:108:13:10:18.144 color='rgb(153, 201, 69)' marker='circle'
2026-04-25 07:34:25,713 get_color_marker_for_perigee_plotly: Perigee 2026:111:04:39:17.091 color='rgb(204, 97, 176)' marker='square'
2026-04-25 07:34:25,713 get_color_marker_for_perigee_plotly: Perigee 2026:113:20:08:06.571 color='rgb(36, 121, 108)' marker='diamond'
2026-04-25 07:34:25,713 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-04-25 07:34:26,483 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-04-25 08:34:29,180 main: Overriding starting time with the time of latest low-kalman event
2026-04-25 08:34:29,180 get_lowkals_new: Getting telemetry between 2026:114:02:18:13.053 and 2026:115:12:34:29.173
2026-04-25 08:34:29,736 get_lowkals_new: Finding intervals of low kalman stars
2026-04-25 08:34:29,759 get_lowkals_new: Last telemetry date: 2026:115:03:13:21.058
2026-04-25 08:34:29,762 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-04-25 08:34:30,072 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:114:02:18:13.053 2026:115:12:34:29.173