Prev
Index
Next
mica: Mon Apr 21 09:17:42 2025
File: /proj/sot/ska/data/mica/logs/daily.0/mica_archive.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| mica |
NOT OK
|
0.06 | 2.0 |
Mon Apr 21 09:17:42 2025 |
Errors:
- Line 348: <<2025-Apr-21 09:14>> Skipping obsid 29928: disk I/O error
- Line 348: <<2025-Apr-21 09:14>> Skipping obsid 29928: disk I/O error
- Line 350: <<2025-Apr-21 09:14>> Skipping obsid 27993: disk I/O error
- Line 350: <<2025-Apr-21 09:14>> Skipping obsid 27993: disk I/O error
- Line 352: <<2025-Apr-21 09:14>> Skipping obsid 30179: disk I/O error
- Line 352: <<2025-Apr-21 09:14>> Skipping obsid 30179: disk I/O error
- Line 354: <<2025-Apr-21 09:14>> Skipping obsid 30084: disk I/O error
- Line 354: <<2025-Apr-21 09:14>> Skipping obsid 30084: disk I/O error
- Line 356: <<2025-Apr-21 09:14>> Skipping obsid 30905: disk I/O error
- Line 356: <<2025-Apr-21 09:14>> Skipping obsid 30905: disk I/O error
- Line 358: <<2025-Apr-21 09:14>> Skipping obsid 28115: disk I/O error
- Line 358: <<2025-Apr-21 09:14>> Skipping obsid 28115: disk I/O error
- Line 360: <<2025-Apr-21 09:14>> Skipping obsid 42488: disk I/O error
- Line 360: <<2025-Apr-21 09:14>> Skipping obsid 42488: disk I/O error
- Line 362: <<2025-Apr-21 09:14>> Skipping obsid 42487: disk I/O error
- Line 362: <<2025-Apr-21 09:14>> Skipping obsid 42487: disk I/O error
- Line 364: <<2025-Apr-21 09:14>> Skipping obsid 42486: disk I/O error
- Line 364: <<2025-Apr-21 09:14>> Skipping obsid 42486: disk I/O error
- Line 366: <<2025-Apr-21 09:14>> Skipping obsid 42485: disk I/O error
- Line 366: <<2025-Apr-21 09:14>> Skipping obsid 42485: disk I/O error
- Line 368: <<2025-Apr-21 09:14>> Skipping obsid 42484: disk I/O error
- Line 368: <<2025-Apr-21 09:14>> Skipping obsid 42484: disk I/O error
- Line 370: <<2025-Apr-21 09:14>> Skipping obsid 42483: disk I/O error
- Line 370: <<2025-Apr-21 09:14>> Skipping obsid 42483: disk I/O error
- Line 372: <<2025-Apr-21 09:14>> Skipping obsid 28322: disk I/O error
- Line 372: <<2025-Apr-21 09:14>> Skipping obsid 28322: disk I/O error
- Line 374: <<2025-Apr-21 09:14>> Skipping obsid 29782: disk I/O error
- Line 374: <<2025-Apr-21 09:14>> Skipping obsid 29782: disk I/O error
- Line 376: <<2025-Apr-21 09:14>> Skipping obsid 42482: disk I/O error
- Line 376: <<2025-Apr-21 09:14>> Skipping obsid 42482: disk I/O error
- Line 378: <<2025-Apr-21 09:14>> Skipping obsid 30902: disk I/O error
- Line 378: <<2025-Apr-21 09:14>> Skipping obsid 30902: disk I/O error
- Line 380: <<2025-Apr-21 09:14>> Skipping obsid 28234: disk I/O error
- Line 380: <<2025-Apr-21 09:14>> Skipping obsid 28234: disk I/O error
- Line 382: <<2025-Apr-21 09:14>> Skipping obsid 42481: disk I/O error
- Line 382: <<2025-Apr-21 09:14>> Skipping obsid 42481: disk I/O error
- Line 384: <<2025-Apr-21 09:14>> Skipping obsid 30899: disk I/O error
- Line 384: <<2025-Apr-21 09:14>> Skipping obsid 30899: disk I/O error
- Line 386: <<2025-Apr-21 09:14>> Skipping obsid 28695: disk I/O error
- Line 386: <<2025-Apr-21 09:14>> Skipping obsid 28695: disk I/O error
- Line 388: <<2025-Apr-21 09:14>> Skipping obsid 30900: disk I/O error
- Line 388: <<2025-Apr-21 09:14>> Skipping obsid 30900: disk I/O error
- Line 390: <<2025-Apr-21 09:14>> Skipping obsid 30895: disk I/O error
- Line 390: <<2025-Apr-21 09:14>> Skipping obsid 30895: disk I/O error
- Line 392: <<2025-Apr-21 09:14>> Skipping obsid 42480: disk I/O error
- Line 392: <<2025-Apr-21 09:14>> Skipping obsid 42480: disk I/O error
- Line 394: <<2025-Apr-21 09:14>> Skipping obsid 28577: disk I/O error
- Line 394: <<2025-Apr-21 09:14>> Skipping obsid 28577: disk I/O error
- Line 396: <<2025-Apr-21 09:14>> Skipping obsid 42479: disk I/O error
- Line 396: <<2025-Apr-21 09:14>> Skipping obsid 42479: disk I/O error
- Line 398: <<2025-Apr-21 09:14>> Skipping obsid 42478: disk I/O error
- Line 398: <<2025-Apr-21 09:14>> Skipping obsid 42478: disk I/O error
- Line 400: <<2025-Apr-21 09:14>> Skipping obsid 42477: disk I/O error
- Line 400: <<2025-Apr-21 09:14>> Skipping obsid 42477: disk I/O error
- Line 402: <<2025-Apr-21 09:14>> Skipping obsid 42476: disk I/O error
- Line 402: <<2025-Apr-21 09:14>> Skipping obsid 42476: disk I/O error
- Line 404: <<2025-Apr-21 09:14>> Skipping obsid 30112: disk I/O error
- Line 404: <<2025-Apr-21 09:14>> Skipping obsid 30112: disk I/O error
- Line 406: <<2025-Apr-21 09:14>> Skipping obsid 42475: disk I/O error
- Line 406: <<2025-Apr-21 09:14>> Skipping obsid 42475: disk I/O error
- Line 408: <<2025-Apr-21 09:14>> Skipping obsid 28762: disk I/O error
- Line 408: <<2025-Apr-21 09:14>> Skipping obsid 28762: disk I/O error
- Line 410: <<2025-Apr-21 09:14>> Skipping obsid 42474: disk I/O error
- Line 410: <<2025-Apr-21 09:14>> Skipping obsid 42474: disk I/O error
- Line 412: <<2025-Apr-21 09:14>> Skipping obsid 30903: disk I/O error
- Line 412: <<2025-Apr-21 09:14>> Skipping obsid 30903: disk I/O error
- Line 414: <<2025-Apr-21 09:14>> Skipping obsid 42473: disk I/O error
- Line 414: <<2025-Apr-21 09:14>> Skipping obsid 42473: disk I/O error
- Line 416: <<2025-Apr-21 09:14>> Skipping obsid 30897: disk I/O error
- Line 416: <<2025-Apr-21 09:14>> Skipping obsid 30897: disk I/O error
- Line 418: <<2025-Apr-21 09:14>> Skipping obsid 42472: disk I/O error
- Line 418: <<2025-Apr-21 09:14>> Skipping obsid 42472: disk I/O error
- Line 420: <<2025-Apr-21 09:14>> Skipping obsid 30904: disk I/O error
- Line 420: <<2025-Apr-21 09:14>> Skipping obsid 30904: disk I/O error
- Line 422: <<2025-Apr-21 09:14>> Skipping obsid 42471: disk I/O error
- Line 422: <<2025-Apr-21 09:14>> Skipping obsid 42471: disk I/O error
- Line 424: <<2025-Apr-21 09:14>> Skipping obsid 30898: disk I/O error
- Line 424: <<2025-Apr-21 09:14>> Skipping obsid 30898: disk I/O error
- Line 426: <<2025-Apr-21 09:14>> Skipping obsid 42470: disk I/O error
- Line 426: <<2025-Apr-21 09:14>> Skipping obsid 42470: disk I/O error
- Line 428: <<2025-Apr-21 09:14>> Skipping obsid 28728: disk I/O error
- Line 428: <<2025-Apr-21 09:14>> Skipping obsid 28728: disk I/O error
- Line 430: <<2025-Apr-21 09:14>> Skipping obsid 30457: disk I/O error
- Line 430: <<2025-Apr-21 09:14>> Skipping obsid 30457: disk I/O error
- Line 432: <<2025-Apr-21 09:14>> Skipping obsid 42469: disk I/O error
- Line 432: <<2025-Apr-21 09:14>> Skipping obsid 42469: disk I/O error
- Line 434: <<2025-Apr-21 09:14>> Skipping obsid 30901: disk I/O error
- Line 434: <<2025-Apr-21 09:14>> Skipping obsid 30901: disk I/O error
- Line 823: <<2025-Apr-21 09:17>> Traceback (most recent call last):
- Line 847: <<2025-Apr-21 09:17>> TimeoutError: The read operation timed out
- Line 847: <<2025-Apr-21 09:17>> TimeoutError: The read operation timed out
- Line 849: <<2025-Apr-21 09:17>> The above exception was the direct cause of the following exception:
- Line 851: <<2025-Apr-21 09:17>> Traceback (most recent call last):
- Line 859: <<2025-Apr-21 09:17>> raise reraise(type(error), error, _stacktrace)
- Line 859: <<2025-Apr-21 09:17>> raise reraise(type(error), error, _stacktrace)
- Line 869: <<2025-Apr-21 09:17>> raise ReadTimeoutError(
- Line 869: <<2025-Apr-21 09:17>> raise ReadTimeoutError(
- Line 870: <<2025-Apr-21 09:17>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)
- Line 870: <<2025-Apr-21 09:17>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)
- Line 870: <<2025-Apr-21 09:17>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)
- Line 872: <<2025-Apr-21 09:17>> During handling of the above exception, another exception occurred:
- Line 874: <<2025-Apr-21 09:17>> Traceback (most recent call last):
- Line 906: <<2025-Apr-21 09:17>> requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)
File contents:
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_obspar.py
############################################################
<<2025-Apr-21 08:02>> using 114235 for last_id
<<2025-Apr-21 08:02>> running get_arch for obsid 30898 run on Apr 20 2025 12:33AM
<<2025-Apr-21 08:02>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/30/30898_v01
<<2025-Apr-21 08:02>> retrieving data for 30898 in /fido.real/conda/envs/ska3-mica/data/mica/archive/tempobs/tmptkfz_5xv
<<2025-Apr-21 08:02>> linking 30898_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/30/30898
<<2025-Apr-21 08:02>> updating archfiles default rev to 1 for 30898
<<2025-Apr-21 08:02>> running get_arch for obsid 28728 run on Apr 20 2025 12:33AM
<<2025-Apr-21 08:02>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/28/28728_v01
<<2025-Apr-21 08:02>> retrieving data for 28728 in /fido.real/conda/envs/ska3-mica/data/mica/archive/tempobs/tmp1vgie7in
<<2025-Apr-21 08:02>> linking 28728_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/28/28728
<<2025-Apr-21 08:02>> updating archfiles default rev to 1 for 28728
<<2025-Apr-21 08:02>> running get_arch for obsid 42470 run on Apr 20 2025 1:00AM
<<2025-Apr-21 08:02>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/42/42470_v01
<<2025-Apr-21 08:02>> retrieving data for 42470 in /fido.real/conda/envs/ska3-mica/data/mica/archive/tempobs/tmp4bgwijut
<<2025-Apr-21 08:02>> linking 42470_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/42/42470
<<2025-Apr-21 08:02>> updating archfiles default rev to 1 for 42470
<<2025-Apr-21 08:02>> running get_arch for obsid 42469 run on Apr 20 2025 8:18AM
<<2025-Apr-21 08:02>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/42/42469_v01
<<2025-Apr-21 08:02>> retrieving data for 42469 in /fido.real/conda/envs/ska3-mica/data/mica/archive/tempobs/tmp13_pxlv3
<<2025-Apr-21 08:02>> linking 42469_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/42/42469
<<2025-Apr-21 08:02>> updating archfiles default rev to 1 for 42469
<<2025-Apr-21 08:02>> running get_arch for obsid 30457 run on Apr 20 2025 8:18AM
<<2025-Apr-21 08:02>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/30/30457_v01
<<2025-Apr-21 08:02>> retrieving data for 30457 in /fido.real/conda/envs/ska3-mica/data/mica/archive/tempobs/tmpt9p95plm
<<2025-Apr-21 08:02>> linking 30457_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/30/30457
<<2025-Apr-21 08:02>> updating archfiles default rev to 1 for 30457
<<2025-Apr-21 08:02>> running get_arch for obsid 30901 run on Apr 20 2025 8:18AM
<<2025-Apr-21 08:02>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/30/30901_v01
<<2025-Apr-21 08:02>> retrieving data for 30901 in /fido.real/conda/envs/ska3-mica/data/mica/archive/tempobs/tmpy99dhvot
<<2025-Apr-21 08:02>> linking 30901_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/obspar/30/30901
<<2025-Apr-21 08:02>> updating archfiles default rev to 1 for 30901
<<2025-Apr-21 08:02>> Checking for updates to obsids with provisional data
<<2025-Apr-21 08:03>> checking database status for obsid 346 obi 0 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 960 obi 0 ver 5,
<<2025-Apr-21 08:03>> checking database status for obsid 52 obi 0 ver 7,
<<2025-Apr-21 08:03>> checking database status for obsid 211 obi 1 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 212 obi 1 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 66 obi 0 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 1463 obi 0 ver 5,
<<2025-Apr-21 08:03>> checking database status for obsid 1309 obi 0 ver 6,
<<2025-Apr-21 08:03>> checking database status for obsid 1508 obi 0 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 1098 obi 0 ver 6,
<<2025-Apr-21 08:03>> checking database status for obsid 1099 obi 1 ver 5,
<<2025-Apr-21 08:03>> checking database status for obsid 2292 obi 0 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 2288 obi 0 ver 5,
<<2025-Apr-21 08:03>> checking database status for obsid 7928 obi 0 ver 3,
<<2025-Apr-21 08:03>> checking database status for obsid 9379 obi 0 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 12181 obi 0 ver 3,
<<2025-Apr-21 08:03>> checking database status for obsid 13142 obi 0 ver 3,
<<2025-Apr-21 08:03>> checking database status for obsid 13141 obi 0 ver 3,
<<2025-Apr-21 08:03>> checking database status for obsid 13455 obi 0 ver 4,
<<2025-Apr-21 08:03>> checking database status for obsid 15703 obi 0 ver 2,
<<2025-Apr-21 08:03>> checking database status for obsid 15070 obi 0 ver 3,
<<2025-Apr-21 08:03>> checking database status for obsid 19421 obi 0 ver 2,
<<2025-Apr-21 08:03>> checking database status for obsid 19436 obi 0 ver 2,
<<2025-Apr-21 08:03>> checking database status for obsid 20325 obi 0 ver 2,
<<2025-Apr-21 08:03>> checking database status for obsid 47063 obi 0 ver 1,
<<2025-Apr-21 08:03>> checking database status for obsid 27599 obi 0 ver 2,
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_aca_l0.py
############################################################
<<2025-Apr-21 08:03>> Fetching new CDA list from 2025:109:14:42:00.000
<<2025-Apr-21 08:03>> URL for fetch https://icxc.harvard.edu/dbtm/CDA/cgi/aspect_fetch.cgi?tstart=04-19-2025&pattern=acaimgc%%25&submit=Search
<<2025-Apr-21 08:03>> Updating /fido.real/conda/envs/ska3-mica/data/mica/archive/aca0/cda_aca0.h5 with 679 new rows
<<2025-Apr-21 08:03>> Fetching ACA L0 Data from 2025:109:21:13:20.000 to 2025:112:02:46:40.000
<<2025-Apr-21 08:04>> Ingested 192 files
<<2025-Apr-21 08:04>> Checking for missing files from 2025:109:14:42:00.000
<<2025-Apr-21 08:04>> No missing files
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_asp_l1.py
############################################################
<<2025-Apr-21 08:04>> using 71373 for last_id
<<2025-Apr-21 08:04>> running get_arch for obsid 28728 run on Apr 20 2025 12:38AM
<<2025-Apr-21 08:04>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/28/28728_v01
<<2025-Apr-21 08:04>> retrieving data for 28728 in /fido.real/conda/envs/ska3-mica/data/mica/archive/temp/tmpz83ur8tk
<<2025-Apr-21 08:04>> linking 28728_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/28/28728
<<2025-Apr-21 08:04>> updating archfiles default rev to 1 for 28728
<<2025-Apr-21 08:04>> Adding asp1 processing for obs 28728
<<2025-Apr-21 08:04>> processing /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/28/28728_v01/pcadf861476768N001_asol1.fits.gz
<<2025-Apr-21 08:04>> Updated table for 28728
<<2025-Apr-21 08:04>> running get_arch for obsid 30898 run on Apr 20 2025 12:38AM
<<2025-Apr-21 08:04>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30898_v01
<<2025-Apr-21 08:04>> retrieving data for 30898 in /fido.real/conda/envs/ska3-mica/data/mica/archive/temp/tmpyz2nhqcz
<<2025-Apr-21 08:04>> linking 30898_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30898
<<2025-Apr-21 08:04>> updating archfiles default rev to 1 for 30898
<<2025-Apr-21 08:04>> Adding asp1 processing for obs 30898
<<2025-Apr-21 08:04>> processing /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30898_v01/pcadf861461967N001_asol1.fits.gz
<<2025-Apr-21 08:04>> Updated table for 30898
<<2025-Apr-21 08:04>> running get_arch for obsid 30457 run on Apr 20 2025 8:23AM
<<2025-Apr-21 08:04>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30457_v01
<<2025-Apr-21 08:04>> retrieving data for 30457 in /fido.real/conda/envs/ska3-mica/data/mica/archive/temp/tmpjvhv4l1z
<<2025-Apr-21 08:04>> linking 30457_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30457
<<2025-Apr-21 08:04>> updating archfiles default rev to 1 for 30457
<<2025-Apr-21 08:04>> Adding asp1 processing for obs 30457
<<2025-Apr-21 08:04>> processing /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30457_v01/pcadf861490540N001_asol1.fits.gz
<<2025-Apr-21 08:04>> Updated table for 30457
<<2025-Apr-21 08:04>> running get_arch for obsid 30901 run on Apr 20 2025 8:23AM
<<2025-Apr-21 08:04>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30901_v01
<<2025-Apr-21 08:04>> retrieving data for 30901 in /fido.real/conda/envs/ska3-mica/data/mica/archive/temp/tmpaprp0uyu
<<2025-Apr-21 08:04>> linking 30901_v01 -> /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30901
<<2025-Apr-21 08:04>> updating archfiles default rev to 1 for 30901
<<2025-Apr-21 08:04>> Adding asp1 processing for obs 30901
<<2025-Apr-21 08:04>> processing /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/30/30901_v01/pcadf861504824N001_asol1.fits.gz
<<2025-Apr-21 08:04>> Updated table for 30901
<<2025-Apr-21 08:04>> Checking for updates to obsids with provisional data
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 2593 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 2586 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 2587 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 3366 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 3367 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 3678 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 3679 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5046 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5047 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5048 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5049 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5961 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5962 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5963 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 5964 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 6447 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 6448 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 6445 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 6446 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 37 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 36 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 1856 'bad_obsid' table
<<2025-Apr-21 08:04>> Skipping obsid asp_l1; in 1855 'bad_obsid' table
<<2025-Apr-21 08:04>> checking database status for obsid 1169 obi 1 ver 4,
<<2025-Apr-21 08:04>> Skipping 1169, obsid 'discarded'
<<2025-Apr-21 08:04>> checking database status for obsid 15703 obi 0 ver 1,
<<2025-Apr-21 08:04>> Skipping 15703, obsid 'discarded'
<<2025-Apr-21 08:04>> checking database status for obsid 22668 obi 1 ver 1,
<<2025-Apr-21 08:04>> Adding asp1 processing for obs 22668
<<2025-Apr-21 08:04>> processing /fido.real/conda/envs/ska3-mica/data/mica/archive/asp1/22/22668_v01/pcadf798846709N001_asol1.fits.gz
<<2025-Apr-21 08:04>> Resetting vv_complete to 0 for obsid 22668 rev 1
<<2025-Apr-21 08:04>> Updated table for 22668
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_starchecks.py
############################################################
<<2025-Apr-21 08:04>> Getting new starcheck.txt files from /data/mpcrit1/mplogs
<<2025-Apr-21 08:05>> Attempting ingest of /data/mpcrit1/mplogs/2025/APR2125/oflsa/starcheck.txt
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_centroid_reports.py
############################################################
<<2025-Apr-21 08:05>> 2025-04-21 07:05:49,462 Reading /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_obsid.dat
<<2025-Apr-21 08:05>> 2025-04-21 07:05:49,867 Reading /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_slot.dat
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,731 Obsid=30781
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,735 Skipping obsid 30781: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,735 Obsid=29928
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,738 Skipping obsid 29928: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,738 Obsid=27993
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,741 Skipping obsid 27993: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,741 Obsid=30179
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,743 Skipping obsid 30179: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,743 Obsid=30084
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,744 Skipping obsid 30084: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,744 Obsid=30905
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,745 Skipping obsid 30905: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,745 Obsid=28115
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,748 Skipping obsid 28115: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,748 Obsid=42488
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,751 Skipping obsid 42488: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,751 Obsid=42487
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,753 Skipping obsid 42487: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,753 Obsid=42486
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,754 Skipping obsid 42486: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,754 Obsid=42485
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,755 Skipping obsid 42485: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,755 Obsid=42484
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,756 Skipping obsid 42484: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,756 Obsid=42483
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,757 Skipping obsid 42483: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,757 Obsid=28322
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,758 Skipping obsid 28322: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,758 Obsid=29782
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,759 Skipping obsid 29782: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,759 Obsid=42482
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,760 Skipping obsid 42482: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,760 Obsid=30902
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,762 Skipping obsid 30902: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,762 Obsid=28234
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,763 Skipping obsid 28234: already processed
<<2025-Apr-21 08:05>> 2025-04-21 07:05:50,763 Obsid=42481
<<2025-Apr-21 08:06>> 2025-04-21 07:06:01,845 Running get_observed_att_errors for 42481
<<2025-Apr-21 08:06>> 2025-04-21 07:06:02,152 Skipping obsid 42481 missing data: No dwell for obsid=42481
<<2025-Apr-21 08:06>> 2025-04-21 07:06:02,153 Obsid=30899
<<2025-Apr-21 08:06>> 2025-04-21 07:06:08,321 Running get_observed_att_errors for 30899
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,562 Running get_observed_att_errors for 42481
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,858 Skipping obsid 30899 missing data: No dwell for obsid=42481
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,858 Obsid=28695
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,859 Skipping obsid 28695: already processed
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,859 Obsid=30900
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,859 Skipping obsid 30900: already processed
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,859 Obsid=30895
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,860 Skipping obsid 30895: already processed
<<2025-Apr-21 08:06>> 2025-04-21 07:06:35,860 Obsid=42480
<<2025-Apr-21 08:06>> 2025-04-21 07:06:41,702 Running get_observed_att_errors for 42480
<<2025-Apr-21 08:06>> 2025-04-21 07:06:41,994 Skipping obsid 42480 missing data: No dwell for obsid=42480
<<2025-Apr-21 08:06>> 2025-04-21 07:06:41,994 Obsid=28577
<<2025-Apr-21 08:06>> 2025-04-21 07:06:47,901 Running get_observed_att_errors for 28577
<<2025-Apr-21 08:06>> 2025-04-21 07:06:53,957 Could not compute crs for 28577 slot 3 (att_source=ground)
<<2025-Apr-21 08:06>> 2025-04-21 07:06:54,329 Could not compute crs for 28577 slot 4 (att_source=ground)
<<2025-Apr-21 08:06>> 2025-04-21 07:06:54,699 Could not compute crs for 28577 slot 5 (att_source=ground)
<<2025-Apr-21 08:06>> 2025-04-21 07:06:55,072 Could not compute crs for 28577 slot 6 (att_source=ground)
<<2025-Apr-21 08:06>> 2025-04-21 07:06:55,445 Could not compute crs for 28577 slot 7 (att_source=ground)
<<2025-Apr-21 08:07>> 2025-04-21 07:07:03,421 No ground aspect solution for 28577. Using obc aspect solution for reference
<<2025-Apr-21 08:07>> 2025-04-21 07:07:19,789 Running get_observed_att_errors for 42480
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,484 Skipping obsid 28577 missing data: No dwell for obsid=42480
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,484 Obsid=42479
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,485 Skipping obsid 42479: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,485 Obsid=42478
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,486 Skipping obsid 42478: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,486 Obsid=42477
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,486 Skipping obsid 42477: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,486 Obsid=42476
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,487 Skipping obsid 42476: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,487 Obsid=30112
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,488 Skipping obsid 30112: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,488 Obsid=42475
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,488 Skipping obsid 42475: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,488 Obsid=28762
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,489 Skipping obsid 28762: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,490 Obsid=42474
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,490 Skipping obsid 42474: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,490 Obsid=30903
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,491 Skipping obsid 30903: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,491 Obsid=42473
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,491 Skipping obsid 42473: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,491 Obsid=30897
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,492 Skipping obsid 30897: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,492 Obsid=42472
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,492 Skipping obsid 42472: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,492 Obsid=30904
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,493 Skipping obsid 30904: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,493 Obsid=42471
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,493 Skipping obsid 42471: already processed
<<2025-Apr-21 08:07>> 2025-04-21 07:07:20,493 Obsid=30898
<<2025-Apr-21 08:07>> 2025-04-21 07:07:32,893 Running get_observed_att_errors for 30898
<<2025-Apr-21 08:08>> 2025-04-21 07:08:03,118 Getting ending roll for 42471 from file
<<2025-Apr-21 08:08>> 2025-04-21 07:08:03,432 Dwell at 2025:109:14:58:18.253
<<2025-Apr-21 08:08>> 2025-04-21 07:08:04,456 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30898/observed_drs_30898.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:05,003 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30898/crs_time_30898.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:11,622 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30898/crs_vis_30898.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:12,321 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30898/n_kalman_30898.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:12,415 Writing index.html for obsid 30898
<<2025-Apr-21 08:08>> 2025-04-21 07:08:12,427 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_obsid.dat
<<2025-Apr-21 08:08>> 2025-04-21 07:08:12,994 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_slot.dat
<<2025-Apr-21 08:08>> 2025-04-21 07:08:14,130 Obsid=42470
<<2025-Apr-21 08:08>> 2025-04-21 07:08:14,131 Skipping obsid 42470: already processed
<<2025-Apr-21 08:08>> 2025-04-21 07:08:14,131 Obsid=28728
<<2025-Apr-21 08:08>> 2025-04-21 07:08:19,800 Running get_observed_att_errors for 28728
<<2025-Apr-21 08:08>> 2025-04-21 07:08:40,109 Getting ending roll for 42470 from file
<<2025-Apr-21 08:08>> 2025-04-21 07:08:40,413 Dwell at 2025:109:19:04:59.254
<<2025-Apr-21 08:08>> 2025-04-21 07:08:41,513 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/28/28728/observed_drs_28728.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:41,684 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/28/28728/crs_time_28728.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:42,367 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/28/28728/crs_vis_28728.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:43,223 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/28/28728/n_kalman_28728.png
<<2025-Apr-21 08:08>> 2025-04-21 07:08:43,328 Writing index.html for obsid 28728
<<2025-Apr-21 08:08>> 2025-04-21 07:08:43,340 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_obsid.dat
<<2025-Apr-21 08:08>> 2025-04-21 07:08:43,838 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_slot.dat
<<2025-Apr-21 08:08>> 2025-04-21 07:08:44,983 Obsid=30457
<<2025-Apr-21 08:08>> 2025-04-21 07:08:50,640 Running get_observed_att_errors for 30457
<<2025-Apr-21 08:09>> 2025-04-21 07:09:10,717 Getting ending roll for 28728 from file
<<2025-Apr-21 08:09>> 2025-04-21 07:09:10,727 More than one entry per 30457. Skipping aber correction
<<2025-Apr-21 08:09>> 2025-04-21 07:09:11,020 Dwell at 2025:109:22:54:31.155
<<2025-Apr-21 08:09>> 2025-04-21 07:09:12,004 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30457/observed_drs_30457.png
<<2025-Apr-21 08:09>> 2025-04-21 07:09:12,162 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30457/crs_time_30457.png
<<2025-Apr-21 08:09>> 2025-04-21 07:09:12,842 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30457/crs_vis_30457.png
<<2025-Apr-21 08:09>> 2025-04-21 07:09:13,548 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30457/n_kalman_30457.png
<<2025-Apr-21 08:09>> 2025-04-21 07:09:13,646 Writing index.html for obsid 30457
<<2025-Apr-21 08:09>> 2025-04-21 07:09:13,658 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_obsid.dat
<<2025-Apr-21 08:09>> 2025-04-21 07:09:14,150 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_slot.dat
<<2025-Apr-21 08:09>> 2025-04-21 07:09:15,434 Obsid=42469
<<2025-Apr-21 08:09>> 2025-04-21 07:09:21,033 Running get_observed_att_errors for 42469
<<2025-Apr-21 08:09>> 2025-04-21 07:09:21,326 Skipping obsid 42469 missing data: No dwell for obsid=42469
<<2025-Apr-21 08:09>> 2025-04-21 07:09:21,326 Obsid=30901
<<2025-Apr-21 08:09>> 2025-04-21 07:09:26,927 Running get_observed_att_errors for 30901
<<2025-Apr-21 08:09>> 2025-04-21 07:09:48,327 Running get_observed_att_errors for 42469
<<2025-Apr-21 08:09>> 2025-04-21 07:09:48,618 Skipping obsid 30901 missing data: No dwell for obsid=42469
<<2025-Apr-21 08:09>> 2025-04-21 07:09:48,618 Obsid=28681
<<2025-Apr-21 08:09>> 2025-04-21 07:09:48,620 Creating directory /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/28/28681
<<2025-Apr-21 08:09>> 2025-04-21 07:09:55,055 Running get_observed_att_errors for 28681
<<2025-Apr-21 08:10>> 2025-04-21 07:10:01,339 Could not compute crs for 28681 slot 3 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:01,722 Could not compute crs for 28681 slot 4 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:02,093 Could not compute crs for 28681 slot 5 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:02,466 Could not compute crs for 28681 slot 6 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:02,836 Could not compute crs for 28681 slot 7 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:11,054 No ground aspect solution for 28681. Using obc aspect solution for reference
<<2025-Apr-21 08:10>> 2025-04-21 07:10:21,085 Running get_observed_att_errors for 30901
<<2025-Apr-21 08:10>> 2025-04-21 07:10:31,826 Dwell at 2025:110:07:29:12.357
<<2025-Apr-21 08:10>> 2025-04-21 07:10:31,943 Skipping science obsid 28681: no ground aspect solution
<<2025-Apr-21 08:10>> 2025-04-21 07:10:31,943 Writing index.html for obsid 28681
<<2025-Apr-21 08:10>> 2025-04-21 07:10:31,946 Obsid=30896
<<2025-Apr-21 08:10>> 2025-04-21 07:10:31,947 Creating directory /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/30/30896
<<2025-Apr-21 08:10>> 2025-04-21 07:10:37,596 Running get_observed_att_errors for 30896
<<2025-Apr-21 08:10>> 2025-04-21 07:10:44,211 Could not compute crs for 30896 slot 3 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:44,868 Could not compute crs for 30896 slot 4 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:45,236 Could not compute crs for 30896 slot 5 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:45,603 Could not compute crs for 30896 slot 6 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:45,972 Could not compute crs for 30896 slot 7 (att_source=ground)
<<2025-Apr-21 08:10>> 2025-04-21 07:10:56,053 No ground aspect solution for 30896. Using obc aspect solution for reference
<<2025-Apr-21 08:11>> 2025-04-21 07:11:00,725 Running get_observed_att_errors for 28681
<<2025-Apr-21 08:11>> 2025-04-21 07:11:01,783 Could not compute crs for 28681 slot 3 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:02,150 Could not compute crs for 28681 slot 4 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:02,526 Could not compute crs for 28681 slot 5 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:02,898 Could not compute crs for 28681 slot 6 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:03,260 Could not compute crs for 28681 slot 7 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:05,632 No ground aspect solution for 28681. Using obc aspect solution for reference
<<2025-Apr-21 08:11>> 2025-04-21 07:11:15,798 Dwell at 2025:110:18:33:36.660
<<2025-Apr-21 08:11>> 2025-04-21 07:11:15,916 Skipping science obsid 30896: no ground aspect solution
<<2025-Apr-21 08:11>> 2025-04-21 07:11:15,916 Writing index.html for obsid 30896
<<2025-Apr-21 08:11>> 2025-04-21 07:11:15,918 Obsid=42468
<<2025-Apr-21 08:11>> 2025-04-21 07:11:15,920 Creating directory /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/42/42468
<<2025-Apr-21 08:11>> 2025-04-21 07:11:21,264 Running get_observed_att_errors for 42468
<<2025-Apr-21 08:11>> 2025-04-21 07:11:36,046 No ground aspect solution for 42468. Using obc aspect solution for reference
<<2025-Apr-21 08:11>> 2025-04-21 07:11:37,154 Running get_observed_att_errors for 30896
<<2025-Apr-21 08:11>> 2025-04-21 07:11:37,816 Could not compute crs for 30896 slot 3 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:38,183 Could not compute crs for 30896 slot 4 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:38,561 Could not compute crs for 30896 slot 5 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:38,926 Could not compute crs for 30896 slot 6 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:39,294 Could not compute crs for 30896 slot 7 (att_source=ground)
<<2025-Apr-21 08:11>> 2025-04-21 07:11:41,606 No ground aspect solution for 30896. Using obc aspect solution for reference
<<2025-Apr-21 08:11>> 2025-04-21 07:11:46,367 Dwell at 2025:110:23:41:55.861
<<2025-Apr-21 08:11>> 2025-04-21 07:11:46,841 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/42/42468/observed_drs_42468.png
<<2025-Apr-21 08:11>> 2025-04-21 07:11:47,010 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/42/42468/crs_time_42468.png
<<2025-Apr-21 08:11>> 2025-04-21 07:11:47,831 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/42/42468/crs_vis_42468.png
<<2025-Apr-21 08:11>> 2025-04-21 07:11:48,504 Writing plot file /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/42/42468/n_kalman_42468.png
<<2025-Apr-21 08:11>> 2025-04-21 07:11:48,609 Writing index.html for obsid 42468
<<2025-Apr-21 08:11>> 2025-04-21 07:11:48,620 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_obsid.dat
<<2025-Apr-21 08:11>> 2025-04-21 07:11:49,110 Writing /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/guide_metrics_slot.dat
<<2025-Apr-21 08:11>> 2025-04-21 07:11:50,243 Obsid=42467
<<2025-Apr-21 08:11>> 2025-04-21 07:11:50,244 Creating directory /proj/sot/ska/www/ASPECT_ICXC/centroid_reports/42/42467
<<2025-Apr-21 08:11>> 2025-04-21 07:11:55,678 Skipping obsid 42467 missing data: No manvr for obsid=42467
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_acq_stats.py
############################################################
<<2025-Apr-21 08:12>> Sleeping
<<2025-Apr-21 09:14>> Processing obsid 29928
<<2025-Apr-21 09:14>> Skipping obsid 29928: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 27993
<<2025-Apr-21 09:14>> Skipping obsid 27993: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30179
<<2025-Apr-21 09:14>> Skipping obsid 30179: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30084
<<2025-Apr-21 09:14>> Skipping obsid 30084: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30905
<<2025-Apr-21 09:14>> Skipping obsid 30905: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28115
<<2025-Apr-21 09:14>> Skipping obsid 28115: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42488
<<2025-Apr-21 09:14>> Skipping obsid 42488: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42487
<<2025-Apr-21 09:14>> Skipping obsid 42487: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42486
<<2025-Apr-21 09:14>> Skipping obsid 42486: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42485
<<2025-Apr-21 09:14>> Skipping obsid 42485: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42484
<<2025-Apr-21 09:14>> Skipping obsid 42484: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42483
<<2025-Apr-21 09:14>> Skipping obsid 42483: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28322
<<2025-Apr-21 09:14>> Skipping obsid 28322: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 29782
<<2025-Apr-21 09:14>> Skipping obsid 29782: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42482
<<2025-Apr-21 09:14>> Skipping obsid 42482: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30902
<<2025-Apr-21 09:14>> Skipping obsid 30902: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28234
<<2025-Apr-21 09:14>> Skipping obsid 28234: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42481
<<2025-Apr-21 09:14>> Skipping obsid 42481: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30899
<<2025-Apr-21 09:14>> Skipping obsid 30899: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28695
<<2025-Apr-21 09:14>> Skipping obsid 28695: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30900
<<2025-Apr-21 09:14>> Skipping obsid 30900: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30895
<<2025-Apr-21 09:14>> Skipping obsid 30895: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42480
<<2025-Apr-21 09:14>> Skipping obsid 42480: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28577
<<2025-Apr-21 09:14>> Skipping obsid 28577: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42479
<<2025-Apr-21 09:14>> Skipping obsid 42479: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42478
<<2025-Apr-21 09:14>> Skipping obsid 42478: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42477
<<2025-Apr-21 09:14>> Skipping obsid 42477: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42476
<<2025-Apr-21 09:14>> Skipping obsid 42476: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30112
<<2025-Apr-21 09:14>> Skipping obsid 30112: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42475
<<2025-Apr-21 09:14>> Skipping obsid 42475: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28762
<<2025-Apr-21 09:14>> Skipping obsid 28762: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42474
<<2025-Apr-21 09:14>> Skipping obsid 42474: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30903
<<2025-Apr-21 09:14>> Skipping obsid 30903: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42473
<<2025-Apr-21 09:14>> Skipping obsid 42473: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30897
<<2025-Apr-21 09:14>> Skipping obsid 30897: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42472
<<2025-Apr-21 09:14>> Skipping obsid 42472: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30904
<<2025-Apr-21 09:14>> Skipping obsid 30904: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42471
<<2025-Apr-21 09:14>> Skipping obsid 42471: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30898
<<2025-Apr-21 09:14>> Skipping obsid 30898: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42470
<<2025-Apr-21 09:14>> Skipping obsid 42470: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28728
<<2025-Apr-21 09:14>> Skipping obsid 28728: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30457
<<2025-Apr-21 09:14>> Skipping obsid 30457: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 42469
<<2025-Apr-21 09:14>> Skipping obsid 42469: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 30901
<<2025-Apr-21 09:14>> Skipping obsid 30901: disk I/O error
<<2025-Apr-21 09:14>> Processing obsid 28681
<<2025-Apr-21 09:14>> Skipping obsid 28681: No obspar for 28681
<<2025-Apr-21 09:14>> Processing obsid 30896
<<2025-Apr-21 09:14>> Skipping obsid 30896: No obspar for 30896
<<2025-Apr-21 09:14>> Processing obsid 42468
<<2025-Apr-21 09:14>> Skipping obsid 42468: No obspar for 42468
<<2025-Apr-21 09:14>> Processing obsid 42467
<<2025-Apr-21 09:14>> Skipping obsid 42467: No obspar for 42467
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_guide_stats.py
############################################################
<<2025-Apr-21 09:14>> Processing obsid 30898
<<2025-Apr-21 09:14>> Found obsid manvr at 2025:109:14:29:28.565
<<2025-Apr-21 09:14>> Found dwell at 2025:109:14:58:18.253
<<2025-Apr-21 09:14>> calculating statistics
<<2025-Apr-21 09:14>> arranging stats into tabular data
<<2025-Apr-21 09:14>> saving stats to h5 table
<<2025-Apr-21 09:14>> Processing obsid 42470
<<2025-Apr-21 09:14>> Found obsid manvr at 2025:109:17:47:32.417
<<2025-Apr-21 09:14>> Found dwell at 2025:109:18:14:04.754
<<2025-Apr-21 09:15>> calculating statistics
<<2025-Apr-21 09:15>> arranging stats into tabular data
<<2025-Apr-21 09:15>> saving stats to h5 table
<<2025-Apr-21 09:15>> Processing obsid 28728
<<2025-Apr-21 09:15>> Found obsid manvr at 2025:109:18:32:29.191
<<2025-Apr-21 09:15>> Found dwell at 2025:109:19:04:59.254
<<2025-Apr-21 09:15>> calculating statistics
<<2025-Apr-21 09:15>> arranging stats into tabular data
<<2025-Apr-21 09:15>> saving stats to h5 table
<<2025-Apr-21 09:15>> Processing obsid 30457
<<2025-Apr-21 09:15>> Found obsid manvr at 2025:109:22:27:11.667
<<2025-Apr-21 09:15>> Found dwell at 2025:109:22:54:31.155
<<2025-Apr-21 09:15>> calculating statistics
<<2025-Apr-21 09:15>> arranging stats into tabular data
<<2025-Apr-21 09:15>> saving stats to h5 table
<<2025-Apr-21 09:15>> Processing obsid 42469
<<2025-Apr-21 09:15>> Skipping obsid 42469: No manvr or dwell for 42469
<<2025-Apr-21 09:15>> Processing obsid 30901
<<2025-Apr-21 09:15>> Found obsid manvr at 2025:110:02:24:01.243
<<2025-Apr-21 09:15>> Found dwell at 2025:110:02:52:35.556
<<2025-Apr-21 09:16>> calculating statistics
<<2025-Apr-21 09:16>> arranging stats into tabular data
<<2025-Apr-21 09:16>> saving stats to h5 table
<<2025-Apr-21 09:16>> Processing obsid 28681
<<2025-Apr-21 09:16>> Skipping obsid 28681: No obspar for 28681
<<2025-Apr-21 09:16>> Processing obsid 30896
<<2025-Apr-21 09:16>> Skipping obsid 30896: No obspar for 30896
<<2025-Apr-21 09:16>> Processing obsid 42468
<<2025-Apr-21 09:16>> Skipping obsid 42468: No obspar for 42468
<<2025-Apr-21 09:16>> Processing obsid 42467
<<2025-Apr-21 09:16>> Skipping obsid 42467: No obspar for 42467
<<2025-Apr-21 09:16>> Processing obsid 42466
<<2025-Apr-21 09:16>> Skipping obsid 42466: No obspar for 42466
<<2025-Apr-21 09:16>> Processing obsid 42465
<<2025-Apr-21 09:16>> Skipping obsid 42465: No obspar for 42465
<<2025-Apr-21 09:16>> Processing obsid 42464
<<2025-Apr-21 09:16>> Skipping obsid 42464: No obspar for 42464
<<2025-Apr-21 09:16>> Processing obsid 42463
<<2025-Apr-21 09:16>> Skipping obsid 42463: No obspar for 42463
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_vv.py
############################################################
<<2025-Apr-21 09:16>> Skipping known bad obsid 1283
<<2025-Apr-21 09:16>> Skipping known bad obsid 1283
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 722
<<2025-Apr-21 09:16>> Skipping known bad obsid 722
<<2025-Apr-21 09:16>> Skipping known bad obsid 721
<<2025-Apr-21 09:16>> Skipping known bad obsid 721
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 21252
<<2025-Apr-21 09:16>> Skipping known bad obsid 21252
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 5542
<<2025-Apr-21 09:16>> Skipping known bad obsid 21252
<<2025-Apr-21 09:16>> Skipping known bad obsid 21252
<<2025-Apr-21 09:16>> Skipping known bad obsid 721
<<2025-Apr-21 09:16>> Skipping known bad obsid 721
<<2025-Apr-21 09:16>> Skipping known bad obsid 722
<<2025-Apr-21 09:16>> Skipping known bad obsid 722
<<2025-Apr-21 09:16>> running VV for obsid 22668 run on 2023-04-25 23:27:01
<<2025-Apr-21 09:16>> Generating V&V for obsid 22668
<<2025-Apr-21 09:16>> Processing aspect interval pcadf798846709N001
<<2025-Apr-21 09:16>> Processing GOOD star in slot 3
<<2025-Apr-21 09:16>> Processing GOOD star in slot 4
<<2025-Apr-21 09:16>> Processing GOOD star in slot 5
<<2025-Apr-21 09:16>> Processing GOOD star in slot 6
<<2025-Apr-21 09:16>> Processing GOOD star in slot 7
<<2025-Apr-21 09:16>> Processing fid HRC-I-1 in slot 0
<<2025-Apr-21 09:16>> Processing fid HRC-I-2 in slot 1
<<2025-Apr-21 09:16>> Processing fid HRC-I-3 in slot 2
<<2025-Apr-21 09:16>> Saved JSON to /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/vv_report.json
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_0_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_0_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_0_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_0_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_0_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_1_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_1_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_1_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_1_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_1_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_2_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_2_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_2_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_2_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_2_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_3_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_3_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_3_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_3_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_3_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_4_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_4_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_4_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_4_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_4_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_5_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_5_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_5_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_5_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_5_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_6_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_6_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_6_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_6_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_6_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_7_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_7_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_7_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_7_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_/slot_7_m.png
<<2025-Apr-21 09:16>> obsid dir /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/22/22668_v01 already exists
<<2025-Apr-21 09:16>> moved VV files to /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/22/22668_v01
<<2025-Apr-21 09:16>> removed directory /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmp60q8nis_
<<2025-Apr-21 09:16>> obsid 22668 is in table
<<2025-Apr-21 09:16>> updating obsid 22668 rev 1 in place
<<2025-Apr-21 09:16>> UPDATE aspect_1_proc set vv_complete = 4
<<2025-Apr-21 09:16>> where obsid = 22668 and revision = 1
<<2025-Apr-21 09:16>> Skipping known bad obsid 1283
<<2025-Apr-21 09:16>> Skipping known bad obsid 1283
<<2025-Apr-21 09:16>> Skipping known bad obsid 29670
<<2025-Apr-21 09:16>> Skipping known bad obsid 29670
<<2025-Apr-21 09:16>> Skipping known bad obsid 30716
<<2025-Apr-21 09:16>> Skipping known bad obsid 30716
<<2025-Apr-21 09:16>> Skipping known bad obsid 29670
<<2025-Apr-21 09:16>> Skipping known bad obsid 29670
<<2025-Apr-21 09:16>> Skipping known bad obsid 30716
<<2025-Apr-21 09:16>> Skipping known bad obsid 30716
<<2025-Apr-21 09:16>> running VV for obsid 28728 run on Apr 20 2025 12:38AM
<<2025-Apr-21 09:16>> Generating V&V for obsid 28728
<<2025-Apr-21 09:16>> Processing aspect interval pcadf861476768N001
<<2025-Apr-21 09:16>> Processing GOOD star in slot 3
<<2025-Apr-21 09:16>> Processing GOOD star in slot 4
<<2025-Apr-21 09:16>> Processing GOOD star in slot 5
<<2025-Apr-21 09:16>> Processing GOOD star in slot 6
<<2025-Apr-21 09:16>> Processing GOOD star in slot 7
<<2025-Apr-21 09:16>> Processing fid ACIS-I-1 in slot 0
<<2025-Apr-21 09:16>> Processing fid ACIS-I-5 in slot 1
<<2025-Apr-21 09:16>> Processing fid ACIS-I-6 in slot 2
<<2025-Apr-21 09:16>> Saved JSON to /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/vv_report.json
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_0_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_0_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_0_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_0_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_0_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_1_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_1_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_1_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_1_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_1_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_2_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_2_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_2_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_2_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_2_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_3_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_3_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_3_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_3_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_3_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_4_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_4_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_4_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_4_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_4_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_5_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_5_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_5_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_5_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_5_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_6_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_6_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_6_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_6_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_6_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_7_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_7_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_7_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_7_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl/slot_7_m.png
<<2025-Apr-21 09:16>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/28/28728_v01
<<2025-Apr-21 09:16>> moved VV files to /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/28/28728_v01
<<2025-Apr-21 09:16>> removed directory /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpweza58yl
<<2025-Apr-21 09:16>> UPDATE aspect_1_proc set vv_complete = 4
<<2025-Apr-21 09:16>> where obsid = 28728 and revision = 1
<<2025-Apr-21 09:16>> running VV for obsid 30898 run on Apr 20 2025 12:38AM
<<2025-Apr-21 09:16>> Generating V&V for obsid 30898
<<2025-Apr-21 09:16>> Processing aspect interval pcadf861461967N001
<<2025-Apr-21 09:16>> Processing GOOD star in slot 3
<<2025-Apr-21 09:16>> Processing GOOD star in slot 4
<<2025-Apr-21 09:16>> Processing GOOD star in slot 5
<<2025-Apr-21 09:16>> Processing GOOD star in slot 6
<<2025-Apr-21 09:16>> Processing GOOD star in slot 7
<<2025-Apr-21 09:16>> Processing fid ACIS-I-1 in slot 0
<<2025-Apr-21 09:16>> Processing fid ACIS-I-2 in slot 1
<<2025-Apr-21 09:16>> Processing fid ACIS-I-6 in slot 2
<<2025-Apr-21 09:16>> Saved JSON to /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/vv_report.json
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_0_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_0_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_0_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_0_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_0_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_1_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_1_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_1_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_1_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_1_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_2_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_2_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_2_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_2_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_2_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_3_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_3_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_3_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_3_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_3_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_4_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_4_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_4_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_4_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_4_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_5_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_5_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_5_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_5_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_5_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_6_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_6_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_6_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_6_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_6_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_7_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_7_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_7_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_7_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_/slot_7_m.png
<<2025-Apr-21 09:16>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/30/30898_v01
<<2025-Apr-21 09:16>> moved VV files to /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/30/30898_v01
<<2025-Apr-21 09:16>> removed directory /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmprm3yu9n_
<<2025-Apr-21 09:16>> UPDATE aspect_1_proc set vv_complete = 4
<<2025-Apr-21 09:16>> where obsid = 30898 and revision = 1
<<2025-Apr-21 09:16>> running VV for obsid 30457 run on Apr 20 2025 8:23AM
<<2025-Apr-21 09:16>> Generating V&V for obsid 30457
<<2025-Apr-21 09:16>> Processing aspect interval pcadf861490540N001
<<2025-Apr-21 09:16>> Processing GOOD star in slot 3
<<2025-Apr-21 09:16>> Processing GOOD star in slot 4
<<2025-Apr-21 09:16>> Processing GOOD star in slot 5
<<2025-Apr-21 09:16>> Processing GOOD star in slot 6
<<2025-Apr-21 09:16>> Processing GOOD star in slot 7
<<2025-Apr-21 09:16>> Processing fid HRC-I-2 in slot 0
<<2025-Apr-21 09:16>> Processing fid HRC-I-3 in slot 1
<<2025-Apr-21 09:16>> Processing fid HRC-I-4 in slot 2
<<2025-Apr-21 09:16>> Saved JSON to /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/vv_report.json
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_0_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_0_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_0_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_0_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_0_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_1_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_1_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_1_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_1_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_1_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_2_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_2_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_2_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_2_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_2_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_3_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_3_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_3_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_3_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_3_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_4_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_4_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_4_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_4_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_4_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_5_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_5_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_5_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_5_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_5_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_6_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_6_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_6_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_6_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_6_m.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_7_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_7_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_7_y.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_7_z.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_/slot_7_m.png
<<2025-Apr-21 09:16>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/30/30457_v01
<<2025-Apr-21 09:16>> moved VV files to /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/30/30457_v01
<<2025-Apr-21 09:16>> removed directory /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmptzr4y2v_
<<2025-Apr-21 09:16>> UPDATE aspect_1_proc set vv_complete = 4
<<2025-Apr-21 09:16>> where obsid = 30457 and revision = 1
<<2025-Apr-21 09:16>> running VV for obsid 30901 run on Apr 20 2025 8:23AM
<<2025-Apr-21 09:16>> Generating V&V for obsid 30901
<<2025-Apr-21 09:16>> Processing aspect interval pcadf861504824N001
<<2025-Apr-21 09:16>> Processing GOOD star in slot 3
<<2025-Apr-21 09:16>> Processing GOOD star in slot 4
<<2025-Apr-21 09:16>> Processing GOOD star in slot 5
<<2025-Apr-21 09:16>> Processing GOOD star in slot 6
<<2025-Apr-21 09:16>> Processing GOOD star in slot 7
<<2025-Apr-21 09:16>> Processing fid ACIS-I-1 in slot 0
<<2025-Apr-21 09:16>> Processing fid ACIS-I-5 in slot 1
<<2025-Apr-21 09:16>> Processing fid ACIS-I-6 in slot 2
<<2025-Apr-21 09:16>> Saved JSON to /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/vv_report.json
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_0_yz.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_0_yzf.png
<<2025-Apr-21 09:16>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_0_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_0_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_0_m.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_1_yz.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_1_yzf.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_1_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_1_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_1_m.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_2_yz.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_2_yzf.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_2_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_2_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_2_m.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_3_yz.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_3_yzf.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_3_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_3_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_3_m.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_4_yz.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_4_yzf.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_4_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_4_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_4_m.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_5_yz.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_5_yzf.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_5_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_5_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_5_m.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_6_yz.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_6_yzf.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_6_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_6_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_6_m.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_7_yz.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_7_yzf.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_7_y.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_7_z.png
<<2025-Apr-21 09:17>> Saved plot /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h/slot_7_m.png
<<2025-Apr-21 09:17>> making directory /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/30/30901_v01
<<2025-Apr-21 09:17>> moved VV files to /fido.real/conda/envs/ska3-mica/data/mica/archive/vv/30/30901_v01
<<2025-Apr-21 09:17>> removed directory /fido.real/conda/envs/ska3-mica/data/mica/archive/tempvv/tmpm2zjje1h
<<2025-Apr-21 09:17>> UPDATE aspect_1_proc set vv_complete = 4
<<2025-Apr-21 09:17>> where obsid = 30901 and revision = 1
############################################################
/fido.real/conda/envs/ska3-mica/share/mica/update_reports.py
############################################################
<<2025-Apr-21 09:17>> Traceback (most recent call last):
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/connectionpool.py", line 537, in _make_request
<<2025-Apr-21 09:17>> response = conn.getresponse()
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/connection.py", line 466, in getresponse
<<2025-Apr-21 09:17>> httplib_response = super().getresponse()
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/http/client.py", line 1390, in getresponse
<<2025-Apr-21 09:17>> response.begin()
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/http/client.py", line 325, in begin
<<2025-Apr-21 09:17>> version, status, reason = self._read_status()
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/http/client.py", line 286, in _read_status
<<2025-Apr-21 09:17>> line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/socket.py", line 706, in readinto
<<2025-Apr-21 09:17>> return self._sock.recv_into(b)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/ssl.py", line 1314, in recv_into
<<2025-Apr-21 09:17>> return self.read(nbytes, buffer)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/ssl.py", line 1166, in read
<<2025-Apr-21 09:17>> return self._sslobj.read(len, buffer)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> TimeoutError: The read operation timed out
<<2025-Apr-21 09:17>>
<<2025-Apr-21 09:17>> The above exception was the direct cause of the following exception:
<<2025-Apr-21 09:17>>
<<2025-Apr-21 09:17>> Traceback (most recent call last):
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
<<2025-Apr-21 09:17>> resp = conn.urlopen(
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
<<2025-Apr-21 09:17>> retries = retries.increment(
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/util/retry.py", line 470, in increment
<<2025-Apr-21 09:17>> raise reraise(type(error), error, _stacktrace)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/util/util.py", line 39, in reraise
<<2025-Apr-21 09:17>> raise value
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
<<2025-Apr-21 09:17>> response = self._make_request(
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/connectionpool.py", line 539, in _make_request
<<2025-Apr-21 09:17>> self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/urllib3/connectionpool.py", line 370, in _raise_timeout
<<2025-Apr-21 09:17>> raise ReadTimeoutError(
<<2025-Apr-21 09:17>> urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)
<<2025-Apr-21 09:17>>
<<2025-Apr-21 09:17>> During handling of the above exception, another exception occurred:
<<2025-Apr-21 09:17>>
<<2025-Apr-21 09:17>> Traceback (most recent call last):
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/share/mica/update_reports.py", line 9, in
<<2025-Apr-21 09:17>> mica.report.update()
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/mica/report/report.py", line 950, in update
<<2025-Apr-21 09:17>> recent_obs = get_states(
<<2025-Apr-21 09:17>> ^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/kadi/commands/states.py", line 2186, in get_states
<<2025-Apr-21 09:17>> cmds = commands.get_cmds(start, stop, scenario=scenario)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/kadi/commands/commands_v2.py", line 235, in get_cmds
<<2025-Apr-21 09:17>> cmds_recent = update_archive_and_get_cmds_recent(
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/kadi/commands/commands_v2.py", line 349, in update_archive_and_get_cmds_recent
<<2025-Apr-21 09:17>> cmd_events = update_cmd_events(scenario)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/kadi/commands/commands_v2.py", line 972, in update_cmd_events
<<2025-Apr-21 09:17>> req = requests.get(url, timeout=30)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/requests/api.py", line 73, in get
<<2025-Apr-21 09:17>> return request("get", url, params=params, **kwargs)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/requests/api.py", line 59, in request
<<2025-Apr-21 09:17>> return session.request(method=method, url=url, **kwargs)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
<<2025-Apr-21 09:17>> resp = self.send(prep, **send_kwargs)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
<<2025-Apr-21 09:17>> r = adapter.send(request, **kwargs)
<<2025-Apr-21 09:17>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<<2025-Apr-21 09:17>> File "/fido.real/conda/envs/ska3-mica/lib/python3.11/site-packages/requests/adapters.py", line 532, in send
<<2025-Apr-21 09:17>> raise ReadTimeout(e, request=request)
<<2025-Apr-21 09:17>> requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='docs.google.com', port=443): Read timed out. (read timeout=30)