ACIS SIB

Description

This set of scripts extracts ACIS SIB data and plots their trends.

Location of Scripts and Their Names

Location:

/data/mta/Script/ACIS/SIB/Correct_excess/Scripts

GitHub Address: https://github.com/chandra-mta/MTA

ccd_comb_plot.py	Mar 03, 2021
update_html.py	Mar 03, 2021
run_evt_script.py	Mar 03, 2021
sib_corr_functions.py	Mar 03, 2021
exclude_srouces.py	Mar 03, 2021
create_sib_data.py	Mar 03, 2021
run_extract_evt1_wrap_script	Mar 03, 2021
run_extract_evt1_main_script	Mar 03, 2021
run_extract_evt2_wrap_script	Mar 03, 2021
run_extract_evt2_main_script	Mar 03, 2021
run_create_wrap_script	Mar 03, 2021
run_create_main_script	Mar 03, 2021

Following scripts are retired or replaced with scripts in the above list

wrap_script	Feb 24, 2010
main_script	Feb 24, 2010
process_evt1.perl	Apr 22, 2013
process_evt2.perl	Apr 23, 2013
exclude_srouces.perl	Jun 03, 2013
sib_corr_comp_sib.perl	Apr 22, 2013
correct_factor.perl	Feb 12, 2010
find_excess_file.perl	Feb 11, 2010
move_exess_list.perl	May 02, 2014
sib_corr_comb.perl	Apr 22, 2013
DBI.py	Apr 07, 2016
OcatSQL.py	Apr 07, 2016
run_create_evt1_wrap_script	Sep 18, 2915
run_create_evt1_main_script	Sep 18, 2915
run_extract_evt1_wrap_script	Sep 17, 2915
run_extract_evt1_main_script	Sep 17, 2915
run_create_evt2_wrap_script	Sep 18, 2915
run_create_evt2_main_script	Sep 18, 2915
run_extract_evt2_wrap_script	Sep 17, 2915
run_extract_evt2_main_script	Sep 17, 2915
run_evt1_script.py	Sep 17, 2915
run_evt2_script.py	Sep 17, 2915
create_sib_data_evt1.py	Sep 18, 2915
create_sib_data_evt2.py	Sep 18, 2915

Please read README file for more details. /data/mta/Script/ACIS/SIB/Correct_excess/Sib_corr/README

Sep 16, 2014	Initially logged
Sep 18, 2015	Converted to cron job
Apr 07, 2016	All scripts are rewritten in python
Oct 24, 2016	ska environment setting updated
Jan 03, 2018	error handling updated
Jul 03, 2019	Python3.6 update
Jul 11, 2019	sib_corr_functions.py; acis_obs table access modified
Aug 05, 2019	run_evt_script.py/sib_corr_functions.py; acis_obs table access modified
Oct 03, 2019	run_evt_script.py: data collection interval bug fixed
Jan 03, 2020	create_sib_data.py: date format problem fixed
Mar 03, 2021	Python3.8 update

Data Needed

acis evt1 and evt2 fits files extracted by arc5gl from archive.
sybase database access

Environment Setting

setenv PYTHONPATH "/data/mta/Script/Python3.6/envs/ska3/lib/python3.6/site-packages:/data/mta/Script/Python3.6/lib/python3.6/site-packages/"

Output Locations and File Names

/data/mta/Script/ACIS/SIB/Data/Lev1/Data_<year>_<month>/
- lres_ccd<ccd#>_merged.fits.gz
/data/mta/Script/ACIS/SIB/Data/Lev2/Data_<year>_<month>/
- lres_ccd<ccd#>_merged.fits.gz
/data/mta_www/mta_sib/Plots/Plot_<year>_<month>/
- combined_month_plot_ccd<ccd#>.png
- month_ccd<ccd#>.png

How to Run the Script(s)

Following describe manual processs.

go to: cd /data/mta/Script/Sib/Correct_excess/
run: /data/mta/Script/ACIS/SIB/Scripts/run_evt_script.py Lev1
run: /data/mta/Script/ACIS/SIB/Scripts/run_evt_script.py Lev2
run: /data/mta/Script/ACIS/SIB/Scripts/create_sib_data.py

How to Run Test(s)

Test is not available for this set of scripts.

Expected result from the test

test results -- test results -- test results

Cron Job

CPU:	c3po-v
User:	mta

35 22 * * * cd /data/mta/Script/ACIS/SIB/Correct_excess/Lev1; /data/mta/Script/ACIS/SIB/Correct_excess/Sib_corr/run_extract_evt1_wrap_script>> $HOME/Logs/sib_lev1_data.cron
14 5 * * * cd /data/mta/Script/ACIS/SIB/Correct_excess/Lev1; rm -rf *fits*

35 20 2,10,20,30 * * cd /data/mta/Script/ACIS/SIB/Correct_excess/Lev2; /data/mta/Script/ACIS/SIB/Correct_excess/Sib_corr/run_extract_evt2_wrap_script>> $HOME/Logs/sib_lev2_data.cron
14 3 * * * cd /data/mta/Script/ACIS/SIB/Correct_excess/Lev2; rm -rf *fits*

15 4 3 * * cd /data/mta/Script/ACIS/SIB/Correct_excess/; /data/mta/Script/ACIS/SIB/Correct_excess/Sib_corr/run_create_wrap_script >> $HOME/Logs/sib_lev2_create.cron

Web Addreess

https://cxc.cfa.harvard.edu/mta_days/mta_sib/sib_main.html

Note

None

Future Plan/Update Schedule

Rewrite all perl scripts by python scripts