MTA Weekly Report Generator

Description

This script creates the weekly report. It creates 95% of the part, most of the time 100%, but occsionally you may want to edit trending and also radiation environment entries.

Location of Scripts and Their Names

Location: /data/mta/Script/Weekly/Scripts/

GitHub Address: https://github.com/chandra-mta/MTA

Script Name	Last Updated
weekly_wrap_script	Mar 15, 2021
weekly_main_script	Mar 15, 2021
create_weekly_report.py	Mar 15, 2021
find_focal_temp_peaks.py	Mar 15, 2021
create_bad_pixel_table.py	Mar 15, 2021
create_telem_table.py	Mar 15, 2021
REPLACETHISLIN
find_recent_observations.py	Mar 15, 2021
plot_acis_focal_temp.py	Mar 15, 2021
Retired
Telem/run_all	Sep 10, 2015
create_telem_table.py	Sep 23, 2019
Telem/complete_telem.perl	Sep 10, 2015
Telem/weekly_telem.pro	Sep 10, 2015
Telem/telem.pl	Sep 10, 2015
Telem/zx_find_error.perl	Sep 10, 2015
Telem/zx_remove.perl	Sep 10, 2015
Telem/reduce_entry.perl	Sep 14, 2015
/data/mta4/MTA/bin/weekly_obs2html.pl	Mar 09, 2007
Focal/run_temp	Sep 11, 2015
Focal/get_ftemp_data.perl	Sep 16, 2015
Focal/plot_erad_time.pro	Updated Weekly

Please read README file for more details. /data/mta/Script/Weekly/README.

Sep 16, 2015	Initially logged
Jan 08, 2016	Year change bug fixed.
Feb 01, 2016	find_focal_temp_peaks.py added: new script to determine focal temp peak profile
Feb 05, 2016	find_focal_temp_peaks.py period adjusted
Feb 26, 2016	find_focal_temp_peaks.py modified to adept an iregular input
Mar 11, 2016	find_focal_temp_peaks.py a mior bug fixed
Apr 08, 2016	find_focal_temp_peaks.py a mior bug fixed
May 27, 2016	find_focal_temp_peaks.py date shifted to start Wed
Jul 23, 2018	find_focal_temp_peaks.py updated
Jul 23, 2018	plot_acis_focal_temp.py replaced focal plane plotting routines
Jul 27, 2018	plot_acis_focal_temp.py a weekly link bug fixed
Jul 27, 2018	new iru plot links added (create_weekly_report.py and this_week)
Aug 03, 2018	minor adjustment on find_focal_temp_peaks.py
Sep 28, 2018	a bug finding the peak selecting fixed: find_focal_temp_peaks.py
Oct 03, 2018	create_weekly_report.py is now pointing new Trending page
Apr 25, 2019	create_weekly_report.py: cti input format change
Aug 23, 2019	find_focal_temp_peaks.py missing last peak bug fixed
Sep 13, 2019	find_focal_temp_peaks.py missing last peak more modification
Sep 23, 2019
Telemetry table is now created with a python script
Feb 03, 2020
Trending format changed
Feb 07, 2020
Trending format changed; bug fixed
Apr 03, 2020
Major update: converted everything into python3.6
Jan 22, 2021
acis.mit.edu --> acisweb.mit.edu
Mar 15, 2021
python3.8 update

Data Needed

Dataseeker data (dataseek_avg.fits, dataseek_deahk_temp.0.fits)
/data/mta4/www/DAILY/mta_derive/*.html (see /data/mta/Script/Weekly/Templates/trending_order/)
/data/mta/www/mp_reports/events/*/*/event.html
/data/mta/Script/ACIS/Bad_pixels/Data/Disp_dir/ccd*_information
/data/mta_www/mta_cti/Plot_adjust/fitting_result
/data/mta_www/mta_sim/wksum.html
/data/mta/Script/Weekly/Templates/trending_order
/data/mta/Script/Weekly/Templates/Headers/*
/data/mta/Script/Weekly/Templates/Headers/Dsave/*

Environment Setting

setascds
setenv PYTHONPATH "/data/mta/Script/Python3.8/envs/ska3-shiny/lib/python3.8/site-packages:/data/mta/Script/Python3.8/lib/python3.8/site-packages/"
setenv IDL_PATH "+/usr/local/rsi/user_contrib/astron_Oct09/pro:+/home/mta/IDL:/home/nadams/pros:+/data/swolk/idl_libs:/home/mta/IDL/tara:widget_tools:utilities:event_browser"

Output Locations and File Names

/data/mta4/www/REPORTS/<yyyy>/<mmdd>.html
/data/mta4/www/REPORTS/<yyyy>/<mmdd>_fptemp.gif

How to Run the Script(s)

go to: /data/mta/Script/Weekly/Templates/Headers/Dsave
find which one will be on this week's report (from /data/mta/Script/Weekly/Templates/trending_order)
add or remove msids from the list
go to /data/mta/Script/Weekly/
setascds
setenv PYTHONPATH "/data/mta/Script/Python3.8/envs/ska3-shiny/lib/python3.8/site-packages:/data/mta/Script/Python3.8/lib/python3.8/site-packages/"
setenv IDL_PATH "+/usr/local/rsi/user_contrib/astron_Oct09/pro:+/home/mta/IDL:/home/nadams/pros:+/data/swolk/idl_libs:/home/mta/IDL/tara:widget_tools:utilities:event_browser"
run: create_weekly_report.py <mmdd> <yyyy>
where <mmdd> is e.g., 0910 and <yyyy> is e.g., 2015
edit /data/mta4/www/REPORTS/index.html and addd the link

How to Run Test(s)

in create_weekly_report.py, change debug=1. This will create output directory Test.
run: create_weekly_report.py 0910 2015
compare the results with that of ./Templates/Test_results/ (the result will not be exactly the same as it will pick up the current data).

Expected result from the test

See ./Templates/Test_results/

Cron Job

mta on boba-v

15 23 * * 4 cd /data/mta/Script/Weekly; /data/mta/Script/Weekly/weekly_wrap_script >> $HOME/Logs/weekly_report.cron 2>&1

Web Addreess

https://cxc.cfa.harvard.edu/mta/REPORTS/weekly.html

Note

None

Future Plan/Update Schedule

None