Space Weather

Description

All space weather/radiation related scripts are gathered in this location and run in a unified way.

Location of Scripts and Their Names

Location: /data/mta4/Space_Weather

GitHub Address: TBD

Directory List

'/data/mta4/Space_Weather/'                 : spw_dir
'/data/mta4/Space_Weather/house_keeping/'   : house_keeping
'/data/mta4/Space_Weather/Idl_subs/'        : idl_dir
'/data/mta4/Space_Weather/ACE/'             : ace_dir
'/data/mta4/Space_Weather/ALERTS/'          : alerts_dir
'/data/mta4/Space_Weather/KP/'              : kp_dir
'/data/mta4/Space_Weather/GOES/'            : goes_dir
'/data/mta4/Space_Weather/EPHEM/'           : ephem_dir
'/data/mta4/Space_Weather/geopack/'         : geopack_dir
'/data/mta4/Space_Weather/SOHO/'            : soho_dir
'/data/mta4/Space_Weather/TLE/'             : tle_dir
'/data/mta4/Space_Weather/STEREO/'          : stereo_dir
'/data/mta4/Space_Weather/Comm_data/'       : comm_dir
'/data/mta4/Space_Weather/CRM/'             : crm_dir
'/data/mta4/Space_Weather/CRM2/'            : crm2_dir
'/data/mta4/Space_Weather/CRM3/'            : crm3_dir
'/data/mta4/Space_Weather/CRMFLX/'          : crmflx_dir
'/data/mta4/Space_Weather/GSM_plots/'       : gsm_plot_dir
'/data/mta4/Space_Weather/MTA_Rad/'         : mta_dir
'/data/mta4/Space_Weather/ACIS_Rad/'        : acis_dir
'/data/mta4/Space_Weather/XMM/'             : xmm_dir
'/data/mta4/www/RADIATION_new/'             : html_dir
'cxc.cfa.harvard.edu/mta/RADIATION_new/'    : main_web
'ftp.swpc.noaa.gov/pub/lists/'              : noaa_ftp
'ftp.swpc.noaa.gov/pub/lists/ace/'          : ace_ftp
'services.swpc.noaa.gov/'                   : noaa_site
'ftp.gfz-potsdam.de/pub/home/obs/kp-ap/wdc/': kp_site
'/proj/web-cxc/htdocs/'                     : htdocs
'/proj/sot/ska/data/arc/iFOT_events/'       : ifot_dir
'/umtof.umd.edu/pm/'                        : umd_site

ACE

Scripts to monitor the ACE satellite proton fluxes for Chandra operations, plus the associated data files.

Location /data/mta4/Space_Weather/ACE/Scripts/
Script Name Last Updated
ace_wrap_script Mar 16, 2021
ace_main_script Mar 16, 2021
create_ace_html_page.py Mar 16, 2021
plot_p3_data.py Mar 16, 2021
update_ace_data_files.py Mar 16, 2021
compute_fluence_cxo70.py Mar 16, 2021
check_prev_process.py Mar 16, 2021
Retired
ace_long_wrap_script Sep 05, 2018
ace_long_main_script Sep 05, 2018
ace_kp_wrap_script Sep 05, 2018
ace_kp_main_script Sep 05, 2018
get_kp.py Sep 05, 2018
get_long_term_data.py Sep 05, 2018
update_long_term_ace_data.py Nov 06, 2018
fmon.pl Sep 05, 2018

Please read README file for more details.

Nov 06, 2018Data reading bug (read only a half day) fixed
Jan 30, 2019Data table order changed
Jan 30, 2019Plottting color changed
Feb 05, 2019A new valid value screening added
Mar 30, 2020python3.6 udpates
Jan 06, 2021Year change bug fixed
Jan 14, 2021time bug fixed
Jan 19, 2021ace minor update
Feb 04, 2021ace new data existance check added
Feb 11, 2021staled plotting process checker added
Mar 16, 2021python3.8 udpates

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

2,8,13,18,23,28,33,38,43,48,54 * * * * /data/mta4/Space_Weather/ACE/Scripts/ace_wrap_script > /data/mta4/Space_Weather/Test_Logs/ace_main.cron

Web Addreess

http://cxc.cfa.harvard.edu/mta/RADIATION_new/ACE/ace.html

ACIS_Rad

A set of scripts creates ACIS radiation related plots.

Location /data/mta4/Space_Weather/ACIS_Rad/Scripts/
Script Name Last Updated
run_rad_wrap_script Mar 16, 2021
run_rad_main_script Mar 16, 2021
create_config_plot.py Mar 16, 2021
create_rad_cnt_plots.py Mar 16, 2021
create_radiation_realted_plots.py Mar 16, 2021
extract_radiation_data.py Mar 16, 2021
update_html_wrap_script Mar 16, 2021
update_html_main_script Mar 16, 2021
update_html_page.py Mar 16, 2021

Please read README file for more details.

Nov 06, 2018minor update
Feb 04, 2019year change bug fixed
Mar 30, 2020Python3.6 updates
Jan 06, 2021year chage bug fixed
Jan 27, 2021data input checker added
feb 02, 2021early year date conversion bug fixed
Mar 16, 2021Python3.8 updates

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

45 1 * * * cd /data/mta4/Space_Weather/ACIS_Rad/Scripts; run_rad_wrap_script > /data/mta4/Space_Weather/Test_Logs/acis_rad_run_rad.cron
43 1 1 * * cd /data/mta4/Space_Weather/ACIS_Rad/Scripts; update_html_wrap_script > /data/mta4/Space_Weather/Test_Logs/acis_rad_html_page.cron

Web Addreess

https://cxc.cfa.harvard.edu/mta/RADIATION_new/ACIS_Rad/index.html

ALERTS

Update MTA Radiation Environment Summary page: https://cxc.cfa.harvard.edu/mta/alerts/rad_summ.html

Location /data/mta4/Space_Weather/ALERTS/Scripts/
Script Name Last Updated
rad_summ_warp_script Mar 16, 2021
rad_summ_main_script Mar 16, 2021
create_radiation_summary_page.pyMar 16, 2021
run_goes_fluence_extract.py Mar 16, 2021
Retired
idlsave.pro Sep 05, 2018
rad_summ.pro Sep 05, 2018
rdb_read.pro Sep 05, 2018

Please read README file for more details.

Mar 30, 2020Python3.6 updates
Jan 14, 2021data extraction upate
Jan 20, 2021data format checking upate
Jan 27, 2021data format checking upate on run_goes_fluence_extract
Mar 16, 2021Python3.8 updates

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta


2,12,22,32,42,52 * * * * cd /data/mta4/Space_Weather/ALERTS/Scripts ; /data/mta4/Space_Weather/ALERTS/Scripts/rad_summ_wrap_script > /data/mta4/Space_Weather/Test_Logs/alert_summary.cron

Web Addreess

https://cxc.cfa.harvard.edu/mta/alerts/rad_summ.html

Comm_data

scripts which collect comm contact data.

Location /data/mta4/Space_Weather/Comm_data/Scripts/ Mar 16, 2021Mar 16, 2021Mar 16, 2021Mar 16, 2021Mar 16, 2021
Script Name Last Updated
comm_main_script
comm_wrap_script
collect_comm_data.py
dsn_summary.pl
read_summary.pl

Probably we don't need dsn_summary.pl and read_summary.pl, but we are keeping them for now for the case someone is using their output.

Please read README file for more details.

Mar 30, 2020Python3.6 updates
Mar 16, 2021Python3.8 updates

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

23 * * * * /data/mta4/Space_Weather/Comm_data/Scripts/comm_wrap_script > /data/mta4/Space_Weather/Test_Logs/comm_collect_comm.cron

Web Addreess

No Web address

Chandra Radiation Model

scripts which collect comm contact data.

Location /data/mta4/Space_Weather/CRM3/Scripts/
Script Name Last Updated
crm_wrap_script Mar 16, 2021
crm_main_script Mar 16, 2021
crm_table_wrap_script Mar 16, 2021
crm_table_main_script Mar 16, 2021
create_crm_summary_table.py Mar 16, 2021
plot_crm_flux_data.py Mar 16, 2021
update_crm_summary.py Mar 16, 2021
runcrm.f Mar 26, 2020
Retired
convrt_to_fphist.perl Sep 05, 2018
crm.pl Sep 05, 2018
CRM_plots.idl Sep 05, 2018
crmpl2.pro Sep 05, 2018
Jul 23, 2019runcrm.f complied with gfortan; several modification including change in: /data/mta4/Space_Weather/CRMFLX/CRMFLX_ver23a/CRMFLX_V23A_EXP.f
MAr 30, 2020Python3.6 udpates
Aug 31, 2020ploting:instrument data reading period extended
Oct 13, 2020ploting:plotting range adjustment capacity added
Jan 05, 2021data reading range expanded to cover the first perigee
Feb 11, 2021staled plotting process checker added
MAr 16, 2021Python3.8 udpates

Currently, runcrm.f is complied with /data/mta4/Space_Weather/CRMFLX/CRMFLX_V33o/CRMFLX_V33.f.

Please read README file for more details.

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

21 3,6,9,12,18,21 * * * /data/mta4/Space_Weather/CRM3/Scripts/crm_wrap_script > /data/mta4/Space_Weather/Test_Logs/crm3_runcrm.cron
2,7,12,17,22,27,32,37,42,47,52,57 * * * * /data/mta4/Space_Weather/CRM3/Scripts/crm_table_wrap_script > /data/mta4/Space_Weather/Test_Logs/crm3_create_table.cron

Web Addreess

No Web address

Ephemeris

Updating Ephemeris Related Data

Location /data/mta4/Space_Weather/EPHEM/Scripts/
Script Name Last Updated
ephem_copy_wrap_script Jun 18, 2019
ephem_copy_main_script Jun 18, 2019
ephem_shorten_wrap_script Mar 10, 2020
ephem_shorten_main_script Mar 10, 2020
convert_coord.py Feb 28, 2020
copy_ephem_data.py Mar 19, 2020
ephem_interpolate.py Feb 02, 2020
interpolate_daemonize.c Jul 30, 2019
interpolate_script.sh Jul 30, 2019
daemon_process_check_ephem_primary.py Oct 29, 2020

Please read README file for more details.

Jun 18, 2019a python version logged
Jul 30, 2019ephem_interpolate.py daemonized
Mar 30, 2020Python3.6 update
Oct 29, 2020daemon process checker added

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

21 3 * * * cd /data/mta4/Space_Weather/EPHEM/Scripts; /data/mta4/Space_Weather/EPHEM/Scripts/ephem_copy_wrap_script > /data/mta4/Space_Weather/Test_Logs/ephem_ephem.cron
19 3,6,9,12,18,21 * * * /data/mta4/Space_Weather/EPHEM/Scripts/ephem_shorten_wrap_script > /data/mta4/Space_Weather/Test_Logs/ephem_shorten.cron

DAEON Job

CPU: 3cpo-v User: mta

mta 17481 0.0 0.0 12668 436 ? S 06:46 0:00 interpolate_daemonize

Web Addreess

No Web address

GOES

GOES proton/particle monitoring system for Chandra

Location /data/mta4/Space_Weather/GOES/Scripts/
Script Name Last Updated
goes_wrap_script Mar 16, 2021
goes_main_script Mar 16, 2021
goes_long_wrap_script Mar 16, 2021
goes_long_main_script Mar 16, 2021
collect_goes_long.py Mar 16, 2021
plot_goes_data.py Mar 16, 2021
update_goes_differential_page.pyMar 16, 2021
update_goes_integrate_page.py Mar 16, 2021
get_goes_data.py Sep 03, 2018
update_long_term_goes_data.py Nov 06, 2018
update_goes_electron_page.py Jan 30, 2019
update_goes_proton_page.py Jan 30, 2019
get_goes_xray_plot.py Jan 31, 2019

Please read README file for more details.

Nov 06, 2018Data reading bug (read only a half day) fixed
Jan 30, 2019Table format adjusted
Jan 31, 2019A new script to download goes x-ray plot added
Mar 30, 2020Python3.6 updates
Jan 20, 2021null data checking added
Mar 16, 2021Python3.8 updates

Data Needed

Note: Goes proton channel name and the energy band: 

P1          1020-1860 keV
P2A         1900-2300 keV
P2B         2310-3340 keV
P3          3400-6480 keV
P4          5840-11000 keV
P5          11640-23270 keV
P6          25900-38100 keV
P7          40300-73400 keV
P8A         83700-98500 keV
P8B         99900-118000 keV
P8C         115000-143000 keV
P9          160000-242000 keV
P10         276000-404000 keV

Output Locations and File Names

Cron Job

User:
CPU: r2d2-v
mta

2,7,12,17,22,27,32,37,42,47,52,57 * * * * /data/mta4/Space_Weather/GOES/Scripts/goes_wrap_script > /data/mta4/Space_Weather/Test_Logs/goes_main.cron
14 2 * * * /data/mta4/Space_Weather/GOES/Scripts/goes_long_wrap_script > /data/mta4/Space_Weather/Test_Logs/goes_long_term.cron
14 2 * * * /data/mta4/Space_Weather/GOES/Scripts/get_goes_xray_plot.py > /data/mta4/Space_Weather/Test_Logs/goes_x_ray_plot.cron

Web Addreess

http://cxc.cfa.harvard.edu/mta/RADIATION_new/GOES/goes_part_p.html
http://cxc.cfa.harvard.edu/mta/RADIATION_new/GOES/goes_pchan_p.html

GSM Plots

Create GSM and GSE plots

Location /data/mta4/Space_Weather/GSM_plots/Scripts/
Script Name Last Updated
gsm_wrap_script Mar 16, 2021
gsm_main_script Mar 16, 2021
create_gsm_gse_orbit_plots.py Mar 16, 2021
create_lon_and_lat_orbit_plot.py Mar 16, 2021
Retired
extract_next_two_days.py Sep 05, 2018
gsm_plots.idl Sep 05, 2018
Create_plots.idl Sep 05, 2018
eph_gsm.pro Sep 05, 2018
gsm_plots.pro Sep 05, 2018

Please read README file for more details.

Mar 30, 2020Python3.6 update
Mar 16, 2021Python3.8 update

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

2,17,32,47 * * * * cd /data/mta4/Space_Weather/GSM_plots/Scripts/; /data/mta4/Space_Weather/GSM_plots/Scripts/gsm_wrap_script > /data/mta4/Space_Weather/Test_Logs/gsm_plot.cron

Web Addreess

http://cxc.cfa.harvard.edu/mta/RADIATION_new/Orbit/orbit.html

KP index

Extract k index

Location /data/mta4/Space_Weather/KP/Scripts/
Script Name Last Updated
kp_wrap_script Mar 16, 2021
kp_main_script Mar 16, 2021
get_kp.py Mar 16, 2021
update_k_index.py Mar 16, 2021
update_solor_wind_data.py Mar 16, 2021

Please read README file for more details.

Mar 30, 2020Python3.6 update
Mar 16, 2021Python3.8 update

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

14 0,3,6,9,12,15,18,21 * * * /data/mta4/Space_Weather/KP/Scripts/kp_wrap_script > /data/mta4/Space_Weather/Test_Logs/kp_index_update.cron 2>&1

Web Addreess

No Web Page

MTA Radiation --- THIS SET OF SCRIPTS WAS RETIRED (MAR 30, 2020)

idl scripts which read data from /dsops/, and updates ephin_L1_2010.rdb and also updates DataSkeer repository rdb file of the same name.

Location /data/mta4/Space_Weather/MTA_Rad/Scripts/
Script Name Last Updated
get_rad_wrap_script Sep 06, 2018
get_rad_main_script Sep 09, 2018
fill_ephin_data_file.py Oct 10, 2018
get_radiation_data.py Sep 06, 2018
mk_rdb.pro Sep 06, 2018
mk_eph_avg.pro Sep 06, 2018
mrdfits.pro Sep 06, 2018
run.pro Sep 06, 2018
filtersort2.pl Sep 06, 2018

Please read README file for more details.

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

23 1 * * * cd /data/mta4/Space_Weather/MTA_Rad/Scripts/; /usr/local/bin/idl run.pro > /data/mta4/Space_Weather/Test_Logs/mta_rad_main.cron 2>&1
17 6 * * * cd /data/mta4/Space_Weather/MTA_Rad/Scripts/; get_rad_wrap_script > /data/mta4/Space_Weather/Test_Logs/mta_rad_get_rad.cron 2>&1

Web Addreess

No Web Page

SOHO

predict and plot the solar wind environment for Chandra, 4 weeks into the future.

Location /data/mta4/Space_Weather/SOHO/Scripts/
Script Name Last Updated
solar_wind_warp_script Mar 16, 2021
solar_wind_main_script Mar 16, 2021
create_predicted_solar_wind_plot.py Mar 16, 2021
Retired
get_sw.pl Sep 06, 2018
plot_sw2.pl Sep 05, 2018
solwin.pl Sep 05, 2018
longterm/get_sw.pl Sep 05, 2018
longterm/plot_sw.pro Sep 05, 2018
longterm/print_sw.pl Sep 05, 2018
longterm/solwin.pl Sep 05, 2018
longterm/sw_rms.pl Sep 05, 2018

Please read README file for more details.

Mar 30, 2020Python3.6 update
Aug 27, 2020ace_swepam_1h.json None data handling added
Mar 16, 2021Python3.8 update

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

36 0,3,6,9,12,15,18,21 * * * cd /data/mta4/Space_Weather/SOHO/Scripts; /data/mta4/Space_Weather/SOHO/Scripts/solar_wind_warp_script

Web Addreess

No Web Page

STEREO

Copying data and plots from NOAA STEREO site

Location /data/mta4/Space_Weather/STEREO/Scripts/
Script Name Last Updated
stereo_wrap_script Mar 16, 2021
tereo_main_script Mar 16, 2021
update_stereo_data.py Mar 16, 2021

Please read README file for more details.

data table ftp site address updated.Python3.6 updatesPython3.8 updates
Jan 30, 2019
Mar 30, 2020
Mar 16, 2021

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

2,6,11,16,21,26,31,36,41,46,51,56 * * * * /data/mta4/Space_Weather/STEREO/Scripts/stereo_wrap_script > /data/mta4/Space_Weather/Test_Logs/stereo_data.cron 2>&1

Web Addreess

http://cxc.cfa.harvard.edu/mta/space_weather/STEREO/stereo.html

TLE

ode to propagate 2-line element ephemeris data

Location /data/mta4/Space_Weather/TLE/Scripts/
Script Name Last Updated
create_orbital_warp_script Mar 16, 2021
create_orbital_main_script Mar 16, 2021
create_orbital_data_files.py Mar 16, 2021
Retired
cocoxmm.f Sep 05, 2018
convert_tle.pl Sep 05, 2018
get_tle.pl Sep 05, 2018
spacetrack.f Sep 10, 2018

Please read README file for more details, especially about python libraries used for this set of scripts.

Python3.6 updatesdate bug fixedPython3.8 updates
Mar 30, 2020
Apr 20, 2020
Mar 16, 2021

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

22 2 * * * cd /data/mta4/Space_Weather/TLE/Scripts/;/usr/bin/perl get_tle.pl > /data/mta4/Space_Weather/Test_Logs/tle_get.cron

Web Addreess

No Web Page

XMM

scripts related to XMM real time radiation observation page http://cxc.cfa.harvard.edu/mta/RADIATION_new/XMM/index.html.

Location /data/mta4/Space_Weather/XMM/Scripts/
Script Name Last Updated
xmm_wrap_script Mar 16, 2021
xmm_main_script Mar 16, 2021
add_region_info.py Mar 16, 2021
check_mta_xmm_alert_page.py Mar 16, 2021
plot_gsm_orbits_org.py Mar 16, 2021
plot_gsm_orbits.py Mar 16, 2021
plot_gsm_orbits_xz_plane.py Mar 16, 2021
plot_xmm_cxo_comp.py Mar 16, 2021
plot_xmm_rad.py Mar 16, 2021
update_xmm_rad_data.py Mar 16, 2021
Retired
run_xmm_scripts.py Sep 05, 2018
crmreg_cxo.f Sep 05, 2018
crmreg_xmm.f Sep 05, 2018
cxtime.pro Sep 05, 2018
date2es.pro Sep 05, 2018
have_license.pro Sep 05, 2018
mta_check_xmm.pro Sep 05, 2018
mta_plot_xmm_comp.pro Sep 05, 2018
mta_plot_xmm_crm.pro Sep 05, 2018
mta_plot_xmm_gsm.pro Sep 05, 2018
mta_plot_xmm.pro Sep 05, 2018
mta_plot_xmm_tle.pro Sep 05, 2018
mta_xmm_db.pro Sep 05, 2018
update.pro Sep 05, 2018
xmm_time.pro Sep 05, 2018

Please read README file for more details.

Python3.6 updatesxmm data source changedxmm mail link updatedPython3.8 updates
Mar 30, 2020
Oct 06, 2020
fev 21, 2021
Mar 16, 2021

Data Needed

Output Locations and File Names

Cron Job

CPU: r2d2-v
User: mta

2,12,22,32,42,52 * * * * cd /data/mta4/Space_Weather/XMM/Scripts ; /data/mta4/Space_Weather/XMM/Scripts/xmm_wrap_script > /data/mta4/Space_Weather/Test_Logs/xmm_main.cron

Web Addreess

http://cxc.cfa.harvard.edu/mta/space_weather/XMM/index.html

Environment Setting

Note

None

Future Plan/Update Schedule

None

Back to Top Page