Update TOO / DDT information

Description

This set of scripts extract too/ddt observations from email or sot database and, if needed, update the information.

Location of Scripts and Their Names

Location: /data/mta4/CUS/www/Usint/TOO_Obs/Scripts/

GitHub Address: https://github.com/tisobe/Usint_script

too_ddt_wrap_script	Jul 30, 2020
too_ddt_main_script	Jul 30, 2020
update_tooddt_prop_list.py	Jul 30, 2020
update_obs_lists.py	Aug 17, 2020
new_too_ddt_notifier.py	Jan 15, 2021
read_sql.py	Jul 23, 2020
RETIRED
find_too_ddt_email.py	Terminated
tooddtFunctions.py	Retired Apr 05, 2018
update_new_obs_list.py	Retired Apr 05, 2018
update_ddt_too_list.py	Retired Apr 05, 2018
update_pornum_poc_list.py	Retired Apr 05, 2018
update_ddt_too_list.py	Retired Apr 05, 2018
DBI.py	Aug 29, 2012
readSQL.py	Apr 05, 2018

Please read more about these scripts in: /data/mta4/obs_ss/Usint_test/Usint_script/TOO_Obs/README

Data Needed

/data/mta4/CUS/www/Usint/ocat/Info_save/too_contact_info/special_obsid_poc_list
/data/mta4/obs_ss/sot_ocat.dat
mta_mail (a copy of mta mail archive; see cron job section below)

Environment Setting

#!/usr/bin/env /proj/sot/ska/bin/python

Output Locations and File Names

/data/mta4/CUS/www/Usint/ocat/Info_save/too_contact_info
- too_list
- ddt_list
- new_obs_list
- obs_in_30days
- new_obs_list.txt
- tooddt_prop_obsid_list
- propno_poc_list
/data/mta4/CUS/www/Usint/TOO_Obs/Msave/
- mta_mail

How to Run the Script(s)

go to: cd /data/mta4/CUS/www/Usint/TOO_Obs
run: /data/mta4/CUS/www/Usint/TOO_Obs/too_ddt_wrap_script

How to Run Test(s)

No test is available, but you can just run this script to see whether it works or not.

Expected result from the test

Cron Job

Jul 30, 2020python 3.6 conversion
Sep 17, 2014	Initially logged
Jan 07, 2015	too/ddt observations are now sololy read from approved email
May 13, 2015	Due to termination of /arc/cus/mail_archive update, find_too_ddt_email.py is replaced by update_ddt_too_list.py
Jul 10, 2015	object is added to target sql inquiry
Jul 10, 2015	sjw is now responsible to all "object"
Jul 13, 2015	The bug due to above update fixed (function call problem)
Mar 02, 2016	poc reference bugs fixed. update_pornum_poc_list.py added
Mar 07, 2016	farther improvement on poc setting: update_new_obs_list.py
Jun 26, 2017	pre-assigned case to ddt/too case updated in update_new_obs_list.py
Apr 05, 2018	a major update. Reading too/ddt observation from mta_mail
Apr 26, 2018	too/ddt poc assignement bug fixed
May 15, 2018	email reading problem addressed
May 29, 2018	a minor bug fixed
Aug 17, 2020bug fixed
Jan 15, 2021notification bug: sending observed obsid fixed

CPU:	luke-v
User:	cus

50 * * * * cd /data/mta4/CUS/www/Usint/TOO_Obs; /data/mta4/CUS/www/Usint/TOO_Obs/too_ddt_wrap_script >> $HOME/Logs/too_ddt_update.cron 2>&1

CPU:	r2d2-v
User:	mta

45 * * * * rm -f /data/mta4/CUS/www/Usint/TOO_Obs/Msave/mta_mail; cp /stage/mail/mta /data/mta4/CUS/www/Usint/TOO_Obs/Msave/mta_mail; chmod 777 /data/mta4/CUS/www/Usint/TOO_Obs/Msave/mta_mail