MSID Limit Database Update

Description

This script compares the current mta limit data base to glimmon and update the former

Location of Scripts and Their Names

Location: /data/mta/Script/MSID_limit/Scripts/

GitHub Address:https://github.com/chandra-mta/MTA

Script Name	Last Updated
compare_database_wrap_script	Mar 10, 2021
compare_database_main_script	Mar 10, 2021
compare_database_and_update.py	Mar 10, 2021
clean_table.py	Mar 10, 2021
validate_op_limits.py	Mar 10, 2021

Please read README file for more details.

May 31, 2017	Initially logged
Feb 15, 2018	special_msid_list added; which prevent glimmon to rewrite the limits
Nov 01, 2018	limit values are compared as a float not a string
May 16, 2019	updated to python3.6
Aug 22, 2019	table clean-up mechanism added
Aug 26, 2019	bug in compare_database_and_update.py fixed
Aug 26, 2019	validate_op_limits.py added for the data validation
Oct 04, 2019	glimmon data integration method changed
Mar 10, 2021	updated to python3.8

Data Needed

https://occweb.cfa.harvard.edu/occweb/FOT/engineering/thermal/AXAFAUTO_RSYNC/G_LIMMON_Archive/glimmondb.sqlite3
/data/mta4/MTA/data/op_limits/op_limits.db
/data/mta/Script/MSID_limit/special_msid_list

Environment Setting

setenv PYTHONPATH "/data/mta/Script/Python3.8/envs/ska3-shiny/lib/python3.8/site-packages:/data/mta/Script/Python3.8/lib/python3.8/site-packages/"

Output Locations and File Names

/data/mta/Script/MSID_limit/
- glimmondb.sqlite3_
- op_limits.db_
/data/mta4/MTA/data/op_limits/
- op_limits.db

How to Run the Script(s)

cd /data/mta/Script/MSID_limit/
source /proj/sot/ska/bin/ska_envs.csh
compare_database_and_update.py

How to Run Test(s)

cd /data/mta/Script/MSID_limit/
source /proj/sot/ska/bin/ska_envs.csh
compare_database_and_update.py test

Expected result from the test

Cron Job

CPU:	boba-v
User:	mta

14 1 1 * * cd /data/mta/Script/MSID_limit/Trend_limit_data/Scripts; /data/mta/Script/MSID_limit/Trend_limit_data/Scripts/msid_trend_wrap_script > $HOME/Logs/msid_limit_table_new.cron 2>&1
35 4 1 * * cd /data/mta/Script/MSID_limit; /data/mta/Script/MSID_limit/compare_database_wrap_script > $HOME/Logs/op_limit_updates.cron 2>&1

Web Addreess

None

Note

None

Future Plan/Update Schedule

None