Ska Runtime Environment 0.15 =========================================== THIS IS THE CURRENTLY-INCOMPLETE version of test / install procedures for skare-0.15, based on a copy of the 0.14 version. .. Build and install this document with: rst2html.py --stylesheet=/proj/sot/ska/www/ASPECT/aspect.css \ --embed-stylesheet NOTES.skare-0.14.rst NOTES.skare-0.14.html cp NOTES.skare-0.14.html /proj/sot/ska/www/ASPECT/skare-0.14.html Review ------ Notes and testing were reviewed by Jean Connelly. Build ------- /proj/sot/ska/test ^^^^^^^^^^^^^^^^^^^ Install (or git pull) skare on 32-bit or 64-bit virtual CentOS-5 machine. :: # Get skare repository on virtual CentOS-5 machine cd ~/git/skare git checkout master git pull origin master # Choose prefix (dev or flight) and configure prefix=/proj/sot/ska/test ./configure --prefix=$prefix # Make 64 or 32-bit installation make all_64 make all_32 # on quango Pre-install testing in Ska test ---------------------------------------- Xija ^^^^^^^^ :: skatest cd python import os os.environ['ENG_ARCHIVE'] = '/proj/sot/ska/data/eng_archive' import xija xija.test() ==> OK 4/16/2013 (TLA) Starcheck ^^^^^^^^^^^^ :: skatest cd ~/git/starcheck git checkout master git pull origin master (unska; /proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test-flight) make test diff test-flight.txt test.txt ==> OK 4/16/2013 (TLA) Eng_archive ^^^^^^^^^^^^ :: cd skatest python import Ska.engarchive Ska.engarchive.test() cd ~/git/eng_archive Follow the steps for "Regression test for new skare (..) in $ska/dev" in NOTES.test. ==> OK 4/16/2013 (TLA) Commanded states ^^^^^^^^^^^^^^^^^^ :: skatest cd ~/git/Chandra.cmd_states python setup.py install cd ~/git/cmd_states make install cd ~/git/timelines make install nosetests ==> OK 4/16/2013 (JC) ACIS thermal load review ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Test for for dpa_check, dea_check, acisfp_check, and psmc_check ==> OK 4/16/2013 (TLA) DPA ~~~~~~~~ Window 1 (FLIGHT):: % source /proj/sot/ska/bin/ska_envs.csh % cd ~/git/skare/tests/0.15/acis_regression # Use your own area here Run the tool, e.g. % python /proj/sot/ska/share/dpa/dpa_check.py \ --outdir=dpa-feb0413a-flight \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 Window 2 (TEST):: % cd ~/git/skare/tests/0.15/acis_regression # Use your own area here % source /proj/sot/ska/test/bin/ska_envs.csh % setenv ENG_ARCHIVE /proj/sot/ska/data/eng_archive % python /proj/sot/ska/share/dpa/dpa_check.py \ --outdir=dpa-feb0413a-test \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 DIFFS:: % diff dpa-feb0413a-flight/index.rst dpa-feb0413a-test/index.rst % diff dpa-feb0413a-flight/temperatures.dat \ dpa-feb0413a-test/temperatures.dat DEA ~~~~~~~~ Window 1 (FLIGHT):: % python /proj/sot/ska/share/dea/dea_check.py \ --outdir=dea-feb0413a-flight \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 Window 2 (TEST):: % python /proj/sot/ska/share/dea/dea_check.py \ --outdir=dea-feb0413a-test \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 DIFFS:: % diff dea-feb0413a-flight/index.rst dea-feb0413a-test/index.rst % diff dea-feb0413a-flight/temperatures.dat \ dea-feb0413a-test/temperatures.dat PSMC ~~~~~~~~ Window 1 (FLIGHT):: % python /proj/sot/ska/share/psmc_check/psmc_check.py \ --outdir=psmc-feb0413a-flight \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 Window 2 (TEST):: % python /proj/sot/ska/share/psmc_check/psmc_check.py \ --outdir=psmc-feb0413a-test \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 DIFFS:: % diff psmc-feb0413a-flight/index.rst psmc-feb0413a-test/index.rst % diff psmc-feb0413a-flight/temperatures.dat \ psmc-feb0413a-test/temperatures.dat ACIS_FP ~~~~~~~~ Window 1 (FLIGHT):: % python /proj/sot/ska/share/acisfp/acisfp_check.py \ --outdir=acisfp-feb0413a-flight \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 Window 2 (TEST):: % python /proj/sot/ska/share/acisfp/acisfp_check.py \ --outdir=acisfp-feb0413a-test \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 DIFFS:: ## There are small expected diffs in both cases because of the random ## sampling in the flight Earth solid angle code. This is changed ## in Skare 0.15, so subsequent regression testing will match. % diff acisfp-feb0413a-flight/index.rst acisfp-feb0413a-test/index.rst % diff acisfp-feb0413a-flight/temperatures.dat \ acisfp-feb0413a-test/temperatures.dat Other modules ^^^^^^^^^^^^^ **Ska.Table** - :: cd ~/git/Ska.Table git fetch origin python test.py ==> OK 4/16/2013 (TLA) **Ska.DBI** - :: cd ~/git/Ska.DBI git fetch origin python test.py ==> OK 4/16/2013 (TLA) **Quaternion** - :: cd ~/git/Quaternion git fetch origin nosetests ==> OK 4/16/2013 (TLA) **Ska.ftp** - :: cd ~/git/Ska.ftp git fetch origin nosetests ==> OK 4/16/2013 (TLA) **Ska.Numpy** - :: cd ~/git/Ska.Numpy git fetch origin nosetests ==> OK 4/16/2013 (TLA) **Ska.ParseCM** - :: cd ~/hg/Ska.ParseCM hg incoming python test.py ==> OK 4/16/2013 (TLA) **Ska.quatutil** - :: cd ~/hg/Ska.quatutil hg incoming nosetests ==> OK 4/16/2013 (TLA) **Ska.Shell** - :: cd ~/hg/Ska.Shell hg incoming python test.py ==> OK 4/16/2013 (TLA) **asciitable** - :: cd ~/git/asciitable git checkout 0.8.0 nosetests ==> OK 4/16/2013 (TLA) **esa_view** - :: cd python /proj/sot/ska/share/taco/esaview.py MAR2513 ==> OK 4/16/2013 (TLA) Installation on GRETA network (test) ------------------------------------- On ccosmos:: skatest ska_version # 0.15-r293-e754375 On quango (32-bit):: skatest ska_version # 0.15-r293-e754375 On chimchim as SOT:: set version=0.15-r293-e754375 mkdir /proj/sot/ska/test/arch/skare-${version} rysnc -av aldcroft@ccosmos:/proj/sot/ska/test/arch/x86_64-linux_CentOS-5 \ /proj/sot/ska/test/arch/skare-${version}/ rysnc -av aldcroft@ccosmos:/proj/sot/ska/test/arch/i686-linux_CentOS-5 \ /proj/sot/ska/test/arch/skare-${version}/ cd /proj/sot/ska/test/arch ls -l # make sure everything looks good ls -l $skare-${version} rm i686-linux_CentOS-5 rm x86_64-linux_CentOS-5 ln -s skare-${version}/i686-linux_CentOS-5 ./ ln -s skare-${version}/x86_64-linux_CentOS-5 ./ Esa_view ^^^^^^^^ Check that ESA view tool passes basic functional checkout:: cd python /proj/sot/ska/share/taco/esaview.py MAR2513 Installation on HEAD network (flight) ------------------------------------- Installation:: # Do everything as aca su -l aca ska # Prepare for in-place installation cd ~/git/skare git checkout 0.15 # Note: skare-0.14 branch has post-install updates vs. 0.14 tag git log # Stop all cron jobs touch /proj/sot/ska/data/task_schedule/master_heart_attack # Wait at least a minute # Build updated skare on ccosmos ./configure --prefix=/proj/sot/ska make python_modules # Could be "make all_64" for a bigger update # Build 32-bit version on quango ssh aca@quango cd ~/git/skare make python_modules # Could be "make all_32" for a bigger update # TEST per instructions below # Allow all cron jobs to resume rm /proj/sot/ska/data/task_schedule/master_heart_attack Post-install testing on HEAD ----------------------------- Starcheck ^^^^^^^^^^^^ :: cd ~/git/starcheck /proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test.new diff test.7cb31b.txt test.new.txt ==> OK 4/17/2013 TLA Eng_archive ^^^^^^^^^^^^ :: cd ~/git/eng_archive Follow the steps for "Regression test for new skare in /proj/sot/ska" in NOTES.test. ==> SKIP Commanded states ^^^^^^^^^^^^^^^^^^^ :: cd ~/git/timelines nosetests ==> OK 4/17/2013 TLA Other modules ^^^^^^^^^^^^^ - Ska.Table: OK 4/17/2013 TLA - Ska.DBI: OK 4/17/2013 TLA - Quaternion (nose): OK 4/17/2013 TLA - Ska.ftp (nose): OK 4/17/2013 TLA - Ska.Numpy: OK 4/17/2013 TLA - Ska.ParseCM: OK 4/17/2013 TLA - Ska.quatutil: OK 4/17/2013 TLA - Ska.Shell: OK 4/17/2013 TLA - asciitable: OK 4/17/2013 TLA acisfp_check ^^^^^^^^^^^^ Window 1 (FLIGHT):: ska cd ~/git/skare/tests/0.15/acis_regression python /proj/sot/ska/share/acisfp/acisfp_check.py \ --outdir=acisfp-feb0413a-new \ --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \ --run-start=2013:031 diff acisfp-feb0413a-flight/index.rst acisfp-feb0413a-new/index.rst diff acisfp-feb0413a-flight/temperatures.dat \ acisfp-feb0413a-new/temperatures.dat ==> OK 4/17/2013 TLA ESA view ^^^^^^^^ :: cd python /proj/sot/ska/share/taco/esaview.py MAR2513 ==> OK 4/17/2013 TLA Notes ----- REMEMBER to "make install" eng archive as needed! Installation on GRETA network (flight) -------------------------------------- Ensure that the HEAD flight distribution has been installed and tested. On chimchim as SOT:: set version=0.15-r293-e754375 cd /proj/sot/ska/dist mkdir skare-${version} rsync -azv aldcroft@ccosmos:/proj/sot/ska/arch/x86_64-linux_CentOS-5/ \ skare-${version}/x86_64-linux_CentOS-5/ rsync -azv aldcroft@ccosmos:/proj/sot/ska/arch/i686-linux_CentOS-5/ \ skare-${version}/i686-linux_CentOS-5/ On chimchim as FOT CM:: cd /proj/sot/ska/arch set version=0.15-r293-e754375 mkdir skare-${version} ls /proj/sot/ska/dist/skare-${version} rsync -av /proj/sot/ska/dist/skare-${version}/ skare-${version}/ rm i686-linux_CentOS-5 rm x86_64-linux_CentOS-5 ln -s skare-${version}/i686-linux_CentOS-5 ./ ln -s skare-${version}/x86_64-linux_CentOS-5 ./ Smoke test on chimchim:: source /proj/sot/ska/bin/ska_envs.csh ipython --pylab import Ska.engarchive.fetch as fetch dat = fetch.Msid('tephin', '2012:001', stat='5min') dat.plot() Smoke test on snowman:: source /proj/sot/ska/bin/ska_envs.csh ipython --pylab import Ska.engarchive.fetch as fetch dat = fetch.Msid('tephin', '2012:001', stat='5min') dat.plot() Fallback:: set version=0.14-r272-ebf9f03 cd /proj/sot/ska/arch rm i686-linux_CentOS-5 rm x86_64-linux_CentOS-5 ln -s skare-${version}/i686-linux_CentOS-5 ./ ln -s skare-${version}/x86_64-linux_CentOS-5 ./ Test on GRETA network (flight) -------------------------------------- Test xija as SOT (32 and 64 bit):: ska cd ipython import xija xija.test() Test eng_archive (32 and 64 bit):: ska ipython import Ska.engarchive Ska.engarchive.test() ESA view tool (basic functional checkout):: # On chimchim only ska cd python /proj/sot/ska/share/taco/esaview.py MAR2513