Ska Runtime Environment 0.10 =========================================== .. Build and install this document with: rst2html.py --stylesheet=/proj/sot/ska/www/ASPECT/aspect.css \ --embed-stylesheet NOTES.skare-0.10 NOTES.skare-0.10.html cp NOTES.skare-0.10.html /proj/sot/ska/www/ASPECT/skare-0.10.html Content overview ---------------- - Python 2.7 (binary install from ActivePython) - NumPy 1.6 (package install from ActivePython) - SciPy 0.9 (package install from ActivePython) - Updates to Python modules: asciitable, cosmocalc, distribute, ipython, Jinja2, mpi4py, nose, pyfits, Pygments, pyparsing, PyYAML, Sphinx, - Updates to C libraries: mpich2, yaml, hdf5 - Pygtk + Gtk+ dependencies - meld (now works properly) - Common build process for 32-bit (GRETA) and 64-bit - No updates to perl or perl libraries - Only three files are modified in place; all other updates are in a new directory that does not conflict with current installation. Review ------ Notes and testing were reviewed by Jean Connelly. Command states and module testing were run independently by Jean. Build ----- Install (or git pull) skare on 32-bit or 64-bit virtual CentOS-5 machine. :: # Get skare repository on virtual CentOS-5 machine cd ~/git git clone git@github.com:sot/skare.git git checkout master # Choose prefix (dev or flight) and configure prefix=/proj/sot/ska/dev prefix=/proj/sot/ska ./configure --prefix=$prefix # Choose 64 or 32-bit installation make basedirs libs python_64 git make basedirs libs python_32 git # Create tarfile output (dev or flight) [replace 64 -> 32 as needed] cd $prefix tar zcf skare-0.10-64-dev.tar.gz arch bin lib build/*/*/.installed tar zcf skare-0.10-64.tar.gz arch bin lib build/*/*/.installed scp skare-0.10-64.tar.gz ccosmos:/proj/sot/ska/dist/ Pre-install testing in development area ---------------------------------------- Starcheck ^^^^^^^^^^^^ :: cd ~/hg/starcheck (unska; /proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test.7cb31b) make test diff test.7cb31b.txt test.txt ==> OK Eng_archive ^^^^^^^^^^^^ :: cd ~/hg hg clone /proj/sot/ska/hg/eng_archive cd eng_archive Follow the steps for "Regression test for new skare (..) in $ska/dev" in NOTES.test. ==> OK Commanded states ^^^^^^^^^^^^^^^^^^ :: skadev cd ~/hg/Chandra.cmd_states_dev python setup.py install cd ~/hg/cmd_states_dev make install cd ~/hg/timelines_dev make install nosetests ==> OK :: cd ~/hg/Chandra.cmd_states python setup.py install cd ~/hg/cmd_states make install cd ~/hg/timelines make install nosetests ==> OK psmc_check ^^^^^^^^^^ :: skadev cd ~/hg/psmc ln -s $ska/data/telem_archive $ska/dev/data/ python ./psmc_check.py --run_start_time='2011:001' --outdir regress_skadev # NEW WINDOW ska python ./psmc_check.py --run_start_time='2011:001' --outdir regress_ska diff regress_ska{,dev}/val diff regress_ska{,dev}/validation_quant.csv rm $ska/dev/data/telem_archive ==> OK Other modules ^^^^^^^^^^^^^ - Ska.Table: OK (with patch). Updated because recent pyfits throws IOError, not caught properly. This was true of Flight Ska, just did not run tests for pyfits 2.2.2 install. - Ska.DBI: OK - Quaternion: OK - Ska.ftp: OK - Ska.Numpy: OK - Ska.ParseCM: OK - Ska.quatutil: OK - Ska.Shell: OK - asciitable: OK Installation on HEAD network ------------------------------------ Copy the skare tar distribution skare-0.10-64.tar.gz to /proj/sot/ska/dist. :: # Do everything as aca su -l aca # Stop all cron jobs touch /proj/sot/ska/data/task_schedule/master_heart_attack cd /proj/sot/ska/dist mkdir skare-0.10-64 cd skare-0.10-64 tar xf ../skare-0.10-64.tar.gz # preview updates in key areas rsync --size-only --dry-run -av bin/ /proj/sot/ska/bin/ rsync --size-only --dry-run -av lib/ /proj/sot/ska/lib/ mv /proj/sot/ska/build{,.bak} ls /proj/sot/ska/dist/skare-0.10-64/ rsync -av /proj/sot/ska/dist/skare-0.10-64/ /proj/sot/ska/ >& install.log # Make modules that cannot be made on virtual machine, e.g. Sybase, and # ensure completeness. # First clone the skare installer repo, then ./configure --prefix=/proj/sot/ska make python_modules # TEST per instructions below # Allow all cron jobs to resume rm /proj/sot/ska/data/task_schedule/master_heart_attack Installation on GRETA network ------------------------------------ Perform GRETA network installation after a soak period of about one week on the HEAD network. Start by copying the skare tar distribution skare-0.10-32.tar.gz to /proj/sot/ska/dist on the GRETA network. Then do the installation steps:: # Do everything as aca su -l aca # Stop all cron jobs crontab -e cd /proj/sot/ska/dist mkdir skare-0.10-32 cd skare-0.10-32 tar xf ../skare-0.10-32.tar.gz # preview updates in key areas rsync --size-only --dry-run -av bin/ /proj/sot/ska/bin/ rsync --size-only --dry-run -av lib/ /proj/sot/ska/lib/ mv /proj/sot/ska/build{,.bak} ls /proj/sot/ska/dist/skare-0.10-32/ # DO THE INSTALL rsync -av /proj/sot/ska/dist/skare-0.10-32/ /proj/sot/ska/ >& install.log # Make modules that cannot be made on virtual machine, e.g. Sybase, and # ensure completeness. make python_modules # TEST per instructions below (as applicable for GRETA) # Allow all cron jobs to resume crontab -e Fallback -------- Only three files are expected to changed (the rest go in a new arch directory): - bin/sysarch - bin/syspathsubst - lib/perl/CXC/Envs/Flight.pm. Confirm with:: rsync --dry-run -av /proj/sot/.snapshot/nightly.0/ska/bin/ /proj/sot/ska/bin/ rsync --dry-run -av /proj/sot/.snapshot/nightly.0/ska/lib/ /proj/sot/ska/lib/ Restore with:: cp -p /proj/sot/.snapshot/nightly.0/ska/bin/sysarch /proj/sot/ska/bin/ cp -p /proj/sot/.snapshot/nightly.0/ska/bin/syspathsubst /proj/sot/ska/bin/ cp -p /proj/sot/.snapshot/nightly.0/ska/lib/perl/CXC/Envs/Flight.pm /proj/sot/ska/lib/perl/CXC/Envs/ rm -rf /proj/sot/ska/build mv /proj/sot/ska/build{.bak,} Post-install testing -------------------- Starcheck ^^^^^^^^^^^^ :: cd ~/hg/starcheck /proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test.new diff test.7cb31b.txt test.new.txt ==> OK Eng_archive ^^^^^^^^^^^^ :: cd ~/hg hg clone /proj/sot/ska/hg/eng_archive cd eng_archive Follow the steps for "Regression test for new skare in /proj/sot/ska" in NOTES.test. ==> OK Commanded states ^^^^^^^^^^^^^^^^^^^ :: cd ~/hg/timelines nosetests ==> PENDING... psmc_check ^^^^^^^^^^ :: ska cd ~/hg/psmc python ./psmc_check.py --run_start_time='2011:001' --outdir regress_ska.new diff regress_ska{.new,.7cb31b}/val diff regress_ska{.new,.7cb31b}/validation_quant.csv ==> OK Other modules ^^^^^^^^^^^^^ - Ska.Table: OK - Ska.DBI: OK - Quaternion (nose): OK - Ska.ftp (nose): OK - Ska.Numpy: OK - Ska.ParseCM: OK - Ska.quatutil: OK - Ska.Shell: OK - asciitable: OK