Ska Runtime Environment 0.11 =========================================== .. Build and install this document with: rst2html.py --stylesheet=/proj/sot/ska/www/ASPECT/aspect.css \ --embed-stylesheet NOTES.skare-0.11 NOTES.skare-0.11.html cp NOTES.skare-0.11.html /proj/sot/ska/www/ASPECT/skare-0.11.html Content changes overview ------------------------ - num_libs_bin: new binary install of "num_libs.cfg". Using procedure in NOTES.make_num_libs_bin, create a package with arch-dependent binaries for num_libs compiled from source (which can take a long time). Do this on the target host if possible. (Building num_libs on VMware Centos-5 VM takes at least 2 hours and is completely the wrong CPU). - NumPy 1.5 source install - SciPy 0.9 source install - New pycore.cfg which installs numpy, scipy, matplotlib from source. Review ------ Notes and testing were reviewed by Jean Connelly. Command states and module testing were run independently by Jean. Build ----- Install (or git pull) skare on 32-bit or 64-bit virtual CentOS-5 machine. :: # Get skare repository on virtual CentOS-5 machine cd ~/git git clone git@github.com:sot/skare.git git checkout master # Choose prefix (dev or flight) and configure prefix=/proj/sot/ska/dev prefix=/proj/sot/ska ./configure --prefix=$prefix # Choose 64 or 32-bit installation make basedirs libs python_64 git meld sherpa make basedirs libs python_32 git meld sherpa # Create tarfile output (dev or flight) [replace 64 -> 32 as needed] cd $prefix tar zcf skare-0.11-64-dev.tar.gz arch bin lib build/*/*/.installed tar zcf skare-0.11-64.tar.gz arch bin lib build/*/*/.installed scp skare-0.11-64.tar.gz ccosmos:/proj/sot/ska/dist/ Pre-install testing in development area ---------------------------------------- Starcheck ^^^^^^^^^^^^ :: skadev cd ~/hg/starcheck (unska; /proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test.7cb31b) make test diff test.7cb31b.txt test.txt ==> OK Eng_archive ^^^^^^^^^^^^ :: cd ~/hg hg clone /proj/sot/ska/hg/eng_archive cd eng_archive Follow the steps for "Regression test for new skare (..) in $ska/dev" in NOTES.test. ==> OK Commanded states ^^^^^^^^^^^^^^^^^^ :: skadev cd ~/hg/Chandra.cmd_states_dev python setup.py install cd ~/hg/cmd_states_dev make install cd ~/hg/timelines_dev make install nosetests ==> :: cd ~/hg/Chandra.cmd_states python setup.py install cd ~/hg/cmd_states make install cd ~/hg/timelines make install nosetests ==> psmc_check ^^^^^^^^^^ :: skadev cd ~/hg/psmc ln -s $ska/data/telem_archive $ska/dev/data/ make install python ./psmc_check.py --run_start_time='2011:001' --outdir regress_skadev # NEW WINDOW ska python ./psmc_check.py --run_start_time='2011:001' --outdir regress_ska diff regress_ska{,dev}/validation_quant.csv rm $ska/dev/data/telem_archive ==> OK Other modules ^^^^^^^^^^^^^ - Ska.Table: OK (with patch). Updated because recent pyfits throws IOError, not caught properly. This was true of Flight Ska, just did not run tests for pyfits 2.2.2 install. - Ska.DBI: OK (need to run as aca and link to aspect_authorization) - Quaternion: OK - Ska.ftp: OK - Ska.Numpy: OK - Ska.ParseCM: OK - Ska.quatutil: OK - Ska.Shell: OK - asciitable: OK Installation on HEAD network ------------------------------------ Copy the skare tar distribution skare-0.11-64.tar.gz to /proj/sot/ska/dist. :: # Do everything as aca su -l aca # Stop all cron jobs touch /proj/sot/ska/data/task_schedule/master_heart_attack cd /proj/sot/ska/dist mkdir skare-0.11-64 cd skare-0.11-64 tar xf ../skare-0.11-64.tar.gz # preview updates in key areas rsync --size-only --dry-run -av bin/ /proj/sot/ska/bin/ rsync --size-only --dry-run -av lib/ /proj/sot/ska/lib/ # NO CHANGES ls /proj/sot/ska/dist/skare-0.11-64/ mv /proj/sot/ska/build/x86_64-linux_CentOS-5{,.bak} mv /proj/sot/ska/arch/x86_64-linux_CentOS-5{,.bak} cd /proj/sot/ska/dist rsync -av /proj/sot/ska/dist/skare-0.11-64/ /proj/sot/ska/ >& install-0.11-64.log # Make modules that cannot be made on virtual machine, e.g. Sybase, and # ensure completeness. # First clone the skare installer repo, then cd /proj/sot/ska/dist (ska; git clone ~aldcroft/git/skare) cd skare git branch # confirm correct branch ./configure --prefix=/proj/sot/ska make python_modules # TEST per instructions below # Allow all cron jobs to resume rm /proj/sot/ska/data/task_schedule/master_heart_attack Installation on GRETA network ------------------------------------ Perform GRETA network installation after a soak period of about one week on the HEAD network. Start by copying the skare tar distribution skare-0.11-32.tar.gz to /proj/sot/ska/dist on the GRETA network. Then do the installation steps:: # Do everything as aca su -l aca # Stop all cron jobs crontab -e cd /proj/sot/ska/dist mkdir skare-0.11-32 cd skare-0.11-32 tar xf ../skare-0.11-32.tar.gz # preview updates in key areas rsync --size-only --dry-run -av bin/ /proj/sot/ska/bin/ rsync --size-only --dry-run -av lib/ /proj/sot/ska/lib/ mv /proj/sot/ska/build{,.bak} ls /proj/sot/ska/dist/skare-0.11-32/ # DO THE INSTALL rsync -av /proj/sot/ska/dist/skare-0.11-32/ /proj/sot/ska/ >& install.log # Make modules that cannot be made on virtual machine, e.g. Sybase, and # ensure completeness. make python_modules # TEST per instructions below (as applicable for GRETA) # Allow all cron jobs to resume crontab -e Fallback -------- Only three files are expected to changed (the rest go in a new arch directory): - bin/sysarch - bin/syspathsubst - lib/perl/CXC/Envs/Flight.pm. Confirm with:: rsync --dry-run -av /proj/sot/.snapshot/nightly.0/ska/bin/ /proj/sot/ska/bin/ rsync --dry-run -av /proj/sot/.snapshot/nightly.0/ska/lib/ /proj/sot/ska/lib/ Restore with:: cp -p /proj/sot/.snapshot/nightly.0/ska/bin/sysarch /proj/sot/ska/bin/ cp -p /proj/sot/.snapshot/nightly.0/ska/bin/syspathsubst /proj/sot/ska/bin/ cp -p /proj/sot/.snapshot/nightly.0/ska/lib/perl/CXC/Envs/Flight.pm /proj/sot/ska/lib/perl/CXC/Envs/ rm -rf /proj/sot/ska/build mv /proj/sot/ska/build{.bak,} Post-install testing -------------------- Starcheck ^^^^^^^^^^^^ :: cd ~/hg/starcheck /proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test.new diff test.7cb31b.txt test.new.txt ==> OK Eng_archive ^^^^^^^^^^^^ :: cd ~/hg hg clone /proj/sot/ska/hg/eng_archive cd eng_archive Follow the steps for "Regression test for new skare in /proj/sot/ska" in NOTES.test. ==> OK Commanded states ^^^^^^^^^^^^^^^^^^^ :: cd ~/hg/timelines nosetests ==> PENDING... psmc_check ^^^^^^^^^^ :: ska cd ~/hg/psmc python ./psmc_check.py --run_start_time='2011:001' --outdir regress_ska.new diff regress_ska{.new,.7cb31b}/validation_quant.csv ==> OK Other modules ^^^^^^^^^^^^^ - Ska.Table: OK - Ska.DBI: OK - Quaternion (nose): OK - Ska.ftp (nose): OK - Ska.Numpy: OK - Ska.ParseCM: OK - Ska.quatutil: OK - Ska.Shell: OK - asciitable: OK