Ska Runtime Environment 0.15

THIS IS THE CURRENTLY-INCOMPLETE version of test / install procedures for skare-0.15, based on a copy of the 0.14 version.

Review

Notes and testing were reviewed by Jean Connelly.

Build

/proj/sot/ska/test

Install (or git pull) skare on 32-bit or 64-bit virtual CentOS-5 machine.

# Get skare repository on virtual CentOS-5 machine
cd ~/git/skare
git checkout master
git pull origin master

# Choose prefix (dev or flight) and configure
prefix=/proj/sot/ska/test
./configure --prefix=$prefix

# Make 64 or 32-bit installation
make all_64
make all_32  # on quango

Pre-install testing in Ska test

Xija

skatest
cd
python
import os
os.environ['ENG_ARCHIVE'] = '/proj/sot/ska/data/eng_archive'
import xija
xija.test()

==> OK 4/16/2013 (TLA)

Starcheck

skatest
cd ~/git/starcheck
git checkout master
git pull origin master
(unska; /proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test-flight)
make test
diff test-flight.txt test.txt

==> OK 4/16/2013 (TLA)

Eng_archive

cd
skatest
python
import Ska.engarchive
Ska.engarchive.test()

cd ~/git/eng_archive

Follow the steps for “Regression test for new skare (..) in $ska/dev” in NOTES.test.

==> OK 4/16/2013 (TLA)

Commanded states

skatest
cd ~/git/Chandra.cmd_states
python setup.py install
cd ~/git/cmd_states
make install
cd ~/git/timelines
make install

nosetests

==> OK 4/16/2013 (JC)

ACIS thermal load review

Test for for dpa_check, dea_check, acisfp_check, and psmc_check

==> OK 4/16/2013 (TLA)

DPA

Window 1 (FLIGHT):

% source /proj/sot/ska/bin/ska_envs.csh
% cd ~/git/skare/tests/0.15/acis_regression  # Use your own area here
Run the tool, e.g.
% python /proj/sot/ska/share/dpa/dpa_check.py \
 --outdir=dpa-feb0413a-flight \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

Window 2 (TEST):

% cd ~/git/skare/tests/0.15/acis_regression  # Use your own area here
% source /proj/sot/ska/test/bin/ska_envs.csh
% setenv ENG_ARCHIVE /proj/sot/ska/data/eng_archive
% python /proj/sot/ska/share/dpa/dpa_check.py \
 --outdir=dpa-feb0413a-test \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

DIFFS:

% diff dpa-feb0413a-flight/index.rst dpa-feb0413a-test/index.rst
% diff dpa-feb0413a-flight/temperatures.dat \
       dpa-feb0413a-test/temperatures.dat

DEA

Window 1 (FLIGHT):

% python /proj/sot/ska/share/dea/dea_check.py \
 --outdir=dea-feb0413a-flight \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

Window 2 (TEST):

% python /proj/sot/ska/share/dea/dea_check.py \
 --outdir=dea-feb0413a-test \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

DIFFS:

% diff dea-feb0413a-flight/index.rst dea-feb0413a-test/index.rst
% diff dea-feb0413a-flight/temperatures.dat \
       dea-feb0413a-test/temperatures.dat

PSMC

Window 1 (FLIGHT):

% python /proj/sot/ska/share/psmc_check/psmc_check.py \
 --outdir=psmc-feb0413a-flight \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

Window 2 (TEST):

% python /proj/sot/ska/share/psmc_check/psmc_check.py \
 --outdir=psmc-feb0413a-test \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

DIFFS:

% diff psmc-feb0413a-flight/index.rst psmc-feb0413a-test/index.rst
% diff psmc-feb0413a-flight/temperatures.dat \
       psmc-feb0413a-test/temperatures.dat

ACIS_FP

Window 1 (FLIGHT):

% python /proj/sot/ska/share/acisfp/acisfp_check.py \
 --outdir=acisfp-feb0413a-flight \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

Window 2 (TEST):

% python /proj/sot/ska/share/acisfp/acisfp_check.py \
 --outdir=acisfp-feb0413a-test \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

DIFFS:

## There are small expected diffs in both cases because of the random
## sampling in the flight Earth solid angle code.  This is changed
## in Skare 0.15, so subsequent regression testing will match.

% diff acisfp-feb0413a-flight/index.rst acisfp-feb0413a-test/index.rst
% diff acisfp-feb0413a-flight/temperatures.dat \
       acisfp-feb0413a-test/temperatures.dat

Other modules

Ska.Table -

cd ~/git/Ska.Table
git fetch origin
python test.py

==> OK 4/16/2013 (TLA)

Ska.DBI -

cd ~/git/Ska.DBI
git fetch origin
python test.py

==> OK 4/16/2013 (TLA)

Quaternion -

cd ~/git/Quaternion
git fetch origin
nosetests

==> OK 4/16/2013 (TLA)

Ska.ftp -

cd ~/git/Ska.ftp
git fetch origin
nosetests

==> OK 4/16/2013 (TLA)

Ska.Numpy -

cd ~/git/Ska.Numpy
git fetch origin
nosetests

==> OK 4/16/2013 (TLA)

Ska.ParseCM -

cd ~/hg/Ska.ParseCM
hg incoming
python test.py

==> OK 4/16/2013 (TLA)

Ska.quatutil -

cd ~/hg/Ska.quatutil
hg incoming
nosetests

==> OK 4/16/2013 (TLA)

Ska.Shell -

cd ~/hg/Ska.Shell
hg incoming
python test.py

==> OK 4/16/2013 (TLA)

asciitable -

cd ~/git/asciitable
git checkout 0.8.0
nosetests

==> OK 4/16/2013 (TLA)

esa_view -

cd
python /proj/sot/ska/share/taco/esaview.py MAR2513

==> OK 4/16/2013 (TLA)

Installation on GRETA network (test)

On ccosmos:

skatest
ska_version  # 0.15-r293-e754375

On quango (32-bit):

skatest
ska_version  # 0.15-r293-e754375

On chimchim as SOT:

set version=0.15-r293-e754375
mkdir /proj/sot/ska/test/arch/skare-${version}
rysnc -av aldcroft@ccosmos:/proj/sot/ska/test/arch/x86_64-linux_CentOS-5 \
                           /proj/sot/ska/test/arch/skare-${version}/
rysnc -av aldcroft@ccosmos:/proj/sot/ska/test/arch/i686-linux_CentOS-5 \
                           /proj/sot/ska/test/arch/skare-${version}/

cd /proj/sot/ska/test/arch
ls -l  # make sure everything looks good
ls -l $skare-${version}
rm i686-linux_CentOS-5
rm x86_64-linux_CentOS-5
ln -s skare-${version}/i686-linux_CentOS-5 ./
ln -s skare-${version}/x86_64-linux_CentOS-5 ./

Esa_view

Check that ESA view tool passes basic functional checkout:

cd
python /proj/sot/ska/share/taco/esaview.py MAR2513

Installation on HEAD network (flight)

Installation:

# Do everything as aca
su -l aca
ska

# Prepare for in-place installation
cd ~/git/skare
git checkout 0.15  # Note: skare-0.14 branch has post-install updates vs. 0.14 tag
git log

# Stop all cron jobs
touch /proj/sot/ska/data/task_schedule/master_heart_attack
# Wait at least a minute

# Build updated skare on ccosmos
./configure --prefix=/proj/sot/ska
make python_modules  # Could be "make all_64" for a bigger update

# Build 32-bit version on quango
ssh aca@quango
cd ~/git/skare
make python_modules  # Could be "make all_32" for a bigger update

# TEST per instructions below

# Allow all cron jobs to resume
rm /proj/sot/ska/data/task_schedule/master_heart_attack

Post-install testing on HEAD

Starcheck

cd ~/git/starcheck
/proj/sot/ska/bin/starcheck -dir AUG0104A -fid_char fid_CHARACTERIS_JUL01 -out test.new
diff test.7cb31b.txt test.new.txt

==> OK 4/17/2013 TLA

Eng_archive

cd ~/git/eng_archive

Follow the steps for “Regression test for new skare in /proj/sot/ska” in NOTES.test.

==> SKIP

Commanded states

cd ~/git/timelines
nosetests

==> OK 4/17/2013 TLA

Other modules

  • Ska.Table: OK 4/17/2013 TLA
  • Ska.DBI: OK 4/17/2013 TLA
  • Quaternion (nose): OK 4/17/2013 TLA
  • Ska.ftp (nose): OK 4/17/2013 TLA
  • Ska.Numpy: OK 4/17/2013 TLA
  • Ska.ParseCM: OK 4/17/2013 TLA
  • Ska.quatutil: OK 4/17/2013 TLA
  • Ska.Shell: OK 4/17/2013 TLA
  • asciitable: OK 4/17/2013 TLA

acisfp_check

Window 1 (FLIGHT):

ska
cd ~/git/skare/tests/0.15/acis_regression
python /proj/sot/ska/share/acisfp/acisfp_check.py \
 --outdir=acisfp-feb0413a-new \
 --oflsdir=/data/mpcrit1/mplogs/2013/FEB0413/oflsa \
 --run-start=2013:031

diff acisfp-feb0413a-flight/index.rst acisfp-feb0413a-new/index.rst
diff acisfp-feb0413a-flight/temperatures.dat \
       acisfp-feb0413a-new/temperatures.dat

==> OK 4/17/2013 TLA

ESA view

cd
python /proj/sot/ska/share/taco/esaview.py MAR2513

==> OK 4/17/2013 TLA

Notes

REMEMBER to “make install” eng archive as needed!

Installation on GRETA network (flight)

Ensure that the HEAD flight distribution has been installed and tested.

On chimchim as SOT:

set version=0.15-r293-e754375
cd /proj/sot/ska/dist
mkdir skare-${version}
rsync -azv aldcroft@ccosmos:/proj/sot/ska/arch/x86_64-linux_CentOS-5/ \
      skare-${version}/x86_64-linux_CentOS-5/
rsync -azv aldcroft@ccosmos:/proj/sot/ska/arch/i686-linux_CentOS-5/ \
      skare-${version}/i686-linux_CentOS-5/

On chimchim as FOT CM:

cd /proj/sot/ska/arch
set version=0.15-r293-e754375
mkdir skare-${version}
ls /proj/sot/ska/dist/skare-${version}
rsync -av /proj/sot/ska/dist/skare-${version}/ skare-${version}/

rm i686-linux_CentOS-5
rm x86_64-linux_CentOS-5
ln -s skare-${version}/i686-linux_CentOS-5 ./
ln -s skare-${version}/x86_64-linux_CentOS-5 ./

Smoke test on chimchim:

source /proj/sot/ska/bin/ska_envs.csh
ipython --pylab
import Ska.engarchive.fetch as fetch
dat = fetch.Msid('tephin', '2012:001', stat='5min')
dat.plot()

Smoke test on snowman:

source /proj/sot/ska/bin/ska_envs.csh
ipython --pylab
import Ska.engarchive.fetch as fetch
dat = fetch.Msid('tephin', '2012:001', stat='5min')
dat.plot()

Fallback:

set version=0.14-r272-ebf9f03
cd /proj/sot/ska/arch
rm i686-linux_CentOS-5
rm x86_64-linux_CentOS-5
ln -s skare-${version}/i686-linux_CentOS-5 ./
ln -s skare-${version}/x86_64-linux_CentOS-5 ./

Test on GRETA network (flight)

Test xija as SOT (32 and 64 bit):

ska
cd
ipython
import xija
xija.test()

Test eng_archive (32 and 64 bit):

ska
ipython
import Ska.engarchive
Ska.engarchive.test()

ESA view tool (basic functional checkout):

# On chimchim only
ska
cd
python /proj/sot/ska/share/taco/esaview.py MAR2513