Scripts Package:
Version History
Package Version | Name | Changes |
---|---|---|
4.15.3 21 August 2023 |
dax |
The Chandra Grating Energy Lookup script now use grep -E rather than egrep, and a typo in the name of the Distance Transform task was corrected. |
obsid_search_csc, search_csc |
Support added for the srcpoly filetype, which refers to the per-master extended source polygon regions for those 2CXO sources whose name ends in X. |
|
specextract |
Bug fixed where if the background spectrum is extracted from an event file that is generated by the 'blanksky' script, the AREASCAL keyword in the spectrum file is used to account for the estimated background scaling term automatically with spectral analysis software. Between Contrib 4.13.1 and 4.15.2, AREASCAL was set to the 'blanksky' BKGSCALn value, which can lead to a severe overestimation of blanksky/stowed background by the automated background scaling applied during spectral analysis in Sherpa and Xspec. Using an AREASCAL value of 1/BKGSCALn will provide the appropriate scaling for both spectral modeling and background subtraction for the analysis software. |
|
4.15.2 7 June 2023 |
get_dither_parameters |
The default Chandra dither parameters have changed recently which may be important especially when doing timing analysis and trying to identify instrumental effects. This script will estimate the dither amplitude and period from the aspect solution file. |
bkg_fixed_counts |
Logic to parse coordinates simplified. |
|
convert_xspec_user_model |
Updated to better support building with shared libraries on MacOS. |
|
convert_xspec_script |
Several enhancements and bugs fixed to better handle XCM files. Initial support added for XSpec's MDEFINE function, although not all cases are supported, and improved handling of the NOTICE and IGNORE commands with files that are non-OGIP compliant.. |
|
psf_contour |
|
|
rank_roi |
|
|
splitroi |
Updated to use the new CXCRegion module object which has increased numerical precision of region parameters. |
|
install_marx |
Updated to remove dependence on deprecated setuptools module. |
|
simulate_psf |
Corrects the frame time used when simulating pileup. |
|
specextract |
Internal updates to how CIAO tools are run to provide more robustness with parallel processes. |
|
srcflux |
|
|
color_color, correct_periscope_drift, deflare, ecf_calc |
Updated to change the matplotlib plotting backend if no $DISPLAY is set. |
|
ciao_contrib.cxcdm_wrapper |
Bug fix when opening a file with 0 columns. |
|
ciao_contrib.param_soaker |
The revision can now be supplied and will be included with the verbose output. |
|
4.15.1 24 January 2023 |
color_color |
Calculate color-color values for a model and a range of parameters given an ARF. |
aplimits |
The number of steps for numerical integration increased to improve the behavior in certain cases. |
|
blanksky |
Corrected the screen output reporting the updated BKGSCAL keywords, albeit the values written to file header were correct. |
|
combine_spectra |
Two bugs have been fixed when the src_arfs parameter is set:
|
|
convert_xspec_script |
Better handling of cases where a local model is used and a problem is fixed handling multiple groups. |
|
convert_xspec_user_model |
Still an experimental script, it has been updated to support models that do not contain C++ code. Initial support for building FORTRAN models with udmget has been added with the --udmget or --udmget64 flags. |
|
find_chandra_obsid |
Improved handling of non-ASCII PI names. |
|
specextract |
|
|
srcflux |
Problem fixed when the script is run with bkgresp=no. |
|
coords.resolver |
The identify_name function should better handle the case of unknown names or one of the name servers being temporarily down when the ciao-install version of CIAO does not work with the system SSL libraries. |
|
sherpa_contrib.profiles |
The module has been updated to account for Sherpa plotting updates. |
|
4.15.0 15 December 2022 |
aplimits | Compute upper limits for the detection of a source, using data obtained from background apertures in event lists, images, and exposure maps. It is based on the article: On computing upper limits to source intensities (Kashyap et al. 2010, ApJ, 719, 900); https://ui.adsabs.harvard.edu/abs/2010ApJ...719..900K. |
blanksky | The stowedbg parameter has been added to allow the stowed background files to be used. This is only useful for CTI-corrected ACIS observations. |
|
bkg_fixed_counts | Create a background region with a fixed number of counts. The region center is specified and then an annulus is created which encloses the requested number of counts (as a minimum). The inner radius of the annulus is based on the PSF size at the location, set by the enclosed counts fraction, and overlapping source regions if set. |
|
chandra_repro | Fixed a problem when multiple SSO eph1 files are found. Work around a DM bug when tg_zo_position=detect which prevented tgdetect2 from choosing the tg_find_zo algorithm |
|
convert_xspec_user_model | The script has been updated to account for changes in the interface to the XSPEC model library. The script will also now attempt to exclude code that XSPEC's initpackage call may have added to the directory. Please contact the CXC helpdesk if you are having problems with this script. |
|
correct_periscope_drift | The script has been updated to account for Sherpa plotting updates. |
|
dax |
dax now properly updates the WCS when ds9 has blocked the image being analyzed (this is different to zoom or bin, which did not need updating). Three new tasks have been added: Coordinates -> Interactive Grating Coordinates Vector, Regions -> PSF Contour, and Regions -> Fixed Counts Background. The list of Image Processing -> Non-Linear Filters includes the new dmimgfilt filters: ridge, plain, q10, q90, and jitter. Changes to Sherpa fitting routines to clean up the textual output. |
|
mktgresp | As mkgrmf can now create a diagonal matrix for HRC data, the work-around to handle the HRC-I + HETG case has been removed. |
|
psf_contour | Create a source region file from a simulated mono-chromatic PSF that is created with MARX. There are a number of ways that the region can be constructed based on the desired fraction of counts: a contour; a lasso, which is similar to the contour option but uses dmimglasso rather than dmcontour; a convex hull, which should reduce the complexity compared to the contour or lassoo options; an ellipse fit to the data; and an ellipse that encloses the fraction. |
|
specextract |
The resp_pos parameter has been added. Previously, specextract would use the location of the maximum pixel in the extraction region, but the default is to use the center from the extraction region, but the resp_pos parameter can be used to change this. The way that the tools are run in parallel has been reworked to improve the behavior. The screen output - when used in an interactive terminal - has been updated to better handle the case where multiple files are being processed. A fix for an odd bug with the name of the combined files not matching the outroot parameter has been fixed. |
|
srcflux |
The plugin concept has been added to srcflux, which allows users to add extra code and merge the results to the tables and outputs that srcflux creates. With psfmethod=marx, the PSFs will now be simulated in parallel (based on the 'parallel' and 'nproc' parameters). The default background region inner radius has been increased. Previously it was the same as the source radius; it is now 1.7 times the source radius. This improves the background estimate around very bright sources; events spread by the PSF could bias the background estimate. When merging observations, a new "INSIDE_FOV" column is added to the merged .flux output file. It is an array of boolean values (True|False) which indicates which observations the source was imaged in. |
|
statmap | Compute simple statistics for events in each map region. This allows simple statistics to be computed from adaptive binning tools, such as dmnautilus and dmradar. |
|
ciao_contrib.runtool | The module has been updated to reflect parameter changes and the new scripts added in this release. The module now points out those scripts which can not be run - as they do not have a parameter file - and points users to alternative ways to run them. |
|
sherpa_contrib.chart | The module has been updated to account for Sherpa plotting updates. |
|
sherpa_contrib.marx | The module has been updated to account for Sherpa plotting updates. |
|
coords.gratings | Introduces a new derived class, TGPixlib, to help convert from sky coordinates to grating coordinates: dispersion angles and energy. |
|
4.14.4 8 November 2022 |
specextract |
The script will now warn if the data lies outside the supported focal-plane temperature ranges for calibration of recent ACIS observations, and listing possible situations the calibration may be insufficient. |
convert_xspec_user_model |
Still an experimental script, it has been updated to improve support for user models, in particular recent versions of relxill and reltrans. Please contact the CXC Helpdesk if you are having problems with this script. |
|
4.14.3 22 September 2022 |
search_csc, obsid_search_csc |
The scripts have been updated to allow users to search the "current" Chandra Source Catalog, catalog="current". The "current" CSC catalog is, as of September 2022, the in-production version of CSC 2.1. Please see the Chandra Source Catalog Release 2.1 page, for details and important caveats. |
coords.chandra |
Module updated to fix a problem when the configuration data is missing some of the SIM header keywords. |
|
4.14.2 19 April 2022 |
dax |
The dax options in DS9 have been enhanced by the addition of the Cross Correlate option, which uses the acrosscorr tool to compare the images in two frames. This can be used to look for shifts between the two images. |
chandra_repro |
|
|
combine_grating_spectra |
The output files now includes the string "_combo_", which is appended to the output root name. This was needed to avoid confusion when using both mktgresp and this script with the same outroot parameter value. |
|
download_obsid_caldb | The script now skips un-readable files in the input directory. | |
mktgresp |
Internal code change due to a bug fix introduced in CIAO 4.14. This does not change the behavior of the script. |
|
simulate_psf | The new numrays parameter lets the user set a specified number of rays (events) instead of the number of iterations to run. | |
specextract |
The new parameter readout_streakspec has been added which is used when extracting a spectrum from the ACIS readout streak of a source. Users should take care to verify the determined number of ACIS pixel rows encompassed by the extraction region and the subsequent effective exposure time for the streak spectrum are reasonable. |
|
splitobs | The script will now handle interleaved-mode grating observations. | |
src_psffrac | Internal changes taking advantage of updates to the Python region module. The behavior of the script is unchanged. | |
srcflux |
|
|
ciao_contrib.runtools |
Module has been updated to reflect the parameter updates in chandra_repro, simulate_psf, and specextract. |
|
coords.resolver |
Fixed bug using the Sesame resolver when the CADC service is down. |
|
4.14.1 27 January 2022 |
specextract |
Several regressions found in the 4.14.0 release have been fixed, primarily affecting usage with blanksky background files and data of Solar System objects. |
mktgresp |
The default value for the verbose parameter has been changed to 1 from 0 |
|
find_chandra_obsid |
Updated to better handle cases where the system OpenSSL is unable to access SSL certificates. |
|
blanksky_image |
The default for the clobber parameter has been changed to no. |
|
4.14.0 14 December 2021 |
logging |
When a script errors out the message will now be displayed in red unless the NO_COLOR environment variable is set—see the site athttps://no-color.org/ or the output is being written to a file rather than a TTY. |
dax |
|
|
find_mono_energy |
Calculates an "effective" mono-chromatic energy for a given spectral model, and set of parameters, given a Chandra ARF and RMF. This can be used to see how the ACIS contamination layer changes the effective response over time, or to calculate the best mono-chromatic energy when calculating exposure maps with scripts like fluximage and merge_obs. |
|
blanksky_sample |
The dead-time correction is now used to better sample the time values created for the events in the blank-sky file. |
|
chandra_repro |
The reprocessed event file now has a CONTENT keyword set to "EVT2" and HDUCLAS2 keyword set to "ACCEPTED". |
|
check_ciao_version |
The script now reports the 'conda install' command that is needed when an update is needed. |
|
convert_xspec_script |
The script now handles XCM scripts containing XSPEC table models (atable, mtable, and etable). |
|
convert_xspec_user_model |
The script has been updated to support changes in XSPEC 12.12.0 and Sherpa. However it is not guaranteed to work for the same models as were supported in CIAO 4.13: please contact the CXC helpdesk if you are having problems with this script. |
|
download_obsid_caldb |
The script now sets the CALDBALIAS which is needed due to a change in the caldb4 Python module in CIAO 4.14. |
|
fluximage |
The script now creates a FOV file for the observation. |
|
flux_obs |
The pixel size calculation used when the maxsize parameter is set has been changed to avoid problems when also setting the psfecf parameter. There have been improvements when combining a large number of observations. The FOV file is now created for each reprojected event file and a combined version. |
|
merge_obs |
The pixel size calculation used when the maxsize parameter is set has been changed to avoid problems when also setting the psfecf parameter. There have been improvements when combining a large number of observations. The FOV file is now created for each reprojected event file and a combined version. |
|
reproject_obs |
The script now generates FOV files for each reprojected event file and a combined file (that includes all the individual shapes). |
|
srcflux |
Fixed a rare error when merging results. If a source was at the edge of the field of view of a CCD it could appear as if it belonged to an inactive CCD, thanks to dither, which caused the script to crash. |
|
specextract |
The tool now runs tasks in parallel to reduce run-time for users with multi-core machines. This can be controlled with the new parallel and nproc parameters. As part of this update the script should provide better diagnostic messages when there is a problem. |
|
ciao_contrib.runtool |
Parameter values are best handled using the natural Python type, so for boolean parameters this means using True or False, but support has been enhanced for the following values: for True, 1, "1", "true", "yes", "on" and for False, 0, "0", "false", "no", "off". This may change the behavior of existing code, since it changes how boolean parameters are handled (e.g. setting a boolean value to "false" will now set it to False when it previously would have set it True. The module has been updated to reflect new tools (dmradar) and parameter settings in CIAO 4.14. |
|
sherpa_contrib.utils |
The sherpa_contrib.utils.renorm routine has seen several minor fixes. |
|
4.13.3 22 September 2021 |
chandra_repro |
The HRC-S/LETG bow-tie filter, designed to reduce background, is not appropriate for data acquired after the HRC-S high-voltage gain was changed. The bow-tie filter is marked invalid in CalDB 4.9.6 for these data. chandra_repro has been modified to correctly recognize that the file is not appropriate and continue processing without it. |
4.13.2 11 June 2021 |
specextract |
Bugs fixed that led to failures combining results when combine=yes and quashing misleading error messages while handling blanksky background files. |
dax |
|
|
simulate_psf |
The MARX TStart value is now taken directly from the input file header without being converted to JEPOCH. This only affects the simulated TIME values. |
|
install_marx |
Create a marx symbolic link to the version specific installation directory (e.g. marx-5.5.2). |
|
4.13.1 18 March 2021 |
download_chandra_obsid |
The --exclude option has been added, to allow file types to be excluded, and the vvref file type has been added to identify the vvref2.pdf.gz file in the secondary directory. |
download_obsid_caldb |
The script will now skip downloading CALDB files associated with the transmission gratings (TG) if neither of the gratings were inserted during the observation. |
|
fluximage, flux_obs, merge_obs |
The frame-store shadow is now included when calculating the instrument map for ACIS observations. This means that a small number of rows of the instrument and exposure maps are now excluded, to match the data processing. Please see the ACIS frame-store caveat for more information: Caveats about ACIS Frame Store Shadow Bad Pixels. |
|
dax |
|
|
specextract |
The frame-store shadow is now included when calculating the ARF for ACIS observations. This means that a small number of rows of the CCDs are now excluded. Bug fixed handling blanksky background files and additional internal changes made cleaning up code and logic. |
|
mktgresp |
The frame-store shadow is now included when calculating the grating ARFs for ACIS observations making a change to the effective area at wavelengths which intersect the bottom edge of the CCD (if any). Updated to support HRC-I/LETG LSFPARM files if they are available in the CALDB. They are expected to be released in March 2021 with the Chandra CALDB 4.9.5 release. |
|
chandra_repro |
Now updates the reprocessed aspect solution file, pcadf*_repro_asol1.fits, to include the RA_NOM, DEC_NOM, and ROLL_NOM keywords. They keywords are removed the by asp_offaxis_corr tool but are required by MARX. The new parameter, pi_filter, controls whether the HRC-S/LETG background PI filter is applied or not. |
|
check_ciao_version |
Bug fixed affectin ciao-install installations when checking CALDB version. |
|
4.13.0 December 2020 |
acis_check_pha_range |
Estimate the actual energy range for an ACIS observation. |
chandra_repro |
If the script can only find original-format aspect solution files (those with header keyword CONTENT=ASPSOL) and with the new parameter asol_update=yes, then chandra_repro will run the new asp_offaxis_corr tool to apply the DY, DZ, and DTHETA boresight corrections directly to the RA, Dec, ROLL, and quaternion values. This new aspect solution file will have CONTENT=ASPSOLOBI and should be used for all data analysis. Additional changes include:
|
|
convert_xspec_user_model |
Experimental script, reintroduced after removal in CIAO 4.11, allowing XSpec user models to be used in Sherpa. The interface is similar to before but the model compilation is handled differently. |
|
convert_xspec_script |
Experimental script that converts an XSpec (xcm) save file to a file that can be used in Sherpa or a Python program. |
|
dax |
Plotting updated to match changes to Sherpa PHA plot style. |
|
download_chandra_obsid, find_chandra_obsid |
Internal changes to be more robust, anticipating future changes to the Chandra Data Archive. |
|
merge_obs, reproject_obs |
Screen output and warning messages use reduced numerical precision. |
|
mktgresp |
Fixed to work with HRC-I/LETG data where ther had been a grid mismatch between the RMF and PI files. Since there are no calibrations for gratings used with HRC-I, a diagonal RMF is generated. |
|
rank_roi |
This script will take a stack of ROI output files and assign the overlapping area to "the best" source. |
|
regphystocel |
This script will convert a region stored in physical coordinates, including FITS region files, into DS9-format regions in celestial coordinates. |
|
specextract |
Internal code cleanup. Some error and warning message formatting changed. |
|
srcflux |
When multiple event files are specified, users will now also get a flux estimate from all the observations combined. Currently model independent fluxes are not combined; but rates, photon fluxes, and model fluxes (absorbed and unabsorbed) are computed. Uncertainties are computed using the aprates tool. Variable sources will likely yield incorrect flux estimates. Additionally:
|
|
ciao_contrib.psf_contrib |
Adds the PSF class and the psfFrac() and psfSize() functions to simplify the use of the CIAO psf module. |
|
coords.format |
The deg2ra() and deg2dec() functions have gained an optional ndp parameter to restrict the number of decimal places used in the output. |
|
sherpa_contrib.xspec.xsconvolve |
Removed xsconvolve model, as Sherpa now directly supports XSpec convolution models. |
|
4.12.4 18 September 2020 |
dax |
dax significantly enhanced. For most tasks, users will now see a progress bar with the name of the CIAO tool which is running; each of the Sherpa fitting tasks will now launch a model parameter editor and interactively adjust the plots and results. The Net Counts and Photometry (srcflux) tasks have moved into the Count Rates and Fluxes sub-menu. The format of the Net Counts has changed slightly and now includes net rate errors. The newest features are highlighted below:
|
deflare, lightcurves.py |
Error message enhanced when sigma clipping fails, providing the unclipped mean and \(n\sigma\) count rate calculated from the input lightcurve. |
|
4.12.3 2 July 2020 |
check_ciao_caldb |
The script has been updated to handle changes to the way that the ACIS DET_GAIN file is indexed in CalDB 4.9.2.1. This file is used in a check that the CalDB is set up correctly. Users who run an old version of the script with CalDB 4.9.2.1 or later will see the following warning when check_ciao_caldb is run: WARNING: 2 matches found for DET_GAIN query, expected only 1. match = /soft/ciao/CALDB/data/chandra/acis/det_gain/acisD2000-01-29gain_ctiN0008.fits[1] match = /soft/ciao/CALDB/data/chandra/acis/det_gain/acisD2000-01-29gain_ctiN0008.fits[1] |
check_ciao_version |
The script has been fixed for Conda installs when a supporting library has been updated. |
|
blanksky, blanksky_sample |
The scripts now accept a new weighting method, particle-rate, which scales the background by comparing the particle background rate (high-energy, above the region where Chandra has any effective area) of the datasets. The blanksky script also now supports use with VFAINT data when the check_vf_pha=no option is chosen when running acis_process_events/chandra_repro. |
|
simulate_psf |
The input file can now be either an image or an event file. |
|
src_psffrac |
The input file can now be either an event or image file. The energy value used is added to the output file using the ENERGY keyword. |
|
4.12.2 08 April 2020 |
chandra_repro |
The skyfov method=convexhull algorithm will now be used when the script find the new style aspect solution files (those with the header keyword CONTENT="ASPSOLOBI"). This new FOV provides a tighter fitting polygon around each chip. |
download_chandra_obsid |
Updated to no longer accesses the archive via FTP. The file download is now done in decreasing order of file size (per ObsID). |
|
download_obsid_caldb |
Updated to no longer accesses the CalDB files via FTP and now generates standard CALDB setup scripts. |
|
find_chandra_obsid |
The script was broken by the DS 10.8.3 upgrade. and now has been fixed. The name server now falls back to using the Sesame service from CDS if the CADC server fails. |
|
tgsplit |
Fixed bug with TYPE:II PHA files created with the tgextract2 tool where the background BACKSCAL column was incorrectly copied from the source region. |
|
dax |
Updated the Regions→PSF Fraction task to force regions into DS9 format. This update prevents dax from hanging when users have modified their preferences to save regions in CIAO format. |
|
simulate_psf |
Fixed bug that caused parameter values in the script's HISTORY records to be reset to their default (blank) values. |
|
correct_periscope_drift |
The script will now run when verbose=0. |
|
coords.resolver |
The identify_name routine now tries the Sesame server from CDS if the CADC name server fails to identify the name. |
|
4.12.1 22 November 2019 |
chandra_repro |
The script has been updated to include the correction for the framestore shadow (new to CIAO 4.12), which adds the bottom rows of each ACIS CCD to the bad-pixel maps to account for the "shadow" caused by the framestore cover. |
combine_spectra |
All TG_M filters removed from the output file subspace so that extraneous subspace components are not included in the file. |
|
combine_grating_spectra |
Remove the TG_M and SPEC_NUM keywords from the output file. |
|
deflare |
Updated to work with Matplotlib 3.1. |
|
dax |
Spectral and radial fits visualization now contains both the fit (data and best-fit model) and the residuals about the best-fit model. |
|
make_instmap_weights |
The default setting for the xsect parameter has changed from bcmc to vern to match the behavior of the XSPEC 12.10.1 model library. |
|
tgsplit |
Bug fixed when trying to work with Type II PHA files created by the tgextract2 tool. |
|
check_ciao_version, check_ciao_caldb |
Updated to work with the new CXC https CXC site. The check_ciao_version also updated to work with CIAO installations using the conda package manager. |
|
ciao_contrib.runtool |
Updated for parameter changes in CIAO 4.12. |
|
lightcurves |
Module updated to work with Matplotlib 3.1. |
|
sherpa_contrib.utils |
The plot_instmap_weights routine has been updated to use Matplotlib preference settings than ChIPS ones from get_data_plot_prefs. |
|
sherpa_contrib.xspec.xsconvolve |
Added the load_xskyconv routine to support the kyconv convolution model. Please note that support for XSPEC convolution models is considered experimental and there are known problems, so use carefully. |
|
ciao_contrib.all |
Module no longer imports the chips_contrib module. |
|
chips_contrib |
The chip_contrib.decorators, chips_contrib.helix, chips_contrib.images, chips_contrib.regions, chips_contrib.scatter, and chips_contrib.utils modules have been removed, as Matplotlib has supplanted ChIPS in CIAO. |
|
4.11.5 28 October 2019 |
search_csc, obsid_search_csc |
These scripts now default to the Chandra Source Catalog 2.0 release, setting version=csc1 if you need to search version 1.1 of the CSC. |
deflare, lightcurves.py |
The script has been fixed so that XMM and Suzaku—or any file missing the some header keywords—lightcurve files may be used again to create plots. |
|
merge_obs, flux_obs |
Bug fixed when the psfmerge parameter is set to exptime or expmap caused the scripts to fail. |
|
combine_spectra |
A bug has been fixed where if bkg_spectra=NONE, it should have ignored the BACKFILE keywords and skipped combining the background spectra, but failed to do so. |
|
ciao_contrib.runtool |
The module has been updated to add the catalog parameter to the search_csc and obsid_search_csc functions. The default is to use version 2.0 of the Chandra Source Catalog. |
|
4.11.4 6 August 2019 |
chandra_repro |
Added support for HRC observations with 0 ontime. |
correct_periscope_drift, sherpa_contrib.profiles, sherpa_contrib.chart.plot_chart_spectrum, sherpa_contrib.marx.plot_marx_spectrum, sherpa_contrib.utils.plot_instmap_weights |
Uses the same plotting backend (ChIPS or Matplotlib) as Sherpa does, set in the ~/.sherpa.rc file. The Sherpa plotting functionality to use Matplotlib rather than ChIPS when the plot_pkg setting is pylab. The plots may have changed slightly in this update. |
|
ecf_calc |
Replace ChIPS with matplotlib for plotting. |
|
make_instmap_weights |
Explicitly sets solar abundances and photoelectric cross-section table for XSpec models. |
|
coords.chandra |
Improved error checking on input keyword dictionary and improved docstrings. |
|
4.11.3 21 May 2019 |
chandra_repro |
When reprocessing a gratings observation, individual (type I rather than type II) source and background files are created, with the correct ANCRFILE, RESPFILE, BACKFILE, and BACKSCAL keywords. For LETG datasets using HRC-S, grating responses for orders -8 to +8 are now created (previously only -1 and +1 were created). |
srcflux |
Bug fixed where the net_phoflux and net_flux values have been corrected for an error in calculating the source contribution to the background area via the PSF. If you set the psfmethod parameter to file, marx, or arfcorr, then the fluxes were being over-estimated by ~5 to 15% (typical). The over-estimate was proportional to the ratio of the area of the background to source area and to the background PSF fraction. |
|
dax |
Major update; highlights include:
|
|
blanksky |
The aimpoint chip of the observation is now calculated using the RA_PNT and DEC_PNT keywords rather than the RA_NOM and DEC_NOM ones. This is to better support reprojected data sets. |
|
convert_ds9_region_to_ciao_stack |
This script is used in dax to convert from DS9 regions to CIAO format. This may be useful for other users, but please be aware that interpreting a DS9 region file can be a surprisingly complex task. |
|
4.11.2 25 April 2019 |
chandra_repro |
Support for level-2 event files with no exposure time added and FOV file is generated using the time ranges from the observation's aspect solution. |
blanksky |
Modified so that the *_PNT and *_AVG header keywords are no longer copied, as this is handled internally by reproject_events in CIAO 4.11. |
|
blanksky_image |
Bug fixed in parsing the data model subspace to recognize any chip filters that have been applied to the input file. |
|
deflare |
Updated to use matplotlib rather than ChIPS for plotting. The output is similar but will not match exactly. This change should improve support for running the script remotely or on a system with no X display. |
|
find_chandra_obsid |
Work around CERTIFICATE_VERIFY_FAILED errors seen on some MacOS/openSSL systems, falling through to curl or wget to download the data. |
|
install_marx |
Runs make clean after a successful installation. |
|
obsid_search_csc, search_csc |
Logic error corrected when an invalid user query triggers an unhelpful error message. |
|
sherpa_contrib.marx |
Bug fixed in the save_marx_spectrum function so that the output is normalized by the bin width, as required by MARX. |
|
4.11.1 30 November 2018 |
chandra_repro |
Updated for HRC to keep all the standard columns defined in the hrc_process_events stdlev1 event-definition parameter and the SAMP values. |
fluximage, flux_obs, merge_obs |
Can now create a PSF map using the optional "psfecf" parameter. An additional "psfmerge" parameter is available in flux_obs and merge_obs for choosing how the per-observation PSF maps are combined. |
|
fullgarf |
"ardlibqual" parameter added allowing users to pass ardlib qualifiers to the calls to mkgarf. |
|
dax |
Internal changes and improved error messages. |
|
splitroi |
Fixed bug introduced to script in CIAO 4.10. |
|
ciao_contrib.runtool |
Updated for parameter changes in CIAO 4.11. |
|
sherpa_contrib.xspec.xsconvolve |
Updated the experimental support for XSPEC convolution models to add support for the following XSPEC models: lumin, cpflux, rfxconv, rgsxsrc, vashift, vmshift, and xilconv |
|
convert_xspec_user_model | Script removed as it has not been updated yet to support XSpec 12.10.0e, which is provided in CIAO 4.11. | |
chips_contrib.pyplot | As CIAO 4.11 provides Matplotlib, the experimental API for providing a Matplotlib-like API for ChIPS users has been removed. | |
4.10.3 7 November 2018 |
find_chandra_obsid, search_csc |
Updated the URL used for the name resolver provided by the CADC to avoid problems with certain name searches. Added support to fall over to curl or wget as the Chandra Data Archive has moved to using https. |
blanksky |
Script updated to support observations made in a sub-array mode. |
|
dax |
Updated to ensure that on systems where DS9 autoloads funtools or zhtools analysis tools, that it is still able to start the ChIPS server in the background. |
|
deflare |
The ahelp file has been updated to match the parameter file. There is no change to the behavior of the script. |
|
download_obsid_caldb |
Updated to verify the size for existing CALDB files on disk with those on the FTP site. Partial files are automatically retrieved again. |
|
mktgresp |
Fix a Python 3 problem version that would skip creating both HEG and MEG responses. |
|
srcflux |
Internal fix to computation of near-chip edge flag related to how floating-point values are treated in the pypixlib module. |
|
combine_spectra, combine_grating_spectra, simulate_psf, srcflux, mktgresp, tgsplit |
Updated so that when the outroot parameter is a directory, adjusts file names so they no longer begin with an underscore or period. |
|
sherpa_contrib.marx |
This module provides the save_marx_spectrum, plot_marx_spectrum, and get_marx_spectrum which are used when using Sherpa to generate model spectra for MARX. They are similar to the routines provided by sherpa_contrib.chart. |
|
4.10.2 15 May 2018 |
find_chandra_obsid |
Script has been updated to use the new location of the Chandra Footprint Server, which is https://cxcfps.harvard.edu/cda/footprint/cdaview.html. Unfortunately, not all versions of CIAO 4.10 contain a Python that supports SSL, and in these cases the script will try to use the curl and wget command-line tools to access the data. |
specextract |
Intended for internal use in support of the HRC Calibration group, the rmffile parameter is enabled for HRC observations to extract zeroth-order gratings data. It is expected that typical users should keep rmffile=CALDB for HRC data. |
|
4.10.1 18 April 2018 |
chandra_repro, combine_spectra, gti_align, obsid_search_csc, reg2tgmask search_csc, tgmask2reg |
Internal changes to the way development libraries are located. |
acis_bkgrnd_lookup |
Removes work-around for CALDB treating "0" as a NULL value. |
|
blanksky_image |
Support added for multi-chip reference images with subspace components containing more than one CCD ID, which often occurs for image files generated by fluximage. |
|
combine_grating_spectra |
Allow tool to work when no background spectra have been extracted. Internal updates to use standard wrapper for tgsplit tool. |
|
fullgarf, mktgresp |
Create additional per-chip gARFs to deal with the case when zeroth-order is not on ACIS-7. |
|
download_obsid_caldb |
Updated to allow it to work with file names containing DM filters. |
|
install_marx |
Force script to use bash shell to fix issue on Ubuntu which defaults to using 'dash'. |
|
make_psf_asymmetry_region |
The roll is now taken from the ROLL_PNT keyword in preference to the ROLL_NOM keyword (as was previously always used). This will only make a difference for data that has been corrected for astrometry shifts or reprojected, and the small number of multi-ObI data sets. The plate scale is now taken from the pixlib settings rather than hard coded, which means that radii for HRC values will decrease by ~0.05%. |
|
simulate_psf |
When using ray files for ChaRT, users can now set ra=INDEF and dec=INDEF and the values used in the ChaRT simulation will be used automatically. |
|
specextract |
PI filtering of spectrum added if the channel parameter is not the default instead of the filter being applied to just the RMF. |
|
list_datasetid |
This script has been removed from CIAO. |
|
merge_obs/ciao_contrib._tools.merging |
Support for combining interleaved-mode observations restored due to file handling changes introduced in CIAO 4.7 when also trying to handle multi-ObI observations. |
|
ciao_contrib._tools.run |
Cleanup dmimgcalc operation syntax. |
|
ciao_contrib.cda.search |
Additional error checking with SIAP service is offline. |
|
ciao_contrib.runtool |
Updated for parameter changes in CIAO 4.10. Fixed an issue with Python 3.5 support (setting parameter values to INDEF). |
|
sherpa_contrib.profiles |
Fixed typo in docstring. |
|
4.9.4 20 Jul 2017 |
dax |
The CIAO → Statistics → Photometry (srcflux) task now allows users to select the method used to estimate the PSF fraction for their analysis.
|
chandra_repro |
Internal fix handling observations with OBC aspect solutions (restricted to Earth and Moon observations only). chandra_repro still cannot be used with these observations but the error message is more informative. |
|
srcflux |
Script modified, adding internal optimization for the case where a large number of positions are used, especially when psfmethod=psffile. There is no change to the output. |
|
mktgresp |
Updated so that temporary aspect histogram files are cleaned up in Python 3.5. |
|
apply_fov_limits, get_fov_limits, fluximage, flux_obs, merge_obs | Fixed an error message when given a FOV file with a region that can not be handled by skyfov. | |
fluximage, flux_obs, merge_obs | Fixed an error message when no input events files can be processed. | |
ciao_contrib.runtool | Support for running the tools axbary, evalpos, mean_energy_map, pileup_map, and wavdetect has been moved to the CIAOToolDirect class. Care should be taken when running these tools to avoid multiple copies trying to edit the same parameter file; it is strongly suggested that the new_pfiles_environment context manager is used when running these tools. | |
4.9.3 24 May 2017 |
download_chandra_obsid, download_obsid_caldb, find_chandra_obsid |
Changes the default FTP server used by these scripts from ftp://cdaftp.cfa.harvard.edu to ftp://cda.cfa.harvard.edu. |
deflare, ecf_calc, find_chandra_obsid |
Updated for Python 3.5 compatibility. |
|
lightcurves.py |
Fixed the error in lc_sigma_clip when trying to create a GTI file using Python 3.5 for some input data files. |
|
4.9.2 12 Apr 2017 |
chandra_repro |
Typo fixed in screen output and script modified to add file history using the Python ciao_contrib.runtool.add_tool_history instead of relying on dmhistory. |
srcflux |
Script modified to run fluximage with background=none, to avoid double counting the background, since srcflux also determines the background independently. This change only affects HRC-I observations. |
|
simulate_psf |
The output simulated events file now includes a [x=:,y=:] to trim the TLMIN/TLMAX keyword range of the output event file to make visuzlizing results in DS9 easier. |
|
mktgresp | Support of Type I PHA file as input added. | |
tgsplit | The REGION block is appended to the produced Type I PHA files | |
combine_spectra | If input files contain a STAT_ERR column, the values will be recomputed using the Gehrels' variance function; which is needed by combine_grating_spectra. | |
install_marx, ecf_calc | Updated for Python 3.5 compatibility. | |
reproject_obs |
Bug fixed that was triggered by multi-asol observations causing runtime failure with Python 3.5. |
|
download_obsid_caldb | Bug fixed where the script fails when the output directory parameter contains a trailing "/". | |
blanksky |
|
|
specextract |
|
|
sherpa_contrib.xspec.xsconvolve | The XSPEC convolution interface is updated so it works with Sherpa in CIAO 4.8 or greater. A bug was also fixed that will allow use of the XSpec partial covering model (load_xspartcov). | |
4.9.1 13 Dec 2016 |
multiple scripts |
The scripts package has been updated for the CIAO 4.9 release and to run under Python version 3.5 as well as Python 2.7. These changes are purely internal and do not change how the scripts behave. |
specextract |
The behavior has been changed when bkgresp=yes so that the calculated background ARF will always be weighted. The background RMF type is determined by the unweight_rmf" parameter. |
|
4.8.4 03 Oct 2016 |
blanksky |
Script to create an unscaled blanksky background file compatible with a given observation events file. The background scaling factors for each chip are calculated and stored in the file header. |
blanksky_image |
Script to create scaled background and background-subtracted images given an observation-specific blanksky background file and a reference image. |
|
correct_periscope_drift |
Script to correct small (~0.1 arcsec) intra-observation alignment drifts that can be seen in recent, long (>50 ks) observations. Requires a bright, on-axis (<2 arcmin) point source with minimal pileup. |
|
specextract |
|
|
srcflux |
|
|
chandra_repro | Using pix_adj=default for ACIS data in CC-mode will now run acis_process_events with pix_adj=NONE. | |
mktgresp | Can now create responses for ACIS-I observations with gratings inserted. | |
tgsplit |
Error fixed when using tgextract2 pha2 files which were created with error=gehrels. |
|
monitor_photom | Script cleaned up to avoid warnings thrown by newer versions of NumPy. | |
dax |
Updates to several tasks to request regions in a specific format. |
|
install_marx |
Corrects a problem in the auto-generated bash-shell setup script. |
|
4.8.3 13 Apr 2016 |
simulate_psf |
A simplified interface to MARX, to perform both raytrace PSF simulations or projecting ChaRT/SAOTrace rayfiles to the detector-plane for an existing observation. |
install_marx |
Updated to automatically install the latest version of MARX available. |
|
specextract |
Added checks to error out if blanksky background files are used as input; a minor bug fixed that attempted to write history to calibration files. |
|
4.8.2 27 Jan 2016 |
fluximage, merge_obs, flux_obs |
New "random" parameter has been added to these scripts to control the random parameter used to reproject the HRC-I background events. |
readout_bkg |
New "random" parameter has been added to control the stream of random CHIPY values. |
|
convert_xspec_user_mode |
|
|
sherpa_contrib.chart |
The routines in this module have been updated to be compatible with ChaRT v2. |
|
sherpa_contrib.utils.renorm | New function added that changes the normalization of a source model so that the total predicted signal matches the observed data. | |
sherpa_contrib.utils.estimate_weighted_expmap | Function has been updated to work in CIAO 4.8. | |
ciao_contrib.runtool |
Updated for the new parameters added to readout_bkg, fluximage, flux_obs, and merge_obs scripts. |
|
4.8.1 15 Dec 2015 |
multiple scripts | The scripts package has been updated for the CIAO 4.8 release. The Analysis Scripts section of the release notes has a list of all the changes. |
convert_xspec_user_mode |
Script needs updating to be compatible with CIAO 4.8. |
|
4.7.4 21 Sep 2015 |
readout_bkg |
Script to model the Out of Time (OOT) contribution of bright and extended sources to the ACIS background. |
install_marx |
New script that automates the standard steps necessary to download, build, and install MARX 5.1. |
|
download_obsid_caldb | *EXPERIMENTAL* Intended for users with limited disk space or internet access/bandwidth; this script downloads only the subset of CalDB files required to analyze one observation at a time. As additional observations are processed, the CalDB will grow incrementally as new files are accrued. | |
detilt | Corrects the time-dependent tilt of LETG/HRC-S spectra by adjusting the TG_D column values. | |
dewiggle | Corrects the LETG/HRC-S spectra by adjusting the TG_D values of events to remove small "wiggles" to straighten the dispersed spectra. | |
symmetrize | Adjusts the LETG/HRC-S spectra by adjusting the TG_D values of events to make cross-dispersion profiles more symmetric about TG_D=0. | |
tgsplit | Bug fix for ACIS CC-mode data, where ARF and RMF files could not be associated with individual spectral files. | |
group |
Missing ahelp files for the Python group module have been placed in the $ASCDS_INSTALL/contrib/doc/xml directory so that they can be accessible to the user. |
|
4.7.3 30 Jun 2015 |
merge_obs, reproject_obs, flux_obs |
These scripts have been updated to work with multi-ObI datasets that have been processed with splitobs. |
combine_spectra |
The path name is now removed from the file names stored in the ANCRFILE, RESPFILE, and BACKFILE keywords. |
|
ecf_calc |
Bug fixed, where vector columns of coordinates were split into individual columns, which caused failures when handling image files. |
|
4.7.2 07 Apr 2015 |
chandra_repro |
|
mktgresp |
|
|
specextract |
|
|
srcflux |
|
|
splitobs |
Automates the steps necessary to separate multi-ObI and interleaved-mode observations into individual directories compatible with chandra_repro. For multi-ObI grating observations, the REGION block is attached to the level 2 event file. |
|
gti_align |
For ACIS observations only. Synchronizes the input GTIs to the ACIS exposure boundaries. |
|
multi_chip_gti |
Create a single multi-chip GTI from individual GTIs. |
|
apply_fov_limits |
The output metadata (including block order) may be different. |
|
combine_spectra |
Bug fixed when checking that all input files have the same channel grid. |
|
dax spectral fits |
Fix logic to allow background to be optionally used. |
|
psfsize_srcs |
Adds tool history to output file and corrects the logic when applied to areas outside a sub-arrayed dataset. |
|
src_psffrac |
Adds tool history to output file. |
|
coords.chandra |
|
|
4.7.1 04 Dec 2014 |
chandra_repro |
|
apply_fov_limits |
The file found from the MASKFILE header keyword in the input event file is now optional when running the tool when no fovfile is set. |
|
find_chandra_obsid |
An ObsID may now be given instead of an object name or position. |
|
mktgresp |
Bug fixed affecting observations with multiple aspect solution files. |
|
ciao_contrib.caldb |
Updated to open the CALDB version file as read-only. |
|
ciao_contrib.runtool |
Updated for the new tools and updated parameter files introduced in CIAO 4.7. |
|
4.6.7 04 Nov 2014 |
combine_grating_spectra |
|
tgsplit |
|
|
specextract |
A bug was fixed causing failures when a weighted ARF and an unweighted RMF are to be created for -110C ACIS data. |
|
combine_spectra |
|
|
dax |
|
|
4.6.6 24 Sep 2014 |
chandra_repro |
|
combine_spectra |
Corrects the ONTIME/LIVETIME/EXPOSURE keywords in the combined ARF. The times in the PHA files, as used by Sherpa and XSpec, are unchanged. |
|
specextract |
|
|
srcflux |
|
|
fluximage, flux_obs, merge_obs, and reproject_obs |
|
|
search_csc and obsid_search_csc |
|
|
acis_clear_status_bits |
Bug fixed affecting 32-bit systems where the CLSTBITS header keyword was being written out incorrectly; the STATUS column was otherwise correct. |
|
convert_xspec_user_mode |
*EXPERIMENTAL* Compile a XSpec user-model for use in Sherpa. This script is an experiment to provide similar functionality to the initpackage Sherpa script, compiling XSpec user-model into a module usable within Sherpa. Only additive, multiplicative, and convolution models are supported. Although Fortran, C, and C++ models are all supported, there may be difficulties in compiling models if you are using a gcc/gfortran version significantly different to that used to compile CIAO 4.6 (namely version 4.1). Models that require the --udmget switch to initpackage are not supported. |
|
sherpa_contrib.xspec.local |
The Python lmod function is provided by this module to load XSpec user-models compiled with the convert_xspec_user_model script. |
|
sherpa_contrib.xspec.xsconvolve |
*EXPERIMENTAL* This module provides an interface to the XSpec convolution models. For example: # Apply the X-Spec gsmooth convolution model to the sum of a # powerlaw and gaussian sherpa> from sherpa_contrib.xspec.xsconvolve import load_xsgsmooth sherpa> load_xsgsmooth("gsm") sherpa> set_source(xshpabs.gal * gsm(xspowerlaw.pl + xsgaussian.gl)) This code has seen limited testing, and should be used with caution. Sherpa does not have an equivalent to the energies command, so some models, such as the reflect model, may be unusable and edge effects from the convolution should be considered. |
|
ciao_contrib.runtool |
The module has been updated to us $ASCDS_WORK_PATH when creating temporary files and directories when appropriate, rathen than always using /tmp. The tmpdir argument has been added to the new_pfiles_environment() and new_tmpdir() context managers and the add_tool_history() function. |
|
$ASCDS_CONTRIB/data/*lut |
The XImage-based color lookup-tables have been updated to contain 256 colors; usable by ChIPS and DS9. The bluebase2 lookup-table has been updated to replace invalid values. |
|
4.6.5 12 Jun 2014 |
monitor_photom |
Create light curves from optical data from the aspect camera. See: |
summarize_status_bits |
Provide summary of the status bits set for the rows and what each bit means for an event file. |
|
apply_fov_limits |
Create an image of an event file using the limits from an FOV file. |
|
srcflux |
Bug fixed where the background photon flux values, BG_PHOTFLUX, were all calculated to be zero. Subsequently, the NET_PHOTFLUX_APER value and corresponding errors were not background subtracted. |
|
combine_spectra |
Script re-written to use Python tempfile. New parameters bscale_method and exp_origin added for expert-users. |
|
fluximage, flux_obs, and merge_obs |
|
|
specextract |
|
|
download_chandra_obsid |
Support added for evt1a and adat (PCAD ACA images) file types. |
|
ecf_calc |
File history added to output file header. |
|
psfsize_srcs |
Bug fix to support image files. |
|
ciao_contrib.region.check_fov.FOVFiles module | Query a stack of FOV files to find which observations include a given RA and Dec. | |
ciao_contrib.runtool module | Updated for new and updated script changes. | |
4.6.4 09 Apr 2014 |
crates_contrib.utils.SimpleCoordTransform |
Bug fix to the Python module to avoid an error being thrown. |
dax |
Work around for DM issues handling regions used by CIAO analysis functions in DS9. |
|
4.6.3 26 Mar 2014 |
ecf_calc |
Provides the encircled counts fraction (ECF) of from a circular region around a given source position as a function of radius. |
fluximage |
|
|
chips_contrib.helix module | Fix allowing the start, hue, gamma, and nlev arguments to be used in load_colormap_cubehelix() and get_cubehelix(). | |
4.6.2 03 Feb 2014 |
check_ciao_version |
Fixed issue that caused failure in CIAO 4.6.1 |
fluximage and merge_obs |
|
|
ciao_contrib.proptools module | Experimental Python interface to the Chandra proposal tools: colden, precess, and dates. | |
4.6.1 12 Dec 2013 |
multiple scripts | The scripts package has been updated for the CIAO 4.6 release. The Analysis Scripts section of the release notes has a list of all the changes. |
4.5.5 17 Oct 2013 |
list_datasetid |
Provides the LaTeX identifier macro used to describe observations in papers written for AAS managed publications. See: CDA Data Literature Links for more information. |
search_csc and obsid_search_csc |
|
|
coords.format.deg2dec module | Fix for small negative declinations. | |
4.5.4 07 Aug 2013 |
specextract |
|
chandra_repro |
|
|
search_csc and obsid_search_csc |
New scripts that allow users to search the Chandra Source Catalog (CSC) from the command-line:
Both scripts can retrieve arbitrary sets of columns from the CSC and save the results as a tab-delimited ASCII file. Additionally, the per source and per observation data products—including event files; images; spectra; lightcurves; and their associated response files (PSF, RMF, ARF, exposure maps)—may be retrieved. |
|
download_chandra_obsid and find_chandra_obsid |
Support of downloading from mirror sites added, rather than requiring direct access to the Chandra Data Archive. |
|
merge_obs, reproject_obs, and flux_obs |
|
|
chips_contrib Python modules |
|
|
ahelp documentation |
New ahelp pages added; describes some of the Python routines used by the scripts, in particular download_chandra_obsid and find_chandra_obsid. |
|
ciao_contrib.runtool module | Updated to include the new and updated scripts introduced in this release. | |
4.5.3 28 Jun 2013 |
merge_obs | Bug fixes when stacks of ancillary files given. |
4.5.2 24 Apr 2013 |
merge_obs, reproject_obs, and flux_obs |
|
fluximage | The asol argument is checked to make sure an aspect histogram is not used by mistake. | |
chandra_repro |
|
|
add_ds9_contours and read_ds9_contours | Bug fix so the tools function in CIAO 4.5. | |
tgmask2reg and reg2tgmask |
New scripts to assist in making custom region extraction masks for tgextract2. See: |
|
mktgresp |
New scripts to that will take a Type II PHA file produced by tgextract or tgextract2 and will create the ARF and RMF for each order and grating arm. |
|
ciao_contrib.runtool module | Updated to include the new and changes scripts in this release. | |
$ASCDS_CONTRIB/param/ximage_lut.par
$ASCDS_CONTRIB/param/imagej_lut.par |
Due to a naming conflict, these parameter files that provide access to the suite of auxiliary color lookup-tables have been changed. | |
4.5.1 13 Dec 2012 |
multiple scripts | The scripts package has been updated for the CIAO 4.5 release. The Analysis Scripts section of the release notes has a list of all the changes. |