2022.13

[javierggt]

Highlights of this new Ska3 release include:

• acis_thermal_check changes to:
  • fix the definition of "old criteria" for determining whether ACIS observations can go to -109 C (PR 55)
  • add predictive data for 1dhatbon to cea_check to prevent crashes (PR 56),
  • update the acis_thermal_check documentation to include more information about how to run models outside of load review (PR 57),
  • fix a bug with running in validation-only mode and adds tests for that mode (PR 58).
• acis_thermal_check includes check_cea.py.
  check_cea.py is a new load review tool to evaluate the HRC CEA temperatures. It is based on ACIS load review tools such as check_dpa.py, and makes use of the HRC CEA thermal model.
• agasc: changes to reduce peak memory use.
• chandra_aca: Use ACA drift model from chandra_models JSON file
• cxotime: Add method and command line script cxotime to convert time formats. See Add method and console script to convert time formats cxotime#30 for examples of this handy new option from the command line.
• kadi:
  • Add a new commanded states validation module to replace the legacy Python 2 script. This new validation uses MAUDE data and generates interactive web plots, making the app suitable for validation of changes to the Chandra Command Events sheet.
  • Add type field to Dump event class and include both ground-commanded (type="GRND") and autonomous (type="AUTO") unloads.
• maude: Allow caching requests to the MAUDE server.
• starcheck:
  • Add 16 arcsec dither in y and z to "standard" set.
  • Replace Inline::Python with a light Python function server.
  • Allow using MAUDE for thermal model source data.

The following packages were renamed. The previous names are still valid and link to the renamed packages:

• Chandra.Time -> chandra_time
• Ska.engarchive -> cheta
• Ska.Sun -> ska_sun

Interface Impacts:

The tables in $SKA/data/kadi/events3.db include a new field.

Testing:

• HEAD.
• GRETA.
• OS-X

skare3 dashboard and test result password at https://icxc.cfa.harvard.edu/aspect/skare3_dash_cred.txt

The latest release candidates will be installed in /proj/sot/ska3/test on HEAD, and all release candidates will be available for testing from the usual channels:

conda create -n ska3-flight-2022.13rc2 --override-channels \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/flight \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/test \
  ska3-flight==2022.13rc2

Review

All operations critical or impacting PR's are independently and carefully reviewed. For other PR's the level of detail for review is calibrated to operations criticality. Some PR's that are confined to aspect-team-specific processing may have little to no independent review.

Deployment

ska3-flight2022.13 will be promoted to flight conda channel and installed on HEAD and GRETA Linux upon approval of FSDS Jira ticket.

Code changes

ska3-core changes (2022.6 -> 2022.13rc2)

• libcxx: 12.0.0 -> 14.0.6 (Mac OS only)

ska3-flight changes (2022.11 -> 2022.13rc2)

New Packages

• chandra_time: 4.1.1
• cheta: 4.58.0
• ska_sun: 3.9.0

Removed Packages

• chandra.time
• ska.engarchive
• ska.sun

Updated Packages

• aca_view: 0.10.1 -> 0.11.0 (0.10.1 -> 0.11.0)
  • PR 156 (Javier Gonzalez): Fixes for issues in real-time mode
  • PR 157 (Javier Gonzalez): Improve feedback when fetching data
• acis_thermal_check: 4.4.0 -> 4.5.0 (4.4.0 -> 4.4.1 -> -> 4.5.0)
  • PR 57 (John ZuHone): Minor doc updates
  • PR 58 (John ZuHone): Fix validation-only runs
  • PR 56 (John ZuHone): Add predictive data for 1dahtbon to cea_check
  • PR 55 (John ZuHone): Update hot ACIS observations criteria
• agasc: 4.13.1 -> 4.14.0 (4.13.1 -> 4.14.0)
  • PR 144 (Jean Connelly): Reduce peak memory use by not reading full file to get RA DEC columns
  • PR 137 (Javier Gonzalez): Write JSON when creating star reports.
• aimpoint_mon: 1.0.1 -> 1.1.0 (1.0.1 -> 1.1.0)
  • PR 24 (Tom Aldcroft): Add notebook for 2022-11 update of aimpoint drift model
• chandra_aca: 4.36.1 -> 4.38.0 (4.36.1 -> 4.37.0 -> 4.37.1 -> 4.38.0)
  • PR 134 (Tom Aldcroft): Use ACA drift model from chandra_models JSON file
  • PR 135 (Tom Aldcroft): Use FOT tools env var to override drift model root dir
  • PR 136 (Tom Aldcroft): Modernize
  • PR 137 (Tom Aldcroft): Update pre-commit hooks and black workflow to latest versions
• cxotime: 3.3.0 -> 3.4.0 (3.3.0 -> 3.4.0)
  • PR 30 (Tom Aldcroft): Add method and console script to convert time formats
  • PR 31 (Tom Aldcroft): Add CxoTimeLike type alias
  • PR 32 (Tom Aldcroft): Black and isort
• kadi: 7.1.0 -> 7.2.0 (7.1.0 -> 7.2.0)
  • PR 262 (Tom Aldcroft): Remove WARNING in logging text
  • PR 263 (Tom Aldcroft): Explicit complete_intervals=True in logical intervals + code tidy
  • PR 264 (Tom Aldcroft): Add type field to Dump event class and update docs and process notes
  • PR 265 (Tom Aldcroft): Fix issue with cmd query around 30 days before current time
  • PR 261 (Tom Aldcroft): Validate kadi states
• kalman_watch: 0.1.0 -> 0.2.0 (0.1.0 -> 0.2.0)
  • PR 8 (Tom Aldcroft): Remove maude from fetch data source
  • PR 9 (Tom Aldcroft): Use explicit complete_intervals=True in low_kalman_mon
• maude: 3.10.4 -> 3.11.0 (3.10.4 -> 3.11.0)
  • PR 44 (Tom Aldcroft): Allow caching requests to the MAUDE server
• ska3-core: 2022.6 -> 2022.13rc2
• ska_helpers: 0.6.1 -> 0.7.1 (0.6.1 -> 0.7.0 -> 0.7.1)
  • PR 26 (Jean Connelly): Add setup_helper.py with duplicate_package_info
  • PR 27 (Tom Aldcroft): Apply black and isort and add flake8 checking
  • PR 28 (Tom Aldcroft): Improve get_version debug output and fully test functionality
• skare3_tools: 1.0.8 -> 1.0.9 (1.0.8 -> 1.0.9)
  • PR 91 (Javier Gonzalez): black
  • PR 92 (Javier Gonzalez): Update docker image to use testr and ska_helpers
• starcheck: 13.17.0 -> 14.0.1 (13.17.0 -> 14.0.0 -> -> 14.0.1)
  • PR 397 (Jean Connelly): Allow using maude for thermal model source data
  • PR 383 (Jean Connelly): Add 16 arcsec to 'standard' dither in y and z
  • PR 402 (Tom Aldcroft): Replace Inline::Python with a light Python function server
  • PR 404 (Jean Connelly): Save and return exit status at END
• xija: 4.29.1 -> 4.29.2 (4.29.1 -> 4.29.2)
  • PR 132 (Jean Connelly): Update location of chandra_models readme

ska3-flight-latest changes (2022.9 -> 2022.13rc2)

New Packages

• **chandra_time: **
• **cheta: **
• **ska_sun: **

Removed Packages

• chandra.time
• ska.engarchive
• ska.sun

Related Issues

Fixes #975
Fixes #976
Fixes #985
Fixes #987
Fixes #988
Fixes #989
Fixes #990
Fixes #991
Fixes #992
Fixes #993
Fixes #994
Fixes #995
Fixes #996
Fixes #998
Fixes #1000
Fixes #1002
Fixes #1003
Fixes #1006

[jzuhone]

acis_thermal_check notes:

v4.4.1: PR 55, which fixes the definition of "old criteria" for determining whether ACIS observations can go to -109 C
v4.5.0: PR 56, which adds predictive data for 1dhatbon to cea_check to prevent crashes, PR 57, which updates the acis_thermal_check documentation to include more information about how to run models outside of load review, and PR 58, which fixes a bug with running in validation-only mode and adds tests for that mode.