Upgrade CSM and additional products with IUF

This procedure is used when performing an upgrade of Cray System Management (CSM) along with additional HPE Cray EX software products at the same time. This procedure would be used when upgrading from one HPC CSM Software Recipe release to another.

This procedure is not used to perform an initial install or upgrade of HPE Cray EX software products when CSM itself is not being upgraded. See Install or upgrade additional products with IUF for that procedure.

This procedure streamlines the rollout of new images to management nodes. These images are based on the new images provided by the CSM product and customized by the additional HPE Cray EX software products, including the User Services Software (USS) and Slingshot Host Software (SHS).

The steps in this procedure alternate between CSM upgrade instructions that do not utilize the IUF and instructions for upgrading additional HPE Cray EX software products whose installation is managed by the IUF.

All stages of iuf are executed in this procedure. All of the new product software provided in the recipe release is deployed and all management NCNs and managed compute nodes and application nodes are rebooted to new images and Configuration Framework Service (CFS) configurations. Manual operations are documented for procedures that are not currently managed by IUF.

The upgrade workflow comprises the following procedures. The diagram shows the workflow and the steps below it provide detailed instructions which must be executed in the order shown.

Upgrade CSM and additional products with IUF

  1. CSM preparation, prepare assets, and prerequisites.

    Read the Important Notes section of the CSM 1.4.0 or later to 1.5.0 Upgrade Process documentation and then follow only these CSM instructions in order:

    1. Prepare for Upgrade
    2. Stage 0.1 - Prepare assets
    3. Stage 0.2 - Prerequisites

  2. Prepare for the upgrade procedure and download product media

    1. Follow the IUF Prepare for the install or upgrade instructions to set environment variables used during the upgrade process.

    2. Download the desired HPE product media defined by the HPC CSM Software Recipe to ${MEDIA_DIR}, which was defined in the previous step.

  3. Product delivery

    Follow the IUF Product delivery instructions.

  4. Configuration

    Follow the IUF Configuration instructions.

  5. Image preparation

    Follow the IUF Image preparation instructions.

  6. CSM backup workload manager data

    Follow the CSM Stage 0.4 - Backup workload manager data instructions.

  7. Backup

    Follow the IUF Backup instructions.

  8. CSM service upgrades and CSM health validation

    Follow these CSM instructions in order:

    1. Stage 1 - CSM Service Upgrades
    2. Validate CSM Health During Upgrade

  9. Management rollout

    Follow the IUF Management rollout instructions.

  10. Deploy product

    Follow these IUF instructions in order:

    1. Deploy product
    2. Stage 3.6 - Complete Kubernetes upgrade
    3. Validate deployment and perform Slingshot switch FW updates

  11. Managed rollout

    Follow the IUF Managed rollout instructions.

The IUF upgrade workflow is now complete. Exit any typescript sessions created during the upgrade procedure and remove any installation artifacts, if desired.