Product delivery

This section ensures the product content is loaded onto the system and available for later steps in the workflow.

  1. Execute the IUF process-media and pre-install-check stages
  2. Update customizations.yaml
  3. Execute the IUF deliver-product stage
  4. Perform manual product delivery operations
  5. Next steps

1. Execute the IUF process-media and pre-install-check stages

  1. The “Install and Upgrade Framework” section of each individual product’s installation document may contain special actions that need to be performed outside of IUF for a stage. The “IUF Stage Documentation Per Product” section of the HPE Cray EX System Software Stack Installation and Upgrade Guide for CSM (S-8052) provides a table that summarizes which product documents contain information or actions for the process-media or pre-install-check stages. Refer to that table and any corresponding product documents before continuing to the next step.

  2. Run upload-rebuild-templates.sh to update all the workflows that will be used by IUF and to make sure the workflow templates are the latest versions.

    (ncn-m001#) Execute the upload-rebuild-templates.sh script.

    /usr/share/doc/csm/workflows/scripts/upload-rebuild-templates.sh
    
  3. Invoke iuf run with activity identifier ${ACTIVITY_NAME} and use -e to execute the process-media and pre-install-check stages. Perform the upgrade using product content found in ${MEDIA_DIR}.

    (ncn-m001#) Execute the process-media and pre-install-check stages.

    iuf -a ${ACTIVITY_NAME} -m "${MEDIA_DIR}" run -e pre-install-check
    

IMPORTANT* If upgrading CSM manually, ensure that the docs-csm-latest.noarch.rpm and libcsm-latest.noarch.rpm RPMs are available at path /root/<rpm> before executing the above command.

NOTE Known Issue: If IUF reports that multiple sessions are in progress for an activity, refer to IUF does not run the next stage for an activity.

Once this step has completed:

  • Product content has been extracted from the product distribution files in ${MEDIA_DIR}
  • Pre-install checks have been performed for CSM and all products found in ${MEDIA_DIR}
  • Per-stage product hooks have executed for the process-media and pre-install-check stages

2. Update customizations.yaml

NOTE This subsection is optional and can be skipped if upgrading only CSM through IUF.

Some products require modifications to the customizations.yaml file before executing the deliver-product stage. Currently, this is limited to the Slurm and PBS Workload Manager (WLM) products, CSM Diags, and the UAN product. Refer to the “Install and Upgrade Framework” section of the Slurm, PBS, CSM Diags, and UAN product documents to determine the actions that need to be performed to update customizations.yaml.

Once this step has completed:

  • The customizations.yaml file has been updated per product documentation.

3. Populate admin directory with files defining site preferences

For creating site_vars.yaml in admin directory, refer to Populate admin directory with files defining site preferences.

4. Execute the IUF deliver-product stage

  1. The “Install and Upgrade Framework” section of each individual product’s installation document may contain special actions that need to be performed outside of IUF for a stage. The “IUF Stage Documentation Per Product” section of the HPE Cray EX System Software Stack Installation and Upgrade Guide for CSM (S-8052) provides a table that summarizes which product documents contain information or actions for the deliver-product stage. Refer to that table and any corresponding product documents before continuing to the next step.

  2. Invoke iuf run with activity identifier ${ACTIVITY_NAME} and use -r to execute the deliver-product stage. Perform the upgrade using product content found in ${MEDIA_DIR}. Additional arguments are available to control the behavior of the deliver-product stage (for example, -rv). See the deliver-product stage documentation for details and adjust the example below if necessary.

    NOTE When installing USS 1.1 or higher, select either SLURM or PBS Pro Products to use on the system before running this stage. For more information, see the deliver-product stage details in the “Install and Upgrade Framework” section of the HPE Cray Supercomputing User Services Software Administration Guide: CSM on HPE Cray Supercomputing EX Systems (S-8063).

    (ncn-m001#) Execute the deliver-product stage. Use site variables from the site_vars.yaml file found in ${ADMIN_DIR} and recipe variables from the product_vars.yaml file found in ${ADMIN_DIR}.

    iuf -a ${ACTIVITY_NAME} -m "${MEDIA_DIR}" run --site-vars \
    "${ADMIN_DIR}/site_vars.yaml" -bpcd "${ADMIN_DIR}" -r deliver-product
    
  3. Run upload-rebuild-templates.sh to ensure the correct CSM product versions will be used by IUF now that all product artifacts have been uploaded.

    (ncn-m001#) Execute the upload-rebuild-templates.sh script.

    /usr/share/doc/csm/workflows/scripts/upload-rebuild-templates.sh
    

Once this step has completed:

  • Product content for all products found in ${MEDIA_DIR} has been uploaded to the system
  • Product content uploaded to the system has been recorded in the product catalog
  • Per-stage product hooks have executed for the deliver-product stage

5. Perform manual product delivery operations

NOTE This subsection is optional and can be skipped if upgrading only CSM through IUF.

NOTE This subsection is optional and can be skipped if third-party GPU and/or programming environment software is not needed.

Some products provide instructions for delivering third-party content to the system outside of IUF. If this content is desired, refer to the following documentation for instructions and execute the procedures before continuing with the workflow.

  • Content: Third-party GPU software
    • Description: User Services Software (USS) provides the gpu-nexus-tool script to upload third-party GPU software to Nexus. The GPU software is used later in the workflow when creating CFS configurations and building compute and application node images.
    • Instructions: See the “IUF Stage Details for USS” section of HPE Cray Supercomputing User Services Software Administration Guide: CSM on HPE Cray EX Systems for references to the installation procedures.
  • Content: Third-party programming environment software
    • Description: The Cray Programming Environment (CPE) provides the install-3p.sh and cpe-custom-img.sh scripts to upload third-party programming environment software to Nexus and build images. The programming environment software is used later in the workflow when creating CPE configurations.
    • Instructions: See the “CPE Install and Upgrade Framework usage” section of HPE CPE Installation Guide CSM on HPE Cray EX Systems (S-8003) for references to the installation procedures.

Once this step has completed:

  • Third-party software has been uploaded to Nexus

6. Next steps