Product delivery

This section ensures the product content is loaded onto the system and available for later steps in the workflow.

  1. Execute the IUF process-media and pre-install-check stages
  2. Update customizations.yaml
  3. Execute the IUF deliver-product stage
  4. Perform manual product delivery operations
  5. Next steps

1. Execute the IUF process-media and pre-install-check stages

  1. The “Install and Upgrade Framework” section of each individual product’s installation document may contain special actions that need to be performed outside of IUF for a stage. The “IUF Stage Documentation Per Product” section of the HPE Cray EX System Software Stack Installation and Upgrade Guide for CSM (S-8052) provides a table that summarizes which product documents contain information or actions for the process-media or pre-install-check stages. Refer to that table and any corresponding product documents before continuing to the next step.

  2. Run upload-rebuild-templates.sh to update all the workflows that will be used by IUF and to ensure the correct CSM product versions will be used by IUF.

    (ncn-m001#) Execute the upload-rebuild-templates.sh script.

    /usr/share/doc/csm/workflows/scripts/upload-rebuild-templates.sh

  3. Invoke iuf run with activity identifier ${ACTIVITY_NAME} and use -e to execute the process-media and pre-install-check stages. Perform the upgrade using product content found in ${MEDIA_DIR}.

    (ncn-m001#) Execute the process-media and pre-install-check stages.

    iuf -a ${ACTIVITY_NAME} -m "${MEDIA_DIR}" run -e pre-install-check

Once this step has completed:

  • Product content has been extracted from the product distribution files in ${MEDIA_DIR}
  • Pre-install checks have been performed for CSM and all products found in ${MEDIA_DIR}
  • Per-stage product hooks have executed for the process-media and pre-install-check stages

2. Update customizations.yaml

Some products require modifications to the customizations.yaml file before executing the deliver-product stage. Currently, this is limited to the Slurm and PBS Workload Manager (WLM) products and the UAN product. Refer to the “Install and Upgrade Framework” section of the Slurm, PBS, and UAN product documents to determine the actions that need to be performed to update customizations.yaml.

Once this step has completed:

  • The customizations.yaml file has been updated per product documentation.

3. Execute the IUF deliver-product stage

  1. The “Install and Upgrade Framework” section of each individual product’s installation document may contain special actions that need to be performed outside of IUF for a stage. The “IUF Stage Documentation Per Product” section of the HPE Cray EX System Software Stack Installation and Upgrade Guide for CSM (S-8052) provides a table that summarizes which product documents contain information or actions for the deliver-product stage. Refer to that table and any corresponding product documents before continuing to the next step.

  2. Invoke iuf run with activity identifier ${ACTIVITY_NAME} and use -r to execute the deliver-product stage. Perform the upgrade using product content found in ${MEDIA_DIR}.

    (ncn-m001#) Execute the deliver-product stage.

    iuf -a ${ACTIVITY_NAME} -m "${MEDIA_DIR}" run -r deliver-product

WARNING: If you are using CSM 1.5.0 (and not CSM 1.5.1+), there is a bug that prevents the deliver-product stage from completing on large number of products being delivered. This bug is addressed in the 1.5.0 hotfix titled CASMINST-6799. You are encouraged to apply that hotfix for 1.5.0 (see Check for field notices about hotfixes). If you have not applied the hotfix and you run across this issue, you can abort IUF-CLI and try running the stage again, but this doesn’t guarantee that the issue will not happen again as it is a race condition. Note again that this does not affect CSM 1.5.1+.

Once this step has completed:

  • Product content for all products found in ${MEDIA_DIR} has been uploaded to the system
  • Product content uploaded to the system has been recorded in the product catalog
  • Per-stage product hooks have executed for the deliver-product stage

4. Perform manual product delivery operations

NOTE This subsection is optional and can be skipped if third-party GPU and/or programming environment software is not needed.

Some products provide instructions for delivering third-party content to the system outside of IUF. If this content is desired, refer to the following documentation for instructions and execute the procedures before continuing with the workflow.

  • Content: Third-party GPU software
    • Description: User Services Software (USS) provides the gpu-nexus-tool script to upload third-party GPU software to Nexus. The GPU software is used later in the workflow when creating CFS configurations and building compute and application node images.
    • Instructions: See the “IUF Stage Details for USS” section of HPE Cray Supercomputing User Services Software Administration Guide: CSM on HPE Cray EX Systems for references to the installation procedures.
  • Content: Third-party programming environment software
    • Description: The Cray Programming Environment (CPE) provides the install-3p.sh and cpe-custom-img.sh scripts to upload third-party programming environment software to Nexus and build images. The programming environment software is used later in the workflow when creating CPE configurations.
    • Instructions: See the “CPE Install and Upgrade Framework usage” section of HPE CPE Installation Guide CSM on HPE Cray EX Systems (S-8003) for references to the installation procedures.

Once this step has completed:

  • Third-party software has been uploaded to Nexus

5. Next steps