Cray System Management Documentation > Cray System Management (CSM) Administration Guide > node management > Add Additional Liquid-Cooled Cabinets to a System

Add Additional Liquid-Cooled Cabinets to a System

This top level procedure outlines the process for adding additional liquid-cooled cabinets to a currently installed system.

Prerequisites

The system’s SHCD file has been updated with the new cabinets and cabling changes.
The new cabinets have been cabled to the system, and the system’s cabling has been validated to be correct.
Follow the procedure Create a Backup of the SLS Postgres Database.
Follow the procedure Create a Backup of the HSM Postgres Database.

Procedure

Perform procedures in Add Liquid-Cooled Cabinets to SLS (alternatively, Add A Cabinet To SLS Using CANI).
Perform procedures in Updating Cabinet Routes on Management NCNs.
Reconfigure management network.
1. Validate SHCD with CANU.
2. Validate cabling with CANU.
3. Update switch firmware.
4. Generate new switch configurations with CANU and updated SLS.
5. Review generated switch configurations.
6. Apply switch configurations.
7. Update CEC VLAN (if required).
For more information on CANU, see the CANU documentation.

DISCLAIMER: This procedure is for standard Mountain cabinet network configurations and does not account for any site customizations that have been made to the management network. Site administrators and support teams are responsible for knowing the customizations in effect in Shasta/CSM and configuring CANU to respect them when generating new network configurations.

See examples of using CANU custom switch configurations and examples of other CSM features that require custom configurations in the following documentation:
- Manual Switch Configuration Example
- Custom Switch Configuration Example
Verify that new hardware has been discovered.

Perform the Hardware State Manager Discovery Validation procedure.

After the management network has been reconfigured, it may take up to 10 minutes for the hardware in the new cabinets to become discovered.
Validate BIOS and BMC firmware levels in the new nodes.

Perform the procedures in Update Firmware with FAS. Perform updates as needed with FAS.

Slingshot switches are updated with procedures from the HPE Slingshot Operations Guide.
Configure BMC and controller parameters with SCSD

The System Configuration Service (SCSD) allows administrators to set various BMC and controller parameters for components in liquid-cooled cabinets. At this point SCSD should be used to set the SSH key in the node controllers (BMCs) to enable troubleshooting. If any of the nodes fail to power down or power up as part of the compute node booting process, it may be necessary to look at the logs on the BMC for node power down or node power up.

See Configure BMC and Controller Parameters with SCSD.
Continue on to the HPE Slingshot Operations Guide to bring up the additional cabinets.