This topic describes nodes in the air-cooled cabinet with diagrams and pictures showing where to find the ports on the nodes and how to cable the nodes to the management network switches.
Device | Port | Linux Device | Destination | Name | VLAN | LAG |
---|---|---|---|---|---|---|
OCP | 1 | mgmt1 |
primary | N/A | HMN, NMN, CAN | MLAG-LACP |
OCP | 2 | mgmt1 |
secondary | N/A | HMN, NMN, CAN | MLAG-LACP |
ILO | 1 | None | HMN leaf-bmc |
N/A | HMN | N/A |
NOTES:
SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
wn01 |
x3000u04ocp-j1 |
x3000u12-j7 |
sw-25g01 |
wn01 |
x3000u04ocp-j2 |
x3000u13-j7 |
sw-25g02 |
The table below describes the cabling of dual card configurations. Also read notes in this section to see other possible customer-based configurations.
Device | Port | Linux Device | Destination | Name | VLAN | LAG |
---|---|---|---|---|---|---|
OCP | 1 | mgmt1 |
primary | N/A | HMN, NMN, CAN | MLAG-LACP |
OCP | 2 | sun1 |
N/A | N/A | N/A | N/A |
PCIe Slot 1 | 1 | mgmt1 |
secondary | N/A | HMN, NMN, CAN | MLAG-LACP |
PCIe Slot 1 | 2 | sun1 |
N/A | N/A | N/A | N/A |
ILO | 1 | None | HMN leaf-bmc |
N/A | HMN | N/A |
NOTES:
ncn-m001
) is required to have a site connection on OCP Port 2 for installation and maintenance.ncn-m001
) is required to have its BMC/iLO connected to the site.SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
mn01 |
x3000u01ocp-j1 |
x3000u12-j1 |
sw-25g01 |
mn01 |
x3000u01s1-j1 |
x3000u13-j1 |
sw-25g02 |
NOTE
: Master 1 (ncn-m001
) is required to have a site connection for installation and non-CAN system access. This can have several configurations depending on customer requirements/equipment:
10/25Gb
card configurations as described in the table above should use PCIe Slot 1, Port 2 as a site connection if the customer supports 10/25Gb
.10/25Gb
speeds (or connection type) and requires RJ45 copper or 1Gb
, then a new and separate card will be installed on ncn-m001
and that card will provide site connectivity.1Gb
port will be used if available (similar to Shasta v1.3 PoR on Gigabyte hardware).Device | Port | Linux Device | Destination | Name | VLAN | LAG |
---|---|---|---|---|---|---|
OCP | 1 | mgmt1 |
primary | N/A | HMN, NMN, CAN | MLAG-LACP |
OCP | 2 | sun1 |
primary | N/A | SUN | MLAG-LACP |
PCIe Slot 1 | 1 | mgmt1 |
secondary | N/A | HMN, NMN, CAN | MLAG-LACP |
PCIe Slot 1 | 2 | sun1 |
secondary | N/A | SUN | MLAG-LACP |
ILO | 1 | None | HMN leaf-bmc |
N/A | HMN | N/A |
NOTES:
SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
sn01 |
x3000u17s1-j2 |
x3000u34-j14 |
sw-25g02 |
sn01 |
x3000u17s1-j1 |
x3000u34-j8 |
sw-25g02 |
sn01 |
x3000u17ocp-j2 |
x3000u33-j14 |
sw-25g01 |
sn01 |
x3000u17ocp-j1 |
x3000u33-j8 |
sw-25g01 |
The OCP ports go to the First switch and the PCIe ports go to the Second switch. OCP port 1 and PCIe port 1 form a Bond. OCP port 2 and PCIe port 2 form a Bond. |
For systems that include 4 leaf switches the cabling will look like the following.
SHCD Example with four leaf switches.
hostname | Source | Destination | Destination |
---|---|---|---|
sn01 |
x3000u10ocp-j2 |
x3000u36-j5 |
sw-25g04 |
sn01 |
x3000u10s1-j2 |
x3000u35-j5 |
sw-25g03 |
sn01 |
x3000u10ocp-j1 |
x3000u34-j6 |
sw-25g02 |
sn01 |
x3000u10s1-j1 |
x3000u33-j6 |
sw-25g01 |
Device | Port | Linux Device | Destination | Name | VLAN | LAG |
---|---|---|---|---|---|---|
OCP | 1 | mgmt1 |
primary | N/A | NMN | N/A |
OCP | 2 | mgmt1 |
primary | N/A | CAN | MLAG-LACP |
PCIe Slot 1 | 1 | mgmt1 |
secondary | N/A | N/A | N/A |
PCIe Slot 1 | 2 | mgmt1 |
secondary | N/A | CAN | MLAG-LACP |
ILO | 1 | None | HMN leaf-bmc |
N/A | HMN | N/A |
NOTES:
SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
uan01 |
x3000u17s1-j2 |
x3000u34-j14 |
sw-25g02 |
uan01 |
x3000u17s1-j1 |
x3000u34-j8 |
sw-25g02 |
uan01 |
x3000u17ocp-j2 |
x3000u33-j14 |
sw-25g01 |
uan01 |
x3000u17ocp-j1 |
x3000u33-j8 |
sw-25g01 |
Server Port | Management Network Port | Speed | Use / Configuration |
---|---|---|---|
OCP port 1 | 1G leaf-bmc switch |
1Gb |
Management Network NMN |
OCP port 2 | None | None | None |
OCP port 3 | None | None | None |
OCP port 4 | None | None | None |
iLO | 1G leaf-bmc switch |
1Gb |
Management Network HMN |
1Gb
management network card and one will be for the HSN.Server Port | Management Network Port | Speed | Use / Configuration |
---|---|---|---|
PCIe port 1 | 1G leaf-bmc switch |
1Gb |
Management Network NMN |
PCIe port 2 | None | None | None |
PCIe port 3 | None | None | None |
PCIe port 4 | None | None | None |
iLO | 1G leaf-bmc switch |
1Gb |
Management Network HMN |
Server Port | Management Network Port | Speed | Use / Configuration |
---|---|---|---|
PCIe Slot 1 port 1 | spine or leaf pair, switch 1/2 | 40Gb |
Management Network NMN/HMN/CAN |
PCIe Slot 1 port 2 | spine or leaf pair, switch 2/2 | 40Gb |
Management Network NMN/HMN/CAN |
SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
wn01 |
x3000u07s1-j1 |
x3000u24L-j4 |
sw-smn02 |
wn01 |
x3000u07s1-j2 |
x3000u24R-j4 |
sw-smn03 |
NOTE
: Cabling ofncn-w001
has changed in Shasta v1.4. Please seencn-m001
note below.
Server Port | Management Network Port | Speed | Use / Configuration |
---|---|---|---|
PCIe Slot 1 port 1 | spine or leaf pair, switch 1/2 | 40Gb |
Management Network NMN/HMN/CAN |
PCIe Slot 1 port 2 | spine or leaf pair, switch 2/2 | 40Gb |
Management Network NMN/HMN/CAN |
LAN0 port 1 | NONE (See note below for ncn-m001 ) |
NONE | Site (See note below for ncn-m001 ) |
SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
mn01 |
x3000u01s1-j1 |
x3000u24L-j1 |
sw-smn02 |
mn01 |
x3000u01s1-j2 |
x3000u24R-j1 |
sw-smn03 |
NOTE
: Master 1 (ncn-m001
) is required to have a site connection for installation and non-CAN system access. In Shasta versions <=1.3 this connection was onncn-w001
. This can have several configurations depending on customer requirements/equipment:
1Gb
lan0
port for site connection on ncn-m001
.1Gb
(or a different connection type), then a new and separate card will be installed on ncn-m001
and that card will provide site connectivity.Server Port | Management Network Port | Speed | Use / Configuration |
---|---|---|---|
PCIe Slot 1 port 1 | spine or leaf pair, switch 1/2 | 40Gb |
Management Network NMN/HMN/CAN |
PCIe Slot 1 port 2 | spine or leaf pair, switch 2/2 | 40Gb |
Management Network NMN/HMN/CAN |
SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
sn01 |
x3000u13s1-j1 |
x3000u24L-j7 |
sw-smn02 |
sn01 |
x3000u13s1-j2 |
x3000u24R-j7 |
sw-smn03 |
Server Port | Management Network Port | Speed | Use / Configuration |
---|---|---|---|
LAN0 port 1 | leaf-bmc (see note) |
1Gb |
Management Network NMN |
PCIe Slot 1 port 1 | spine or leaf pair, switch 1/2 | 40Gb |
Management Network CAN bond |
PCIe Slot 1 port 2 | spine or leaf pair, switch 2/2 | 40Gb |
Management Network CAN bond |
SHCD Example
hostname | Source | Destination | Destination |
---|---|---|---|
uan01 |
x3000u27s1-j1 |
x3000u24L-j10 |
sw-smn02 |
uan01 |
x3000u27s1-j2 |
x3000u24R-j10 |
sw-smn03 |
NOTE that there are a couple configurations possible for LAN0:
leaf-bmc
port.1Gb
port).10/25Gb
card could be added in an Aruba hardware system to match the HPE UANs.