The network design used in majority of supercomputer installations is spine-leaf architecture. In more sizeable systems, super-spine may be used to provide additional HA capabilities.
A spine-leaf architecture is a data center network topology that consists of two switching layers: a spine and leaf. The leaf layer consists of access switches that aggregate traffic from servers and connect directly into the spine or network core. Spine switches interconnect all leaf switches in a full-mesh topology.