Setup a re-install of LiveCD on a node using the previous configuration.
Backup to the data partition:
pit# mkdir -pv /var/www/ephemeral/backup
pit# pushd /var/www/ephemeral/backup
pit# tar -czvf "dnsmasq-data-$(date '+%Y-%m-%d_%H-%M-%S').tar.gz" /etc/dnsmasq.*
pit# tar -czvf "network-data-$(date '+%Y-%m-%d_%H-%M-%S').tar.gz" /etc/sysconfig/network/*
pit# cp -pv /etc/hosts ./
pit# popd
pit# umount -v /var/www/ephemeral
Unplug the USB device.
The USB device should now contain all the information already loaded, as well as the backups of the initialized files.
Plug the device into a new machine, or make a backup on the booted NCN. Make a snapshot of the USB device.
mylinuxpc> mount -v /dev/disk/by-label/PITDATA /mnt
mylinuxpc> tar -czvf --exclude *.squashfs \
"install-data-$(date '+%Y-%m-%d_%H-%M-%S').tar.gz" /mnt/
mylinuxpc> umount -v /dev/disk/by-label/PITDATA
Follow the Bootstrap PIT Node from LiveCD USB procedure, and then return here and move onto the next step.
The new tar.gz file can be stored anywhere, and can be used to reinitialize the LiveCD.
Delete the existing content on the USB device and create a new LiveCD on that same USB device.
Once the install-data partition is created, it can be remounted and can be used to restore the backup.
mylinuxpc> mount -v /dev/disk/by-label/PITDATA /mnt
mylinuxpc> tar -xzvf $(ls -ltR *.tar.gz | head -n 1)
mylinuxpc> ls -R /mnt
The tarball should have extracted everything into the install-data partition.
Retrieve the SquashFS artifacts.
The artifacts can be retrieved at the following locations:
/mnt/var/www/ephemeral/k8s//mnt/var/www/ephemeral/ceph/Attach the USB to a Cray non-compute node (NCN) and reboot into the USB device.
Once booted into the USB device, restore network configuration and dnsmasq, and then ensure the pods are started.
STOP AND INSPECT ANY FAILURE IN ANY OF THESE COMMANDS
pit# tar -xzvf /var/www/ephemeral/backup/dnsmasq*.tar.gz
pit# tar -xzvf /var/www/ephemeral/backup/network*.tar.gz
pit# systemctl restart wicked wickedd-nanny
pit# systemctl restart dnsmasq
pit# systemctl start basecamp nexus
The LiveCD is now re-installed with the previous configuration.