Since 2013, HCC has operated and maintained multiple generations of the Crane HPC cluster alongside other HPC clusters. Due to the original hardware being well out of warranty and becoming unmaintainable, Crane is set to be retired as an HCC resource after nearly 10 years of service to Nebraska researchers. This will allow HCC to consolidate hardware into a single resource and improve performance and reliability. Since Crane's launch in 2013 at the 475th place in the Top500, Crane has provided over 640 million core hours and 2.3 million GPU hours to over 2,600 Nebraska researchers spanning 140 departments. Crane will be planned to stop accepting new job submissions on June 23rd, 2023.  Existing jobs will be allowed to complete, with all jobs stopped by June 30th.  The login node and storage will remain available until August 1st, 2023 to allow for migration of any remaining data.  

With the retirement of Crane, all data stored on the $HOME and $WORK filesystems of Crane will be removed following decommissioning. Users with data on Crane are strongly encouraged to move their files sooner rather than later. For precious data, HCC provides the Attic resource to reliably store data for a nominal cost. The $COMMON filesystem is another option, as it is available on both Crane and Swan, and is not subject to the 6-month purge policy in effect on the $WORK filesystem. Please note data on $COMMON is not backed up; precious data should be additionally saved elsewhere. Each group is allocated 30TB of $COMMON space at no charge; additional space is available for a fee. For large data transfers, it is strongly encouraged to use Globus to transfer your data. The Globus transfer servers for Crane, Swan, and Attic provide a faster connection for the data transfer and provide checks on both ends of the data transfer.  

As a part of the long-running plan to retire Crane, HCC deployed the Swan cluster in May 2022 as Crane’s replacement and made possible by investments from the UNL Office of Research and Economic Development and the Nebraska Research Initiative. Swan already has a significant number of resources available for general use, and will have the remaining in-warranty resources from Crane migrated into the Swan cluster. Most workflows from Crane can be used on Swan with little to no modification to software or submission scripts.  

REMINDER:

As part of the retirement process, GPUs on Crane will no longer be available on May 24th. Any jobs that can't complete by May 24th will not start. This is to allow HCC to migrate the GPUs from Crane to Swan and consolidate the pool of GPU resources into Swan. This will greatly increase the number of available GPUs on the Swan cluster.

Transiting GPU workflows to Swan should only require re-creating any environments needed and migrating any data needed. If you have any questions about this process, please contact [email protected] or join our Open Office Hours every Tuesday and Thursday from 2-3PM via Zoom.

HCC will work to make this transition as minimally disruptive as possible. More information can be found at this page. Please contact [email protected] with any questions or concerns.