CISL storage architecture and user environment evolving for petascale era

With input from users and recent changes in the storage technology landscape, CISL has begun to transform its storage offerings for users, while at the same time working with users to help them understand the trade-offs that they now face and will continue to face. New storage systems and practices are being put into place in 2018 to reflect the new reality facing users of CISL's petascale computational environments.

In 2017, CISL's computational environment began experiencing signs of stress related to users' storage demands stemming from use of Yellowstone, which was deployed in late 2012, and Cheyenne, which arrived in January 2017. CISL's tape archive reached 85 PB of data stored by the end of 2017, with 80% of those holdings added since the arrival of Yellowstone. With tape storage no longer effectively infinite from a user perspective, and disk filling faster than users could complete their analyses, CISL needed to re-evaluate its storage architecture, user workflows, and system policies.

Presentation

This was presented by Dave Hart, NCAR/CISL User Services Manager, as part of the CISL Seminar Series.

Download slides (PDF)