From bare metal to virtual lessons learned when a supercomputing institute deploys its first cloud

Evan F. Bollig, James C. Wilgenbusch

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

As primary provider for research computing services at the University of Minnesota, the Minnesota Supercomputing Institute (MSI) has long been responsible for serving the needs of a user-base numbering in the thousands. In recent years, MSI-like many other HPC centers-has observed a growing need for self-service, on-demand, data-intensive research, as well as the emergence of many new controlled-access datasets for research purposes. In light of this, MSI constructed a new on-premise cloud service, named Stratus, which is architected from the ground up to easily satisfy data-use agreements and fill four gaps left by traditional HPC. The resulting OpenStack cloud, constructed from HPC-specific compute nodes and backed by Ceph storage, is designed to fully comply with controls set forth by the NIH Genomic Data Sharing Policy. Herein, we present twelve lessons learned during the ambitious sprint to take Stratus from inception and into production in less than 18 months. Important, and often overlooked, components of this timeline included the development of new leadership roles, staff and user training, and user support documentation. Along the way, the lessons learned extended well beyond the technical challenges often associated with acquiring, configuring, and maintaining large-scale systems.

Original languageEnglish (US)
Title of host publicationPractice and Experience in Advanced Research Computing 2018
Subtitle of host publicationSeamless Creativity, PEARC 2018
PublisherAssociation for Computing Machinery
ISBN (Print)9781450364461
DOIs
StatePublished - Jul 22 2018
Event2018 Practice and Experience in Advanced Research Computing Conference: Seamless Creativity, PEARC 2018 - Pittsburgh, United States
Duration: Jul 22 2017Jul 26 2017

Publication series

NameACM International Conference Proceeding Series

Other

Other2018 Practice and Experience in Advanced Research Computing Conference: Seamless Creativity, PEARC 2018
CountryUnited States
CityPittsburgh
Period7/22/177/26/17

Keywords

  • ACM proceedings
  • Cloud Infrastructure
  • Controlled-Access Data
  • Cost-Recovery
  • Lessons Learned
  • OpenStack

Fingerprint Dive into the research topics of 'From bare metal to virtual lessons learned when a supercomputing institute deploys its first cloud'. Together they form a unique fingerprint.

  • Cite this

    Bollig, E. F., & Wilgenbusch, J. C. (2018). From bare metal to virtual lessons learned when a supercomputing institute deploys its first cloud. In Practice and Experience in Advanced Research Computing 2018: Seamless Creativity, PEARC 2018 [a13] (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3219104.3219164