Interactive HPC gateways with jupyter and jupyterhub

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Scopus citations

Abstract

MSI at the University of Minnesota has adopted a goal of supporting Interactive HPC as a first class service. This paper describes the implementation of a gateway for user-friendly, reproducible computing in an HPC environment using the Jupyter notebook server and Jupyterhub. For this project, we developed novel components and techniques enabling interoperability of Jupyter with the distinct requirements of an institutional HPC center. These include modules providing integration with batch job scheduling, control of job profiles, and integration with a central authentication service. To achieve software sustainability, we designed these elements for generic applicability, and several have now been accepted as components of the Jupyterhub open source project.

Original languageEnglish (US)
Title of host publicationPEARC 2017 - Practice and Experience in Advanced Research Computing 2017
Subtitle of host publicationSustainability, Success and Impact
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450352727
DOIs
StatePublished - Jul 9 2017
Event2017 Practice and Experience in Advanced Research Computing, PEARC 2017 - New Orleans, United States
Duration: Jul 9 2017Jul 13 2017

Publication series

NameACM International Conference Proceeding Series
VolumePart F128771

Other

Other2017 Practice and Experience in Advanced Research Computing, PEARC 2017
Country/TerritoryUnited States
CityNew Orleans
Period7/9/177/13/17

Bibliographical note

Publisher Copyright:
© 2017 Copyright held by the owner/author(s).

Keywords

  • High performance computing
  • Interfaces
  • Jupyter
  • Management

Fingerprint

Dive into the research topics of 'Interactive HPC gateways with jupyter and jupyterhub'. Together they form a unique fingerprint.

Cite this