Slimmer: Weight loss secrets for docker registries

Nannan Zhao; Vasily Tarasov; Ali Anwar; Lukas Rupprecht; Dimitrios Skourtis; Amit Warke; Mohamed Mohamed; Ali Butt

doi:10.1109/CLOUD.2019.00096

Slimmer: Weight loss secrets for docker registries

Nannan Zhao
, Vasily Tarasov
, Ali Anwar
, Lukas Rupprecht
, Dimitrios Skourtis
, Amit Warke
, Mohamed Mohamed
, Ali Butt

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

18 Scopus citations

Abstract

Due to their tight isolation, low overhead, and efficient packaging of the execution environment, Docker containers have become a prominent solution for deploying modern applications. Containers are created from images which are stored in a Docker registry. An image consists of a list of layers which can be shared among images. Docker registries store a large amount of images and with the increasing popularity of Docker, they continue to grow. For example, Docker Hub-a popular public registry-stores more than half a million public images. In this paper, we analyze over 167TB of uncompressed Docker images and evaluate the potential of file-level deduplication in the registry. Our analysis reveals that only 3% of the files in images are unique and Docker's existing layer sharing mechanism is not sufficient to eliminate this profound redundancy. We then present the design of Slimmer-a Docker registry with file deduplication support-and conduct a simulation-based analysis of its performance implications.

Original language	English (US)
Title of host publication	Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services
Editors	Elisa Bertino, Carl K. Chang, Peter Chen, Ernesto Damiani, Michael Goul, Katsunori Oyama
Publisher	IEEE Computer Society
Pages	517-519
Number of pages	3
ISBN (Electronic)	9781728127057
DOIs	https://doi.org/10.1109/CLOUD.2019.00096
State	Published - Jul 2019
Externally published	Yes
Event	12th IEEE International Conference on Cloud Computing, CLOUD 2019 - Milan, Italy Duration: Jul 8 2019 → Jul 13 2019

Publication series

Name	IEEE International Conference on Cloud Computing, CLOUD
Volume	2019-July
ISSN (Print)	2159-6182
ISSN (Electronic)	2159-6190

Conference

Conference	12th IEEE International Conference on Cloud Computing, CLOUD 2019
Country/Territory	Italy
City	Milan
Period	7/8/19 → 7/13/19

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Keywords

Deduplication
Distributed storage system
Docker registry

Publisher link

10.1109/CLOUD.2019.00096

Find It

Find It at U of M Libraries

Cite this

Zhao, N., Tarasov, V., Anwar, A., Rupprecht, L., Skourtis, D., Warke, A., Mohamed, M., & Butt, A. (2019). Slimmer: Weight loss secrets for docker registries. In E. Bertino, C. K. Chang, P. Chen, E. Damiani, M. Goul, & K. Oyama (Eds.), Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services (pp. 517-519). Article 8814532 (IEEE International Conference on Cloud Computing, CLOUD; Vol. 2019-July). IEEE Computer Society. https://doi.org/10.1109/CLOUD.2019.00096

Slimmer: Weight loss secrets for docker registries. / Zhao, Nannan; Tarasov, Vasily; Anwar, Ali et al.
Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services. ed. / Elisa Bertino; Carl K. Chang; Peter Chen; Ernesto Damiani; Michael Goul; Katsunori Oyama. IEEE Computer Society, 2019. p. 517-519 8814532 (IEEE International Conference on Cloud Computing, CLOUD; Vol. 2019-July).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Zhao, N, Tarasov, V, Anwar, A, Rupprecht, L, Skourtis, D, Warke, A, Mohamed, M & Butt, A 2019, Slimmer: Weight loss secrets for docker registries. in E Bertino, CK Chang, P Chen, E Damiani, M Goul & K Oyama (eds), Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services., 8814532, IEEE International Conference on Cloud Computing, CLOUD, vol. 2019-July, IEEE Computer Society, pp. 517-519, 12th IEEE International Conference on Cloud Computing, CLOUD 2019, Milan, Italy, 7/8/19. https://doi.org/10.1109/CLOUD.2019.00096

Zhao N, Tarasov V, Anwar A, Rupprecht L, Skourtis D, Warke A et al. Slimmer: Weight loss secrets for docker registries. In Bertino E, Chang CK, Chen P, Damiani E, Goul M, Oyama K, editors, Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services. IEEE Computer Society. 2019. p. 517-519. 8814532. (IEEE International Conference on Cloud Computing, CLOUD). doi: 10.1109/CLOUD.2019.00096

Zhao, Nannan ; Tarasov, Vasily ; Anwar, Ali et al. / Slimmer : Weight loss secrets for docker registries. Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services. editor / Elisa Bertino ; Carl K. Chang ; Peter Chen ; Ernesto Damiani ; Michael Goul ; Katsunori Oyama. IEEE Computer Society, 2019. pp. 517-519 (IEEE International Conference on Cloud Computing, CLOUD).

@inproceedings{ee12d986d32b46a2aae03835144e31bb,

title = "Slimmer: Weight loss secrets for docker registries",

abstract = "Due to their tight isolation, low overhead, and efficient packaging of the execution environment, Docker containers have become a prominent solution for deploying modern applications. Containers are created from images which are stored in a Docker registry. An image consists of a list of layers which can be shared among images. Docker registries store a large amount of images and with the increasing popularity of Docker, they continue to grow. For example, Docker Hub-a popular public registry-stores more than half a million public images. In this paper, we analyze over 167TB of uncompressed Docker images and evaluate the potential of file-level deduplication in the registry. Our analysis reveals that only 3\% of the files in images are unique and Docker's existing layer sharing mechanism is not sufficient to eliminate this profound redundancy. We then present the design of Slimmer-a Docker registry with file deduplication support-and conduct a simulation-based analysis of its performance implications.",

keywords = "Deduplication, Distributed storage system, Docker registry",

author = "Nannan Zhao and Vasily Tarasov and Ali Anwar and Lukas Rupprecht and Dimitrios Skourtis and Amit Warke and Mohamed Mohamed and Ali Butt",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 12th IEEE International Conference on Cloud Computing, CLOUD 2019 ; Conference date: 08-07-2019 Through 13-07-2019",

year = "2019",

month = jul,

doi = "10.1109/CLOUD.2019.00096",

language = "English (US)",

series = "IEEE International Conference on Cloud Computing, CLOUD",

publisher = "IEEE Computer Society",

pages = "517--519",

editor = "Elisa Bertino and Chang, \{Carl K.\} and Peter Chen and Ernesto Damiani and Michael Goul and Katsunori Oyama",

booktitle = "Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services",

}

TY - GEN

T1 - Slimmer

T2 - 12th IEEE International Conference on Cloud Computing, CLOUD 2019

AU - Zhao, Nannan

AU - Tarasov, Vasily

AU - Anwar, Ali

AU - Rupprecht, Lukas

AU - Skourtis, Dimitrios

AU - Warke, Amit

AU - Mohamed, Mohamed

AU - Butt, Ali

PY - 2019/7

Y1 - 2019/7

N2 - Due to their tight isolation, low overhead, and efficient packaging of the execution environment, Docker containers have become a prominent solution for deploying modern applications. Containers are created from images which are stored in a Docker registry. An image consists of a list of layers which can be shared among images. Docker registries store a large amount of images and with the increasing popularity of Docker, they continue to grow. For example, Docker Hub-a popular public registry-stores more than half a million public images. In this paper, we analyze over 167TB of uncompressed Docker images and evaluate the potential of file-level deduplication in the registry. Our analysis reveals that only 3% of the files in images are unique and Docker's existing layer sharing mechanism is not sufficient to eliminate this profound redundancy. We then present the design of Slimmer-a Docker registry with file deduplication support-and conduct a simulation-based analysis of its performance implications.

AB - Due to their tight isolation, low overhead, and efficient packaging of the execution environment, Docker containers have become a prominent solution for deploying modern applications. Containers are created from images which are stored in a Docker registry. An image consists of a list of layers which can be shared among images. Docker registries store a large amount of images and with the increasing popularity of Docker, they continue to grow. For example, Docker Hub-a popular public registry-stores more than half a million public images. In this paper, we analyze over 167TB of uncompressed Docker images and evaluate the potential of file-level deduplication in the registry. Our analysis reveals that only 3% of the files in images are unique and Docker's existing layer sharing mechanism is not sufficient to eliminate this profound redundancy. We then present the design of Slimmer-a Docker registry with file deduplication support-and conduct a simulation-based analysis of its performance implications.

KW - Deduplication

KW - Distributed storage system

KW - Docker registry

UR - https://www.scopus.com/pages/publications/85072337517

UR - https://www.scopus.com/pages/publications/85072337517#tab=citedBy

U2 - 10.1109/CLOUD.2019.00096

DO - 10.1109/CLOUD.2019.00096

M3 - Conference contribution

AN - SCOPUS:85072337517

T3 - IEEE International Conference on Cloud Computing, CLOUD

SP - 517

EP - 519

BT - Proceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services

A2 - Bertino, Elisa

A2 - Chang, Carl K.

A2 - Chen, Peter

A2 - Damiani, Ernesto

A2 - Goul, Michael

A2 - Oyama, Katsunori

PB - IEEE Computer Society

Y2 - 8 July 2019 through 13 July 2019

ER -

Slimmer: Weight loss secrets for docker registries

Abstract

Publication series

Conference

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this