ZoneTier: A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives

Xuchao Xie, Liquan Xiao, David H.C. Du

Research output: Contribution to journalArticle

Abstract

Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.

Original languageEnglish (US)
Article numberA19
JournalACM Transactions on Storage
Volume15
Issue number3
DOIs
StatePublished - Aug 2019

Fingerprint

Magnetic recording
Cleaning
HPSS
Relocation
Hybrid systems
Information management
Recovery
Costs
Experiments

Keywords

  • Host-aware
  • Shingled magnetic recording (SMR)
  • Tiering and caching co-design
  • ZoneTier

Cite this

ZoneTier : A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives. / Xie, Xuchao; Xiao, Liquan; Du, David H.C.

In: ACM Transactions on Storage, Vol. 15, No. 3, A19, 08.2019.

Research output: Contribution to journalArticle

@article{d5cebce50c3c4b92b27c29978e39b7f1,
title = "ZoneTier: A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives",
abstract = "Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41{\%} on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37{\%}, and improve performance by up to 32.31{\%} than existing hybrid storage designs.",
keywords = "Host-aware, Shingled magnetic recording (SMR), Tiering and caching co-design, ZoneTier",
author = "Xuchao Xie and Liquan Xiao and Du, {David H.C.}",
year = "2019",
month = "8",
doi = "10.1145/3335548",
language = "English (US)",
volume = "15",
journal = "ACM Transactions on Storage",
issn = "1553-3077",
publisher = "Association for Computing Machinery (ACM)",
number = "3",

}

TY - JOUR

T1 - ZoneTier

T2 - A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives

AU - Xie, Xuchao

AU - Xiao, Liquan

AU - Du, David H.C.

PY - 2019/8

Y1 - 2019/8

N2 - Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.

AB - Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zonebased storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.

KW - Host-aware

KW - Shingled magnetic recording (SMR)

KW - Tiering and caching co-design

KW - ZoneTier

UR - http://www.scopus.com/inward/record.url?scp=85074816079&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074816079&partnerID=8YFLogxK

U2 - 10.1145/3335548

DO - 10.1145/3335548

M3 - Article

AN - SCOPUS:85074816079

VL - 15

JO - ACM Transactions on Storage

JF - ACM Transactions on Storage

SN - 1553-3077

IS - 3

M1 - A19

ER -