Cross-object coding and allocation (COCA) for distributed storage systems

Luoyang Fang, Rongqing Zhang, Xiang Cheng, Liuqing Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Distributed storage systems (DSSs) are widely employed in data centers and sensing networks to resist storage node failures. Structured redundancy is introduced to DSS by various coding schemes to efficiently account for failures of storage nodes. The allocation of the coded data blocks to storage nodes is another factor that impacts the data reliability. In this paper, we investigate the coding and allocation problem on multiple data objects in DSS. We propose a cross-object coding and allocation (COCA), which amounts to encoding and symmetric allocation on one large virtual data object aggregated by multiple data objects. We first explore the benefits of the proposed COCA scheme and find its reliability improvement in terms of joint successful recovery probability. However, such reliability improvement comes at the cost of increased data retrieval complexity. Hence, an optimization problem is formulated to explore the tradeoff between data reliability and data retrieval complexity. By employing a coalition formation game to model the process of the data objects grouping, we also propose a coalition-formation-based grouping algorithm to provide a suboptimal solution with greatly reduced computation complexity. Simulations validate the reliability improvement of our proposed COCA scheme and the effectiveness of our proposed coalition-formation-based algorithm.

Original languageEnglish (US)
Title of host publication2017 IEEE International Conference on Communications, ICC 2017
EditorsMerouane Debbah, David Gesbert, Abdelhamid Mellouk
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781467389990
DOIs
StatePublished - Jul 28 2017
Externally publishedYes
Event2017 IEEE International Conference on Communications, ICC 2017 - Paris, France
Duration: May 21 2017May 25 2017

Publication series

NameIEEE International Conference on Communications
ISSN (Print)1550-3607

Other

Other2017 IEEE International Conference on Communications, ICC 2017
CountryFrance
CityParis
Period5/21/175/25/17

Fingerprint Dive into the research topics of 'Cross-object coding and allocation (COCA) for distributed storage systems'. Together they form a unique fingerprint.

Cite this