Giza: Erasure coding objects across global data centers

Yu Lin Chen, Shuai Mu, Jinyang Li, Cheng Huang, Jin Li, Aaron Ogus, Douglas Phillips

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Microsoft Azure Storage is a global cloud storage system with a footprint in 38 geographic regions. To protect customer data against catastrophic data center failures, it optionally replicates data to secondary DCs hundreds of miles away. Using Microsoft OneDrive as an example, this paper illustrates the characteristics of typical cloud storage workloads and the opportunity to lower storage cost for geo-redundancy with erasure coding. The paper presents the design, implementation and evaluation of Giza - a strongly consistent, versioned object store that applies erasure coding across global data centers. The key technical challenge Giza addresses is to achieve single cross-DC round trip latency for the common contention-free workload, while also maintaining strong consistency when there are conflicting access. Giza addresses the challenge with a novel implementation of well-known distributed consensus algorithms tailored for restricted cloud storage APIs. Giza is deployed to 11 DCs across 3 continents and experimental results demonstrate that it achieves our design goals.

Original languageEnglish (US)
Title of host publicationProceedings of the 2017 USENIX Annual Technical Conference, USENIX ATC 2017
PublisherUSENIX Association
Pages539-551
Number of pages13
ISBN (Electronic)9781931971386
StatePublished - 2019
Event2017 USENIX Annual Technical Conference, USENIX ATC 2017 - Santa Clara, United States
Duration: Jul 12 2017Jul 14 2017

Publication series

NameProceedings of the 2017 USENIX Annual Technical Conference, USENIX ATC 2017

Conference

Conference2017 USENIX Annual Technical Conference, USENIX ATC 2017
CountryUnited States
CitySanta Clara
Period7/12/177/14/17

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Giza: Erasure coding objects across global data centers'. Together they form a unique fingerprint.

  • Cite this

    Chen, Y. L., Mu, S., Li, J., Huang, C., Li, J., Ogus, A., & Phillips, D. (2019). Giza: Erasure coding objects across global data centers. In Proceedings of the 2017 USENIX Annual Technical Conference, USENIX ATC 2017 (pp. 539-551). (Proceedings of the 2017 USENIX Annual Technical Conference, USENIX ATC 2017). USENIX Association.