Flexible, wide-area storage for distributed systems with wheelfs

Jeremy Stribling, Yair Sovran, Irene Zhang, Xavid Pretzer, Jinyang Li, M. Frans Kaashoek, Robert Morris

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

WheelFS is a wide-area distributed storage system intended to help multi-site applications share data and gain fault tolerance. WheelFS takes the form of a distributed file system with a familiar POSIX interface. Its design allows applications to adjust the tradeoff between prompt visibility of updates from other sites and the ability for sites to operate independently despite failures and long delays. WheelFS allows these adjustments via semantic cues, which provide application control over consistency, failure handling, and file and replica placement. WheelFS is implemented as a user-level file system and is deployed on PlanetLab and Emulab. Three applications (a distributed Web cache, an email service and large file distribution) demonstrate that WheelFS's file system interface simplifies construction of distributed applications by allowing reuse of existing software. These applications would perform poorly with the strict semantics implied by a traditional file system interface, but by providing cues to WheelFS they are able to achieve good performance. Measurements show that applications built on WheelFS deliver comparable performance to services such as CoralCDN and BitTorrent that use specialized wide-area storage systems.

Original languageEnglish (US)
Title of host publicationProceedings of the 6th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2009
PublisherUSENIX Association
Pages43-58
Number of pages16
ISBN (Electronic)9781931971676
StatePublished - Jan 1 2019
Event6th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2009 - Boston, United States
Duration: Apr 22 2009Apr 24 2009

Publication series

NameProceedings of the 6th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2009

Conference

Conference6th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2009
CountryUnited States
CityBoston
Period4/22/094/24/09

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Flexible, wide-area storage for distributed systems with wheelfs'. Together they form a unique fingerprint.

Cite this