Improved single-round protocols for remote file synchronization

Utku Irmak, Svilen Mihaylov, Torsten Suel

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Given two versions of a file, a current version located on one machine and an outdated version known only to another machine, the remote file synchronization problem is how to update the outdated version over a network with a minimal amount of communication. In particular, when the versions are very similar, the total data transmitted should be significantly smaller than the file size. File synchronization problems arise in many application scenarios such as web site mirroring, file system backup and replication, and web access over slow links. An open source tool for this problem, called rsync and included in many Linux distributions, is widely used in such scenarios, rsync uses a single round of messages between the two machines. While recent research has shown that significant additional savings in bandwidth consumption are possible through the use of optimized multi-round protocols, there are many scenarios where multiple rounds are undesirable. In this paper, we study single-round protocols for file synchronization that offer significant improvements over rsync. Our main contribution is a new approach to file synchronization based on the use of erasure codes. Using this approach, we design a single-round protocol that is provably efficient with respect to common measures of file distance, and another optimized practical protocol that shows promising improvements over rsync on our data sets. In addition, we show how to obtain moderate improvements by engineering the rsync approach.

    Original languageEnglish (US)
    Title of host publicationProceedings - IEEE INFOCOM 2005. The Conference on Computer Communications - 24th Annual Joint Conference of the IEEE Computer and Communications Societies
    EditorsK. Makki, E. Knightly
    Pages1665-1676
    Number of pages12
    DOIs
    StatePublished - 2005
    EventIEEE INFOCOM 2005 - Miami, FL, United States
    Duration: Mar 13 2005Mar 17 2005

    Publication series

    NameProceedings - IEEE INFOCOM
    Volume3
    ISSN (Print)0743-166X

    Other

    OtherIEEE INFOCOM 2005
    CountryUnited States
    CityMiami, FL
    Period3/13/053/17/05

    ASJC Scopus subject areas

    • Computer Science(all)
    • Electrical and Electronic Engineering

    Fingerprint Dive into the research topics of 'Improved single-round protocols for remote file synchronization'. Together they form a unique fingerprint.

  • Cite this

    Irmak, U., Mihaylov, S., & Suel, T. (2005). Improved single-round protocols for remote file synchronization. In K. Makki, & E. Knightly (Eds.), Proceedings - IEEE INFOCOM 2005. The Conference on Computer Communications - 24th Annual Joint Conference of the IEEE Computer and Communications Societies (pp. 1665-1676). (Proceedings - IEEE INFOCOM; Vol. 3). https://doi.org/10.1109/INFCOM.2005.1498448