HyLine: A Simple and Practical Flow Scheduling for Commodity Datacenters

Soheil Abbasloo, Yang Xu, H. Jonathan Chao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Today's datacenter networks (DCNs) have been built upon multipath topologies where each path contains multiple links. However, flow scheduling schemes proposed to minimize flow completion times (FCT) in DCNs are based on algorithms which are optimum or close-to-optimum only over single link. Moreover, most of these scheduling schemes seek either fully centralized approaches having overhead of communicating to a central entity or fully distributed approaches requiring changes in the fabric.Motivated by these shortcomings, we present HyLine a simple scheduling design for commodity DCNs which is equipped with a joint load-balancing and flow scheduling (path-aware) design exploiting the multipath nature of DCNs. HyLine takes a hybrid approach and uses the global-awareness of centralized and agility of distributed techniques without requiring any changes in the fabric. To that end, it determines a threshold margin identifying flows for which using centralized approach is beneficial.We have shown through extensive ns2 simulations that despite HyLine's simplicity, it significantly outperforms existing schemes and achieves lower average and 99th percentile FCTs. For instance, compared to Qjump-state-of-the-art practical scheme- and pFabric-one of the best performing flow scheduling schemes- HyLine reduces average FCT up to 68% and 31%, respectively, under a production datacenter workload.

Original languageEnglish (US)
Title of host publication2018 IFIP Networking Conference IFIP Networking and Workshops, IFIP Networking 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages334-342
Number of pages9
ISBN (Electronic)9783903176089
DOIs
StatePublished - Jul 2 2018
Event17th IFIP Networking Conference IFIP Networking and Workshops, IFIP Networking 2018 - Zurich, Switzerland
Duration: May 14 2018May 16 2018

Publication series

Name2018 IFIP Networking Conference IFIP Networking and Workshops, IFIP Networking 2018 - Proceedings

Conference

Conference17th IFIP Networking Conference IFIP Networking and Workshops, IFIP Networking 2018
Country/TerritorySwitzerland
CityZurich
Period5/14/185/16/18

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'HyLine: A Simple and Practical Flow Scheduling for Commodity Datacenters'. Together they form a unique fingerprint.

Cite this