In-network Congestion-aware Load Balancing at Transport Layer

Ashkan Aghdai, Michael I.C. Wang, Yang Xu, Charles H.P. Wenz, H. Jonathan Chao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Load balancing at transport layer is an important function in data centers, content delivery networks, and mobile networks, where per-connection consistency (PCC) has to be met for optimal performance. Cloud-native L4 load balancers are commonly deployed as virtual network functions (VNFs) and are a critical forwarding element in modern cloud infrastructure. We identify load imbalance among service instances as the main cause of additional processing delay caused by transport-layer load balancers. Existing transport-layer load balancers rely on one of two methods: host-level traffic redirection, which may add as much as 12.48% additional traffic to underlying networks, or connection tracking, which consumes a considerable amount of memory in load balancers. Both of these methods result in inefficient usage of network resources. We propose the in-network congestion-aware load Balancer (INCAB) to achieve even load distribution among service instances and optimal network resources usage in addition to meeting the PCC requirement. We show that INCAB is capable of identifying and monitoring each instance's most-utilized resource and can improve the load distribution among all service instances. INCAB utilizes a Bloom filter and an ultra-compact connection table for in-network flow distribution. Furthermore, it does not rely on end hosts for traffic redirection. Our flow level simulations show that INCAB improves flows' average completion time by 31.97% compared to stateless solutions.

Original languageEnglish (US)
Title of host publicationIEEE Conference on Network Function Virtualization and Software Defined Networks, NFV-SDN 2019 - Proceedings
EditorsLarry Horner, Kurt Tutschku, Fabrizio Granelli, Yuji Sekiya, Marco Tacca, Deval Bhamare, Helge Parzyjegla
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728145457
DOIs
StatePublished - Nov 2019
Event2019 IEEE Conference on Network Function Virtualization and Software Defined Networks, NFV-SDN 2019 - Dallas, United States
Duration: Nov 12 2019Nov 14 2019

Publication series

NameIEEE Conference on Network Function Virtualization and Software Defined Networks, NFV-SDN 2019 - Proceedings

Conference

Conference2019 IEEE Conference on Network Function Virtualization and Software Defined Networks, NFV-SDN 2019
CountryUnited States
CityDallas
Period11/12/1911/14/19

Keywords

  • network function virtualization
  • software defined networks
  • transport layer load balancing

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Media Technology

Fingerprint Dive into the research topics of 'In-network Congestion-aware Load Balancing at Transport Layer'. Together they form a unique fingerprint.

Cite this