SmartEntry: Mitigating routing update overhead with reinforcement learning for traffic engineering

Junjie Zhang, Zehua Guo, Minghao Ye, H. Jonathan Chao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Traffic Engineering (TE) has been used by Internet service providers to improve their network performance and provide better service quality to users. While flow-based TE is an alternative, destination-based TE is a more readily deployed solution. This is because destination-based forwarding is ubiquitously supported by today's routers. A challenge faced by state-of-the-art destination-based TE solutions is considerable time taken by a centralized controller to update traffic split ratios for each entry of the forwarding table of each router. This could impose a fundamental limitation on how responsively the network can react to dynamic changes of traffic demands. In this paper, we propose SmartEntry, a destination-based routing solution coupled with Reinforcement Learning (RL) to reduce the number of the forwarding entries that need to be updated to respond to dynamic change of traffic demands. SmartEntry forwards majority traffic on Equal-Cost Multi-Path (ECMP) and redistributes a small portion of traffic using our proposed RL algorithm. SmartEntry adopts Linear Programming (LP) to produce reward signals. This RL + LP combined approach turns out to be surprisingly effective. We evaluate SmartEntry by conducting extensive experiments on different network topologies with both real and synthesized traffic. The simulation results show that SmartEntry achieves near-optimal performance with a saving of 90% forwarding entry updates, and generalizes well to unseen traffic matrices.

Original languageEnglish (US)
Title of host publicationNetAI 2020 - Proceedings of the 2020 Workshop on Network Meets AI and ML
PublisherAssociation for Computing Machinery
Pages1-7
Number of pages7
ISBN (Electronic)9781450380430
DOIs
StatePublished - Aug 14 2020
Event2020 ACM Workshop on Network Meets AI and ML, NetAI 2020 - Virtual, Online, United States
Duration: Aug 14 2020 → …

Publication series

NameNetAI 2020 - Proceedings of the 2020 Workshop on Network Meets AI and ML

Conference

Conference2020 ACM Workshop on Network Meets AI and ML, NetAI 2020
Country/TerritoryUnited States
CityVirtual, Online
Period8/14/20 → …

Keywords

  • Linear Programming
  • Reinforcement Learning
  • Routing Update Overhead
  • Traffic Engineering

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'SmartEntry: Mitigating routing update overhead with reinforcement learning for traffic engineering'. Together they form a unique fingerprint.

Cite this