Heavy-hitter detection entirely in the data plane

Vibhaalakshmi Sivaraman, Srinivas Narayana, Ori Rottenstreich, S. Muthukrishnan, Jennifer Rexford

    Research output: Chapter in Book/Report/Conference proceedingConference contribution


    Identifying the "heavy hitter" flows or flows with large traffic volumes in the data plane is important for several applications e.g., flow-size aware routing, DoS detection, and traffic engineering. However, measurement in the data plane is constrained by the need for linerate processing (at 10-100Gb/s) and limited memory in switching hardware. We propose HashPipe, a heavy hitter detection algorithm using emerging programmable data planes. HashPipe implements a pipeline of hash tables which retain counters for heavy flows while evicting lighter flows over time. We prototype HashPipe in P4 and evaluate it with packet traces from an ISP backbone link and a data center. On the ISP trace (which contains over 400,000 flows), we find that HashPipe identifies 95% of the 300 heaviest flows with less than 80KB of memory.

    Original languageEnglish (US)
    Title of host publicationSOSR 2017 - Proceedings of the 2017 Symposium on SDN Research
    PublisherAssociation for Computing Machinery, Inc
    Number of pages13
    ISBN (Electronic)9781450349475
    StatePublished - Apr 3 2017
    Event2017 Symposium on SDN Research, SOSR 2017 - Santa Clara, United States
    Duration: Apr 3 2017Apr 4 2017

    Publication series

    NameSOSR 2017 - Proceedings of the 2017 Symposium on SDN Research


    Conference2017 Symposium on SDN Research, SOSR 2017
    Country/TerritoryUnited States
    CitySanta Clara


    • Network algorithms
    • Network monitoring
    • Programmable networks
    • Software-defined networks

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Software


    Dive into the research topics of 'Heavy-hitter detection entirely in the data plane'. Together they form a unique fingerprint.

    Cite this