A large-scale characterization of online incitements to harassment across platforms

Max Aliapoulios, Kejsi Take, Prashanth Ramakrishna, Daniel Borkan, Beth Goldberg, Jeffrey Sorensen, Anna Turner, Rachel Greenstadt, Tobias Lauinger, Damon McCoy

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Attack strategies used by online harassers have evolved over time to inflict increasing harm to their targets. In addition to scaling harassment through incitement and coordination, online communities that commonly engage in harassment are likely a source of "innovation" for harassment attack strategies. We use the incitements or calls to harassment posted by members of these communities as a lens through which to holistically measure and understand this ecosystem. We create a filtering pipeline to discover 14,679 incitements to harassment within four large-scale data sets of messages and posts that span multiple platforms. Our approach studies the coordination itself, detecting inciting language, rather than individual attack types, to understand a broad range of harassment strategies. In particular, this approach allows us to create a taxonomy of attack strategies. We use this taxonomy to categorize the preferred approaches of coordinated attackers and the proportion of incitements for various types of harassment on different platforms. We find that over 50% of the incitements to harassment included calls to report the target to authorities or their respective platforms. Finally, we provide suggestions for actions and future research that could be performed by researchers, platforms, authorities, and anti-harassment groups.

    Original languageEnglish (US)
    Title of host publicationIMC 2021 - Proceedings of the 2021 ACM Internet Measurement Conference
    PublisherAssociation for Computing Machinery
    Pages621-638
    Number of pages18
    ISBN (Electronic)9781450391290
    DOIs
    StatePublished - Nov 2 2021
    Event21st ACM Internet Measurement Conference, IMC 2021 - Virtual, Online, United States
    Duration: Nov 2 2021Nov 4 2021

    Publication series

    NameProceedings of the ACM SIGCOMM Internet Measurement Conference, IMC

    Conference

    Conference21st ACM Internet Measurement Conference, IMC 2021
    Country/TerritoryUnited States
    CityVirtual, Online
    Period11/2/2111/4/21

    Keywords

    • cyberbullying
    • doxing
    • empirical measurement
    • online coordinated harassment
    • online social harm

    ASJC Scopus subject areas

    • Software
    • Computer Networks and Communications

    Fingerprint

    Dive into the research topics of 'A large-scale characterization of online incitements to harassment across platforms'. Together they form a unique fingerprint.

    Cite this