TY - GEN
T1 - A large-scale characterization of online incitements to harassment across platforms
AU - Aliapoulios, Max
AU - Take, Kejsi
AU - Ramakrishna, Prashanth
AU - Borkan, Daniel
AU - Goldberg, Beth
AU - Sorensen, Jeffrey
AU - Turner, Anna
AU - Greenstadt, Rachel
AU - Lauinger, Tobias
AU - McCoy, Damon
N1 - Funding Information:
We thank the anonymous reviewers and shepherd for their useful feedback. This research was supported by a contract from Google and National Science Foundation grants 1916126 and 2016061.
Publisher Copyright:
© 2021 Owner/Author.
PY - 2021/11/2
Y1 - 2021/11/2
N2 - Attack strategies used by online harassers have evolved over time to inflict increasing harm to their targets. In addition to scaling harassment through incitement and coordination, online communities that commonly engage in harassment are likely a source of "innovation" for harassment attack strategies. We use the incitements or calls to harassment posted by members of these communities as a lens through which to holistically measure and understand this ecosystem. We create a filtering pipeline to discover 14,679 incitements to harassment within four large-scale data sets of messages and posts that span multiple platforms. Our approach studies the coordination itself, detecting inciting language, rather than individual attack types, to understand a broad range of harassment strategies. In particular, this approach allows us to create a taxonomy of attack strategies. We use this taxonomy to categorize the preferred approaches of coordinated attackers and the proportion of incitements for various types of harassment on different platforms. We find that over 50% of the incitements to harassment included calls to report the target to authorities or their respective platforms. Finally, we provide suggestions for actions and future research that could be performed by researchers, platforms, authorities, and anti-harassment groups.
AB - Attack strategies used by online harassers have evolved over time to inflict increasing harm to their targets. In addition to scaling harassment through incitement and coordination, online communities that commonly engage in harassment are likely a source of "innovation" for harassment attack strategies. We use the incitements or calls to harassment posted by members of these communities as a lens through which to holistically measure and understand this ecosystem. We create a filtering pipeline to discover 14,679 incitements to harassment within four large-scale data sets of messages and posts that span multiple platforms. Our approach studies the coordination itself, detecting inciting language, rather than individual attack types, to understand a broad range of harassment strategies. In particular, this approach allows us to create a taxonomy of attack strategies. We use this taxonomy to categorize the preferred approaches of coordinated attackers and the proportion of incitements for various types of harassment on different platforms. We find that over 50% of the incitements to harassment included calls to report the target to authorities or their respective platforms. Finally, we provide suggestions for actions and future research that could be performed by researchers, platforms, authorities, and anti-harassment groups.
KW - cyberbullying
KW - doxing
KW - empirical measurement
KW - online coordinated harassment
KW - online social harm
UR - http://www.scopus.com/inward/record.url?scp=85118995684&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85118995684&partnerID=8YFLogxK
U2 - 10.1145/3487552.3487852
DO - 10.1145/3487552.3487852
M3 - Conference contribution
AN - SCOPUS:85118995684
T3 - Proceedings of the ACM SIGCOMM Internet Measurement Conference, IMC
SP - 621
EP - 638
BT - IMC 2021 - Proceedings of the 2021 ACM Internet Measurement Conference
PB - Association for Computing Machinery
T2 - 21st ACM Internet Measurement Conference, IMC 2021
Y2 - 2 November 2021 through 4 November 2021
ER -