TY - JOUR
T1 - Hiding opinions from machine learning
AU - Waniek, Marcin
AU - Magdy, Walid
AU - Rahwan, Talal
N1 - Publisher Copyright:
© The Author(s) 2022.
PY - 2022/11/1
Y1 - 2022/11/1
N2 - Recent breakthroughs in machine learning and big data analysis are allowing our online activities to be scrutinized at an unprecedented scale, and our private information to be inferred without our consent or knowledge. Here, we focus on algorithms designed to infer the opinions of Twitter users toward a growing number of topics, and consider the possibility of modifying the profiles of these users in the hope of hiding their opinions from such algorithms. We ran a survey to understand the extent of this privacy threat, and found evidence suggesting that a significant proportion of Twitter users wish to avoid revealing at least some of their opinions about social, political, and religious issues. Moreover, our participants were unable to reliably identify the Twitter activities that reveal one’s opinion to such algorithms. Given these findings, we consider the possibility of fighting AI with AI, i.e., instead of relying on human intuition, people may have a better chance at hiding their opinion if they modify their Twitter profiles following advice from an automated assistant. We propose a heuristic that identifies which Twitter accounts the users should follow or mention in their tweets, and show that such a heuristic can effectively hide the user’s opinions. Altogether, our study highlights the risk associated with developing machine learning algorithms that analyze people’s profiles, and demonstrates the potential to develop countermeasures that preserve the basic right of choosing which of our opinions to share with the world.
AB - Recent breakthroughs in machine learning and big data analysis are allowing our online activities to be scrutinized at an unprecedented scale, and our private information to be inferred without our consent or knowledge. Here, we focus on algorithms designed to infer the opinions of Twitter users toward a growing number of topics, and consider the possibility of modifying the profiles of these users in the hope of hiding their opinions from such algorithms. We ran a survey to understand the extent of this privacy threat, and found evidence suggesting that a significant proportion of Twitter users wish to avoid revealing at least some of their opinions about social, political, and religious issues. Moreover, our participants were unable to reliably identify the Twitter activities that reveal one’s opinion to such algorithms. Given these findings, we consider the possibility of fighting AI with AI, i.e., instead of relying on human intuition, people may have a better chance at hiding their opinion if they modify their Twitter profiles following advice from an automated assistant. We propose a heuristic that identifies which Twitter accounts the users should follow or mention in their tweets, and show that such a heuristic can effectively hide the user’s opinions. Altogether, our study highlights the risk associated with developing machine learning algorithms that analyze people’s profiles, and demonstrates the potential to develop countermeasures that preserve the basic right of choosing which of our opinions to share with the world.
KW - machine learning
KW - privacy
KW - social media
KW - Stance detection
UR - http://www.scopus.com/inward/record.url?scp=85159905835&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85159905835&partnerID=8YFLogxK
U2 - 10.1093/pnasnexus/pgac256
DO - 10.1093/pnasnexus/pgac256
M3 - Article
AN - SCOPUS:85159905835
SN - 2752-6542
VL - 1
JO - PNAS Nexus
JF - PNAS Nexus
IS - 5
M1 - pgac256
ER -