Learning to extract quality discourse in online communities

Michael Brennan, Stacy Wrazien, Rachel Greenstadt

    Research output: Chapter in Book/Report/Conference proceedingConference contribution


    Collaborative filtering systems have been developed to manage information overload and improve discourse in online communities. In such systems, users rank content provided by other users on the validity or usefulness within their particular context. The goal is that "good" content will rise to prominence and "bad" content will fade into obscurity. These filtering mechanisms are not well-understood and have known weaknesses. For example, they depend on the presence of a large crowd to rate content, but such a crowd may not be present. Additionally, the community's decisions determine which voices will reach a large audience and which will be silenced, but it is not known if these decisions represent "the wisdom of crowds" or a "censoring mob." Our approach uses statistical machine learning to predict community ratings. By extracting features that replicate the community's verdict, we can better understand collaborative filtering, improve the way the community uses the ratings of their members, and design agents that augment community decision-making. Slashdot is an example of such a community where peers will rate each others' comments based on their relevance to the post. This work extracts a wide variety of features from the Slashdot metadata and posts' linguistic contents to identify features that can predict the community rating. We find that author reputation, use of pronouns, and author sentiment are salient. We achieve 76% accuracy predicting community ratings as good, neutral, or bad.

    Original languageEnglish (US)
    Title of host publicationCollaboratively-Built Knowledge Sources and Artificial Intelligence - Papers from the 2010 AAAI Workshop, Technical Report
    Number of pages6
    StatePublished - 2010
    Event2010 AAAI Workshop - Atlanta, GA, United States
    Duration: Jul 12 2010Jul 12 2010

    Publication series

    NameAAAI Workshop - Technical Report


    Conference2010 AAAI Workshop
    Country/TerritoryUnited States
    CityAtlanta, GA

    ASJC Scopus subject areas

    • General Engineering


    Dive into the research topics of 'Learning to extract quality discourse in online communities'. Together they form a unique fingerprint.

    Cite this