Annotating targets of opinions in arabic using crowdsourcing

Noura Farra; Kathleen McKeown; Nizar Habash

Annotating targets of opinions in arabic using crowdsourcing

Noura Farra, Kathleen McKeown, Nizar Habash

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We present a method for annotating targets of opinions in Arabic in a two-stage process using the crowdsourcing tool Amazon Mechanical Turk. The first stage consists of identifying candidate targets "entities" in a given text. The second stage consists of identifying the opinion polarity (positive, negative, or neutral) expressed about a specific entity. We annotate a corpus of Arabic text using this method, selecting our data from online commentaries in different domains. Despite the complexity of the task, we find high agreement. We present detailed analysis.

Original language	English (US)
Title of host publication	2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings
Editors	Nizar Habash, Stephan Vogel, Kareem Darwish
Publisher	Association for Computational Linguistics (ACL)
Pages	89-98
Number of pages	10
ISBN (Electronic)	9781941643587
State	Published - 2015
Event	2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - Beijing, China Duration: Jul 30 2015 → …

Publication series

Name	2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings

Conference

Conference	2nd Workshop on Arabic Natural Language Processing, ANLP 2015
Country/Territory	China
City	Beijing
Period	7/30/15 → …

ASJC Scopus subject areas

Computer Science Applications
Computational Theory and Mathematics
Software

Cite this

Farra, N., McKeown, K., & Habash, N. (2015). Annotating targets of opinions in arabic using crowdsourcing. In N. Habash, S. Vogel, & K. Darwish (Eds.), 2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings (pp. 89-98). (2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings). Association for Computational Linguistics (ACL).

Annotating targets of opinions in arabic using crowdsourcing. / Farra, Noura; McKeown, Kathleen; Habash, Nizar.
2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings. ed. / Nizar Habash; Stephan Vogel; Kareem Darwish. Association for Computational Linguistics (ACL), 2015. p. 89-98 (2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Farra, N, McKeown, K & Habash, N 2015, Annotating targets of opinions in arabic using crowdsourcing. in N Habash, S Vogel & K Darwish (eds), 2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings. 2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings, Association for Computational Linguistics (ACL), pp. 89-98, 2nd Workshop on Arabic Natural Language Processing, ANLP 2015, Beijing, China, 7/30/15.

Farra N, McKeown K, Habash N. Annotating targets of opinions in arabic using crowdsourcing. In Habash N, Vogel S, Darwish K, editors, 2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings. Association for Computational Linguistics (ACL). 2015. p. 89-98. (2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings).

Farra, Noura ; McKeown, Kathleen ; Habash, Nizar. / Annotating targets of opinions in arabic using crowdsourcing. 2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings. editor / Nizar Habash ; Stephan Vogel ; Kareem Darwish. Association for Computational Linguistics (ACL), 2015. pp. 89-98 (2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings).

@inproceedings{c0604246726f4991a6d69cf32244d185,

title = "Annotating targets of opinions in arabic using crowdsourcing",

abstract = "We present a method for annotating targets of opinions in Arabic in a two-stage process using the crowdsourcing tool Amazon Mechanical Turk. The first stage consists of identifying candidate targets {"}entities{"} in a given text. The second stage consists of identifying the opinion polarity (positive, negative, or neutral) expressed about a specific entity. We annotate a corpus of Arabic text using this method, selecting our data from online commentaries in different domains. Despite the complexity of the task, we find high agreement. We present detailed analysis.",

author = "Noura Farra and Kathleen McKeown and Nizar Habash",

year = "2015",

language = "English (US)",

series = "2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings",

publisher = "Association for Computational Linguistics (ACL)",

pages = "89--98",

editor = "Nizar Habash and Stephan Vogel and Kareem Darwish",

booktitle = "2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings",

}

TY - GEN

T1 - Annotating targets of opinions in arabic using crowdsourcing

AU - Farra, Noura

AU - McKeown, Kathleen

AU - Habash, Nizar

PY - 2015

Y1 - 2015

N2 - We present a method for annotating targets of opinions in Arabic in a two-stage process using the crowdsourcing tool Amazon Mechanical Turk. The first stage consists of identifying candidate targets "entities" in a given text. The second stage consists of identifying the opinion polarity (positive, negative, or neutral) expressed about a specific entity. We annotate a corpus of Arabic text using this method, selecting our data from online commentaries in different domains. Despite the complexity of the task, we find high agreement. We present detailed analysis.

AB - We present a method for annotating targets of opinions in Arabic in a two-stage process using the crowdsourcing tool Amazon Mechanical Turk. The first stage consists of identifying candidate targets "entities" in a given text. The second stage consists of identifying the opinion polarity (positive, negative, or neutral) expressed about a specific entity. We annotate a corpus of Arabic text using this method, selecting our data from online commentaries in different domains. Despite the complexity of the task, we find high agreement. We present detailed analysis.

UR - http://www.scopus.com/inward/record.url?scp=85021643066&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85021643066&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85021643066

T3 - 2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings

SP - 89

EP - 98

BT - 2nd Workshop on Arabic Natural Language Processing, ANLP 2015 - held at 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015 - Proceedings

A2 - Habash, Nizar

A2 - Vogel, Stephan

A2 - Darwish, Kareem

PB - Association for Computational Linguistics (ACL)

T2 - 2nd Workshop on Arabic Natural Language Processing, ANLP 2015

Y2 - 30 July 2015

ER -

Annotating targets of opinions in arabic using crowdsourcing

Abstract

Publication series

Conference

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this