Distant supervision for relation extraction with an incomplete knowledge base

Bonan Min; Ralph Grishman; Li Wan; Chang Wang; David Gondek

Distant supervision for relation extraction with an incomplete knowledge base

Bonan Min, Ralph Grishman, Li Wan, Chang Wang, David Gondek

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Distant supervision, heuristically labeling a corpus using a knowledge base, has emerged as a popular choice for training relation extractors. In this paper, we show that a significant number of "negative" examples generated by the labeling process are false negatives because the knowledge base is incomplete. Therefore the heuristic for generating negative examples has a serious flaw. Building on a state-of-The-Art distantly-supervised extraction algorithm, we proposed an algorithm that learns from only positive and unlabeled labels at the pair-of-entity level. Experimental results demonstrate its advantage over existing algorithms.

Original language	English (US)
Title of host publication	Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics
Subtitle of host publication	Human Language Technologies
Publisher	Association for Computational Linguistics (ACL)
Pages	777-782
Number of pages	6
ISBN (Electronic)	9781937284473
State	Published - 2013
Event	2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2013 - Atlanta, United States Duration: Jun 9 2013 → Jun 14 2013

Publication series

Name	NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Other

Other	2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2013
Country/Territory	United States
City	Atlanta
Period	6/9/13 → 6/14/13

ASJC Scopus subject areas

Language and Linguistics
Computer Science Applications
Linguistics and Language

Cite this

Min, B., Grishman, R., Wan, L., Wang, C., & Gondek, D. (2013). Distant supervision for relation extraction with an incomplete knowledge base. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 777-782). (NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference). Association for Computational Linguistics (ACL).

Distant supervision for relation extraction with an incomplete knowledge base. / Min, Bonan; Grishman, Ralph; Wan, Li et al.
Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics (ACL), 2013. p. 777-782 (NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Min, B, Grishman, R, Wan, L, Wang, C & Gondek, D 2013, Distant supervision for relation extraction with an incomplete knowledge base. in Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference, Association for Computational Linguistics (ACL), pp. 777-782, 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2013, Atlanta, United States, 6/9/13.

Min B, Grishman R, Wan L, Wang C, Gondek D. Distant supervision for relation extraction with an incomplete knowledge base. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics (ACL). 2013. p. 777-782. (NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference).

Min, Bonan ; Grishman, Ralph ; Wan, Li et al. / Distant supervision for relation extraction with an incomplete knowledge base. Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics (ACL), 2013. pp. 777-782 (NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference).

@inproceedings{afa19f3e18b5405db9576612e111f94e,

title = "Distant supervision for relation extraction with an incomplete knowledge base",

abstract = "Distant supervision, heuristically labeling a corpus using a knowledge base, has emerged as a popular choice for training relation extractors. In this paper, we show that a significant number of {"}negative{"} examples generated by the labeling process are false negatives because the knowledge base is incomplete. Therefore the heuristic for generating negative examples has a serious flaw. Building on a state-of-The-Art distantly-supervised extraction algorithm, we proposed an algorithm that learns from only positive and unlabeled labels at the pair-of-entity level. Experimental results demonstrate its advantage over existing algorithms.",

author = "Bonan Min and Ralph Grishman and Li Wan and Chang Wang and David Gondek",

note = "Publisher Copyright: {\textcopyright} 2013 Association for Computational Linguistics.; 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2013 ; Conference date: 09-06-2013 Through 14-06-2013",

year = "2013",

language = "English (US)",

series = "NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference",

publisher = "Association for Computational Linguistics (ACL)",

pages = "777--782",

booktitle = "Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics",

}

TY - GEN

T1 - Distant supervision for relation extraction with an incomplete knowledge base

AU - Min, Bonan

AU - Grishman, Ralph

AU - Wan, Li

AU - Wang, Chang

AU - Gondek, David

PY - 2013

Y1 - 2013

N2 - Distant supervision, heuristically labeling a corpus using a knowledge base, has emerged as a popular choice for training relation extractors. In this paper, we show that a significant number of "negative" examples generated by the labeling process are false negatives because the knowledge base is incomplete. Therefore the heuristic for generating negative examples has a serious flaw. Building on a state-of-The-Art distantly-supervised extraction algorithm, we proposed an algorithm that learns from only positive and unlabeled labels at the pair-of-entity level. Experimental results demonstrate its advantage over existing algorithms.

AB - Distant supervision, heuristically labeling a corpus using a knowledge base, has emerged as a popular choice for training relation extractors. In this paper, we show that a significant number of "negative" examples generated by the labeling process are false negatives because the knowledge base is incomplete. Therefore the heuristic for generating negative examples has a serious flaw. Building on a state-of-The-Art distantly-supervised extraction algorithm, we proposed an algorithm that learns from only positive and unlabeled labels at the pair-of-entity level. Experimental results demonstrate its advantage over existing algorithms.

UR - http://www.scopus.com/inward/record.url?scp=84926224568&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84926224568&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84926224568

T3 - NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

SP - 777

EP - 782

BT - Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics

PB - Association for Computational Linguistics (ACL)

T2 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2013

Y2 - 9 June 2013 through 14 June 2013

ER -

Distant supervision for relation extraction with an incomplete knowledge base

Abstract

Publication series

Other

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this