Overview of the SPMRL 2013 shared task: Cross-framework evaluation of parsing morphologically rich languages

Djamé Seddah, Reut Tsarfaty, Sandra Kübler, Marie Candito, Jinho D. Choi, Richárd Farkas, Jennifer Foster, Iakes Goenaga, Koldo Gojenola, Yoav Goldberg, Spence Green, Nizar Habash, Marco Kuhlmann, Wolfgang Maier, Joakim Nivre, Adam Przepiórkowski, Ryan Roth, Wolfgang Seeker, Yannick Versley, Veronika VinczeMarcin Woliński, Alina Wróblewska, Eric Villemonte De La Clérgerie

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper reports on the first shared task on statistical parsing of morphologically rich languages (MRLs). The task features data sets from nine languages, each available both in constituency and dependency annotation. We report on the preparation of the data sets, on the proposed parsing scenarios, and on the evaluation metrics for parsing MRLs given different representation types. We present and analyze parsing results obtained by the task participants, and then provide an analysis and comparison of the parsers across languages and frameworks, reported for gold input as well as more realistic parsing scenarios.

Original languageEnglish (US)
Title of host publicationSPMRL 2013 - 4th Workshop on Statistical Parsing of Morphologically Rich Languages, Proceedings of the Workshop
PublisherAssociation for Computational Linguistics (ACL)
Pages146-182
Number of pages37
ISBN (Electronic)9781937284978
StatePublished - 2013
Event4th Workshop on Statistical Parsing of Morphologically Rich Languages, SPMRL 2013 - Seattle, United States
Duration: Oct 18 2013 → …

Publication series

NameSPMRL 2013 - 4th Workshop on Statistical Parsing of Morphologically Rich Languages, Proceedings of the Workshop

Other

Other4th Workshop on Statistical Parsing of Morphologically Rich Languages, SPMRL 2013
CountryUnited States
CitySeattle
Period10/18/13 → …

ASJC Scopus subject areas

  • Language and Linguistics
  • Computer Science Applications
  • Linguistics and Language

Fingerprint Dive into the research topics of 'Overview of the SPMRL 2013 shared task: Cross-framework evaluation of parsing morphologically rich languages'. Together they form a unique fingerprint.

  • Cite this

    Seddah, D., Tsarfaty, R., Kübler, S., Candito, M., Choi, J. D., Farkas, R., Foster, J., Goenaga, I., Gojenola, K., Goldberg, Y., Green, S., Habash, N., Kuhlmann, M., Maier, W., Nivre, J., Przepiórkowski, A., Roth, R., Seeker, W., Versley, Y., ... De La Clérgerie, E. V. (2013). Overview of the SPMRL 2013 shared task: Cross-framework evaluation of parsing morphologically rich languages. In SPMRL 2013 - 4th Workshop on Statistical Parsing of Morphologically Rich Languages, Proceedings of the Workshop (pp. 146-182). (SPMRL 2013 - 4th Workshop on Statistical Parsing of Morphologically Rich Languages, Proceedings of the Workshop). Association for Computational Linguistics (ACL).