A spelling correction corpus for multiple arabic dialects

Fadhl Eryani, Nizar Habash, Houda Bouamor, Salam Khalifa

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Arabic dialects are the non-standard varieties of Arabic commonly spoken - and increasingly written on social media - across the Arab world. Arabic dialects do not have standard orthographies, a challenge for natural language processing applications. In this paper, we present the MADAR CODA Corpus, a collection of 10,000 sentences from five Arabic city dialects (Beirut, Cairo, Doha, Rabat, and Tunis) represented in the Conventional Orthography for Dialectal Arabic (CODA) in parallel with their Raw original form. The sentences come from the Multi-Arabic Dialect Applications and Resources (MADAR) Project and are in parallel across the cities (2,000 sentences from each city). This publicly available resource is intended to support research on spelling correction and text normalization for Arabic dialects. We present results on a bootstrapping technique we use to speed up the CODA annotation, as well as on the degree of similarity across the dialects before and after CODA annotation.
Original languageEnglish (US)
Title of host publicationLREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings
PublisherEuropean Language Resources Association (ELRA)
Pages4130-4138
Number of pages9
ISBN (Print)9791095546344
StatePublished - 2020

Publication series

NameLREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings

Keywords

  • Conventional Orthography for Dialectal Arabic
  • Corpora
  • Dialects
  • Spelling Correction

Cite this