CAMELMORPH MSA: A Large-Scale Open-Source Morphological Analyzer for Modern Standard Arabic

Christian Khairallah, Salam Khalifa, Reham Marzouk, Mayar Nassar, Nizar Habash

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present CAMELMORPH MSA, the largest open-source Modern Standard Arabic morphological analyzer and generator. CAMELMORPH MSA has over 100K lemmas, and includes rarely modeled morphological features of Modern Standard Arabic with Classical Arabic origins. CAMELMORPH MSA can produce ∼1.45B analyses and ∼535M unique diacritizations, almost an order of magnitude larger than SAMA (Maamouri et al., 2010c), in addition to having ∼36% less OOV rate than SAMA on a 10B word corpus. Furthermore, CAMELMORPH MSA fills the gaps of many lemma paradigms by modeling linguistic phenomena consistently. CAMELMORPH MSA seamlessly integrates with the Camel Tools Python toolkit (Obeid et al., 2020), ensuring ease of use and accessibility.

Original languageEnglish (US)
Title of host publication2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings
EditorsNicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
PublisherEuropean Language Resources Association (ELRA)
Pages2683-2691
Number of pages9
ISBN (Electronic)9782493814104
StatePublished - 2024
EventJoint 30th International Conference on Computational Linguistics and 14th International Conference on Language Resources and Evaluation, LREC-COLING 2024 - Hybrid, Torino, Italy
Duration: May 20 2024May 25 2024

Publication series

Name2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings

Conference

ConferenceJoint 30th International Conference on Computational Linguistics and 14th International Conference on Language Resources and Evaluation, LREC-COLING 2024
Country/TerritoryItaly
CityHybrid, Torino
Period5/20/245/25/24

Keywords

  • Arabic
  • Morphology
  • Open-Source

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computational Theory and Mathematics
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'CAMELMORPH MSA: A Large-Scale Open-Source Morphological Analyzer for Modern Standard Arabic'. Together they form a unique fingerprint.

Cite this