ArTenTen: Arabic Corpus and Word Sketches

Tressy Arts; Yonatan Belinkov; Nizar Habash; Adam Kilgarriff; Vit Suchomel

doi:10.1016/j.jksuci.2014.06.009

ArTenTen: Arabic Corpus and Word Sketches

Tressy Arts, Yonatan Belinkov, Nizar Habash, Adam Kilgarriff, Vit Suchomel

Computer Science

Research output: Contribution to journal › Article › peer-review

Abstract

We present arTenTen, a web-crawled corpus of Arabic, gathered in 2012. arTenTen consists of 5.8-billion words. A chunk of it has been lemmatized and part-of-speech (POS) tagged with the MADA tool and subsequently loaded into Sketch Engine, a leading corpus query tool, where it is open for all to use. We have also created 'word sketches': one-page, automatic, corpus-derived summaries of a word's grammatical and collocational behavior. We use examples to demonstrate what the corpus can show us regarding Arabic words and phrases and how this can support lexicography and inform linguistic research. The article also presents the 'sketch grammar' (the basis for the word sketches) in detail, describes the process of building and processing the corpus, and considers the role of the corpus in additional research on Arabic.

Original language	English (US)
Pages (from-to)	357-371
Number of pages	15
Journal	Journal of King Saud University - Computer and Information Sciences
Volume	26
Issue number	4
DOIs	https://doi.org/10.1016/j.jksuci.2014.06.009
State	Published - 2014

Keywords

Arabic
Concordance
Corpora
Lexicography
Morphology

ASJC Scopus subject areas

General Computer Science

Access to Document

10.1016/j.jksuci.2014.06.009

Cite this

@article{82af99206e954dad9eba49d2f0d118d4,

title = "ArTenTen: Arabic Corpus and Word Sketches",

abstract = "We present arTenTen, a web-crawled corpus of Arabic, gathered in 2012. arTenTen consists of 5.8-billion words. A chunk of it has been lemmatized and part-of-speech (POS) tagged with the MADA tool and subsequently loaded into Sketch Engine, a leading corpus query tool, where it is open for all to use. We have also created 'word sketches': one-page, automatic, corpus-derived summaries of a word's grammatical and collocational behavior. We use examples to demonstrate what the corpus can show us regarding Arabic words and phrases and how this can support lexicography and inform linguistic research. The article also presents the 'sketch grammar' (the basis for the word sketches) in detail, describes the process of building and processing the corpus, and considers the role of the corpus in additional research on Arabic.",

keywords = "Arabic, Concordance, Corpora, Lexicography, Morphology",

author = "Tressy Arts and Yonatan Belinkov and Nizar Habash and Adam Kilgarriff and Vit Suchomel",

note = "Funding Information: This work was partly supported by the Ministry of Education of the Czech Republic within the LINDAT-Clarin project LM2010013 and by the Ministry of the Interior of the Czech Republic within the project VF20102014003. Nizar Habash performed most of his work on this article while he was at the Center for Computational Learning Systems at Columbia University. Publisher Copyright: {\textcopyright} 2014.",

year = "2014",

doi = "10.1016/j.jksuci.2014.06.009",

language = "English (US)",

volume = "26",

pages = "357--371",

journal = "Journal of King Saud University - Computer and Information Sciences",

issn = "1319-1578",

publisher = "King Saud bin Abdulaziz University",

number = "4",

}

TY - JOUR

T1 - ArTenTen

T2 - Arabic Corpus and Word Sketches

AU - Arts, Tressy

AU - Belinkov, Yonatan

AU - Habash, Nizar

AU - Kilgarriff, Adam

AU - Suchomel, Vit

N1 - Funding Information: This work was partly supported by the Ministry of Education of the Czech Republic within the LINDAT-Clarin project LM2010013 and by the Ministry of the Interior of the Czech Republic within the project VF20102014003. Nizar Habash performed most of his work on this article while he was at the Center for Computational Learning Systems at Columbia University. Publisher Copyright: © 2014.

PY - 2014

Y1 - 2014

N2 - We present arTenTen, a web-crawled corpus of Arabic, gathered in 2012. arTenTen consists of 5.8-billion words. A chunk of it has been lemmatized and part-of-speech (POS) tagged with the MADA tool and subsequently loaded into Sketch Engine, a leading corpus query tool, where it is open for all to use. We have also created 'word sketches': one-page, automatic, corpus-derived summaries of a word's grammatical and collocational behavior. We use examples to demonstrate what the corpus can show us regarding Arabic words and phrases and how this can support lexicography and inform linguistic research. The article also presents the 'sketch grammar' (the basis for the word sketches) in detail, describes the process of building and processing the corpus, and considers the role of the corpus in additional research on Arabic.

AB - We present arTenTen, a web-crawled corpus of Arabic, gathered in 2012. arTenTen consists of 5.8-billion words. A chunk of it has been lemmatized and part-of-speech (POS) tagged with the MADA tool and subsequently loaded into Sketch Engine, a leading corpus query tool, where it is open for all to use. We have also created 'word sketches': one-page, automatic, corpus-derived summaries of a word's grammatical and collocational behavior. We use examples to demonstrate what the corpus can show us regarding Arabic words and phrases and how this can support lexicography and inform linguistic research. The article also presents the 'sketch grammar' (the basis for the word sketches) in detail, describes the process of building and processing the corpus, and considers the role of the corpus in additional research on Arabic.

KW - Arabic

KW - Concordance

KW - Corpora

KW - Lexicography

KW - Morphology

UR - http://www.scopus.com/inward/record.url?scp=85006193533&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85006193533&partnerID=8YFLogxK

U2 - 10.1016/j.jksuci.2014.06.009

DO - 10.1016/j.jksuci.2014.06.009

M3 - Article

AN - SCOPUS:85006193533

SN - 1319-1578

VL - 26

SP - 357

EP - 371

JO - Journal of King Saud University - Computer and Information Sciences

JF - Journal of King Saud University - Computer and Information Sciences

IS - 4

ER -

ArTenTen: Arabic Corpus and Word Sketches

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this