Combination of arabic preprocessing schemes for statistical machine translation

Fatiha Sadat; Nizar Habash

Combination of arabic preprocessing schemes for statistical machine translation

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Statistical machine translation is quite robust when it comes to the choice of input representation. It only requires consistency between training and testing. As a result, there is a wide range of possible preprocessing choices for data used in statistical machine translation. This is even more so for morphologically rich languages such as Arabic. In this paper, we study the effect of different word-level preprocessing schemes for Arabic on the quality of phrase-based statistical machine translation. We also present and evaluate different methods for combining preprocessing schemes resulting in improved translation quality.

Original language	English (US)
Title of host publication	COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
Pages	1-8
Number of pages	8
State	Published - 2006
Event	21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, COLING/ACL 2006 - Sydney, NSW, Australia Duration: Jul 17 2006 → Jul 21 2006

Publication series

Name	COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
Volume	1

Other

Other	21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, COLING/ACL 2006
Country/Territory	Australia
City	Sydney, NSW
Period	7/17/06 → 7/21/06

ASJC Scopus subject areas

Language and Linguistics
Linguistics and Language

Cite this

Sadat, F., & Habash, N. (2006). Combination of arabic preprocessing schemes for statistical machine translation. In COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (pp. 1-8). (COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference; Vol. 1).

Combination of arabic preprocessing schemes for statistical machine translation. / Sadat, Fatiha; Habash, Nizar.
COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. 2006. p. 1-8 (COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference; Vol. 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sadat, F & Habash, N 2006, Combination of arabic preprocessing schemes for statistical machine translation. in COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, vol. 1, pp. 1-8, 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, COLING/ACL 2006, Sydney, NSW, Australia, 7/17/06.

Sadat F, Habash N. Combination of arabic preprocessing schemes for statistical machine translation. In COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. 2006. p. 1-8. (COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference).

Sadat, Fatiha ; Habash, Nizar. / Combination of arabic preprocessing schemes for statistical machine translation. COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. 2006. pp. 1-8 (COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference).

@inproceedings{2f151a1cd25346ae9292bffa1ed5c3a4,

title = "Combination of arabic preprocessing schemes for statistical machine translation",

abstract = "Statistical machine translation is quite robust when it comes to the choice of input representation. It only requires consistency between training and testing. As a result, there is a wide range of possible preprocessing choices for data used in statistical machine translation. This is even more so for morphologically rich languages such as Arabic. In this paper, we study the effect of different word-level preprocessing schemes for Arabic on the quality of phrase-based statistical machine translation. We also present and evaluate different methods for combining preprocessing schemes resulting in improved translation quality.",

author = "Fatiha Sadat and Nizar Habash",

year = "2006",

language = "English (US)",

isbn = "1932432655",

series = "COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference",

pages = "1--8",

booktitle = "COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference",

note = "21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, COLING/ACL 2006 ; Conference date: 17-07-2006 Through 21-07-2006",

}

TY - GEN

T1 - Combination of arabic preprocessing schemes for statistical machine translation

AU - Sadat, Fatiha

AU - Habash, Nizar

PY - 2006

Y1 - 2006

N2 - Statistical machine translation is quite robust when it comes to the choice of input representation. It only requires consistency between training and testing. As a result, there is a wide range of possible preprocessing choices for data used in statistical machine translation. This is even more so for morphologically rich languages such as Arabic. In this paper, we study the effect of different word-level preprocessing schemes for Arabic on the quality of phrase-based statistical machine translation. We also present and evaluate different methods for combining preprocessing schemes resulting in improved translation quality.

AB - Statistical machine translation is quite robust when it comes to the choice of input representation. It only requires consistency between training and testing. As a result, there is a wide range of possible preprocessing choices for data used in statistical machine translation. This is even more so for morphologically rich languages such as Arabic. In this paper, we study the effect of different word-level preprocessing schemes for Arabic on the quality of phrase-based statistical machine translation. We also present and evaluate different methods for combining preprocessing schemes resulting in improved translation quality.

UR - http://www.scopus.com/inward/record.url?scp=84860521060&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860521060&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84860521060

SN - 1932432655

SN - 9781932432657

T3 - COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

SP - 1

EP - 8

BT - COLING/ACL 2006 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

T2 - 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, COLING/ACL 2006

Y2 - 17 July 2006 through 21 July 2006

ER -

Combination of arabic preprocessing schemes for statistical machine translation

Abstract

Publication series

Other

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this