Learning to parse and translate improves neural machine translation

Akiko Eriguchi; Yoshimasa Tsuruoka; Kyunghyun Cho

doi:10.18653/v1/P17-2012

Learning to parse and translate improves neural machine translation

Akiko Eriguchi, Yoshimasa Tsuruoka, Kyunghyun Cho

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

There has been relatively little attention to incorporating linguistic prior to neural machine translation. Much of the previous work was further constrained to considering linguistic prior on the source side. In this paper, we propose a hybrid model, called NMT+RNNG, that learns to parse and translate by combining the recurrent neural network grammar into the attention-based neural machine translation. Our approach encourages the neural machine translation model to incorporate linguistic prior during training, and lets it translate on its own afterward. Extensive experiments with four language pairs show the effectiveness of the proposed NMT+RNNG.

Original language	English (US)
Title of host publication	ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers)
Publisher	Association for Computational Linguistics (ACL)
Pages	72-78
Number of pages	7
ISBN (Electronic)	9781945626760
DOIs	https://doi.org/10.18653/v1/P17-2012
State	Published - 2017
Event	55th Annual Meeting of the Association for Computational Linguistics, ACL 2017 - Vancouver, Canada Duration: Jul 30 2017 → Aug 4 2017

Publication series

Name	ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)
Volume	2

Other

Other	55th Annual Meeting of the Association for Computational Linguistics, ACL 2017
Country/Territory	Canada
City	Vancouver
Period	7/30/17 → 8/4/17

ASJC Scopus subject areas

Language and Linguistics
Artificial Intelligence
Software
Linguistics and Language

Access to Document

10.18653/v1/P17-2012

Cite this

Eriguchi, A., Tsuruoka, Y., & Cho, K. (2017). Learning to parse and translate improves neural machine translation. In ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers) (pp. 72-78). (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers); Vol. 2). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/P17-2012

Learning to parse and translate improves neural machine translation. / Eriguchi, Akiko; Tsuruoka, Yoshimasa; Cho, Kyunghyun.
ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers). Association for Computational Linguistics (ACL), 2017. p. 72-78 (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers); Vol. 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Eriguchi, A, Tsuruoka, Y & Cho, K 2017, Learning to parse and translate improves neural machine translation. in ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers). ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers), vol. 2, Association for Computational Linguistics (ACL), pp. 72-78, 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, 7/30/17. https://doi.org/10.18653/v1/P17-2012

Eriguchi A, Tsuruoka Y, Cho K. Learning to parse and translate improves neural machine translation. In ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers). Association for Computational Linguistics (ACL). 2017. p. 72-78. (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)). doi: 10.18653/v1/P17-2012

Eriguchi, Akiko ; Tsuruoka, Yoshimasa ; Cho, Kyunghyun. / Learning to parse and translate improves neural machine translation. ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers). Association for Computational Linguistics (ACL), 2017. pp. 72-78 (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)).

@inproceedings{b4b945629c514edcbe51b42a59481195,

title = "Learning to parse and translate improves neural machine translation",

abstract = "There has been relatively little attention to incorporating linguistic prior to neural machine translation. Much of the previous work was further constrained to considering linguistic prior on the source side. In this paper, we propose a hybrid model, called NMT+RNNG, that learns to parse and translate by combining the recurrent neural network grammar into the attention-based neural machine translation. Our approach encourages the neural machine translation model to incorporate linguistic prior during training, and lets it translate on its own afterward. Extensive experiments with four language pairs show the effectiveness of the proposed NMT+RNNG.",

author = "Akiko Eriguchi and Yoshimasa Tsuruoka and Kyunghyun Cho",

note = "Publisher Copyright: {\textcopyright} 2017 Association for Computational Linguistics.; 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017 ; Conference date: 30-07-2017 Through 04-08-2017",

year = "2017",

doi = "10.18653/v1/P17-2012",

language = "English (US)",

series = "ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)",

publisher = "Association for Computational Linguistics (ACL)",

pages = "72--78",

booktitle = "ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers)",

}

TY - GEN

T1 - Learning to parse and translate improves neural machine translation

AU - Eriguchi, Akiko

AU - Tsuruoka, Yoshimasa

AU - Cho, Kyunghyun

PY - 2017

Y1 - 2017

N2 - There has been relatively little attention to incorporating linguistic prior to neural machine translation. Much of the previous work was further constrained to considering linguistic prior on the source side. In this paper, we propose a hybrid model, called NMT+RNNG, that learns to parse and translate by combining the recurrent neural network grammar into the attention-based neural machine translation. Our approach encourages the neural machine translation model to incorporate linguistic prior during training, and lets it translate on its own afterward. Extensive experiments with four language pairs show the effectiveness of the proposed NMT+RNNG.

AB - There has been relatively little attention to incorporating linguistic prior to neural machine translation. Much of the previous work was further constrained to considering linguistic prior on the source side. In this paper, we propose a hybrid model, called NMT+RNNG, that learns to parse and translate by combining the recurrent neural network grammar into the attention-based neural machine translation. Our approach encourages the neural machine translation model to incorporate linguistic prior during training, and lets it translate on its own afterward. Extensive experiments with four language pairs show the effectiveness of the proposed NMT+RNNG.

UR - http://www.scopus.com/inward/record.url?scp=85040614869&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85040614869&partnerID=8YFLogxK

U2 - 10.18653/v1/P17-2012

DO - 10.18653/v1/P17-2012

M3 - Conference contribution

AN - SCOPUS:85040614869

T3 - ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)

SP - 72

EP - 78

BT - ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Short Papers)

PB - Association for Computational Linguistics (ACL)

T2 - 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017

Y2 - 30 July 2017 through 4 August 2017

ER -

Learning to parse and translate improves neural machine translation

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this