ITER: Improving Translation Edit Rate through Optimizable Edit Costs

Joybrata Panja, Sudip Kumar Naskar


Abstract
The paper presents our participation in the WMT 2018 Metrics Shared Task. We propose an improved version of Translation Edit/Error Rate (TER). In addition to including the basic edit operations in TER, namely - insertion, deletion, substitution and shift, our metric also allows stem matching, optimizable edit costs and better normalization so as to correlate better with human judgement scores. The proposed metric shows much higher correlation with human judgments than TER.
Anthology ID:
W18-6455
Volume:
Proceedings of the Third Conference on Machine Translation: Shared Task Papers
Month:
October
Year:
2018
Address:
Belgium, Brussels
Editors:
Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Christof Monz, Matteo Negri, Aurélie Névéol, Mariana Neves, Matt Post, Lucia Specia, Marco Turchi, Karin Verspoor
Venue:
WMT
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
746–750
Language:
URL:
https://aclanthology.org/W18-6455
DOI:
10.18653/v1/W18-6455
Bibkey:
Cite (ACL):
Joybrata Panja and Sudip Kumar Naskar. 2018. ITER: Improving Translation Edit Rate through Optimizable Edit Costs. In Proceedings of the Third Conference on Machine Translation: Shared Task Papers, pages 746–750, Belgium, Brussels. Association for Computational Linguistics.
Cite (Informal):
ITER: Improving Translation Edit Rate through Optimizable Edit Costs (Panja & Naskar, WMT 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-6455.pdf