Can we beat Google Translate? (CROSBI ID 589722)
Prilog sa skupa u zborniku | izvorni znanstveni rad | međunarodna recenzija
Podaci o odgovornosti
Brkic, M. ; Mikulic, B.B. ; Matetic, M.
engleski
Can we beat Google Translate?
This paper presents a machine translation evaluation study for CroatianEnglish language pair. In-domain and out-of-domain translations from Croatian into English have been obtained from Google Translate, our own statistical machine translation system LegTran, and from a professional translator. These translations have been evaluated by six different automatic metrics. The gains obtained from increasing the number of reference translations have been explored and measured. System level correlation between automatic evaluation metrics is given and the significance of the results is discussed. Bootstrapping, approximate randomization and the sign test have been used for confidence intervals and hypothesis testing.
automatic evaluation; BLEU; F-measure; Google Translate; NIST; PER; reference set; SMT (statistical machine translation); TER; translation evaluation; WER
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
Podaci o prilogu
381-386.
2012.
objavljeno
Podaci o matičnoj publikaciji
Proceedings of the ITI 2012 34th Conf. on Information Technology Interfaces
Luzar-Stiffler, Vesna ; Jarec, Iva ; Bekic, Zoran
Zagreb: Sveučilišni računski centar Sveučilišta u Zagrebu (Srce)
978-953-7138-24-0
1330-1012
Podaci o skupu
Conf. on Information Technology Interfaces
predavanje
25.06.2012-28.06.2012
Cavtat, Hrvatska