TY - GEN
T1 - Findings of the AmericasNLP 2023 Shared Task on Machine Translation into Indigenous Languages
AU - Ebrahimi, Abteen
AU - Mager, Manuel
AU - Rijhwani, Shruti
AU - Rice, Enora
AU - Oncevay, Arturo
AU - Baltazar, Claudia Garcia
AU - Méndez Cortés, María Elena
AU - Montaño, Cynthia
AU - Ortega, John E.
AU - Coto-Solano, Rolando
AU - Cruz, Hilaria
AU - Palmer, Alexis
AU - Kann, Katharina
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - In this work, we present the results of the AmericasNLP 2023 Shared Task on Machine Translation into Indigenous Languages. This edition of the shared task features eleven language pairs, one of which – Chatino–Spanish – uses a newly collected evaluation dataset, consisting of professionally translated text from the legal domain. Seven teams participated in the shared task, with a total of 181 submissions. Additionally, we conduct a human evaluation of the best system outputs and compare them to the best submissions from the 2021 shared task. We find that this analysis agrees with the quantitative measure we use to rank submissions, ChrF, which itself shows an improvement of 9.64 points on average across all languages, compared to the prior winning system.
AB - In this work, we present the results of the AmericasNLP 2023 Shared Task on Machine Translation into Indigenous Languages. This edition of the shared task features eleven language pairs, one of which – Chatino–Spanish – uses a newly collected evaluation dataset, consisting of professionally translated text from the legal domain. Seven teams participated in the shared task, with a total of 181 submissions. Additionally, we conduct a human evaluation of the best system outputs and compare them to the best submissions from the 2021 shared task. We find that this analysis agrees with the quantitative measure we use to rank submissions, ChrF, which itself shows an improvement of 9.64 points on average across all languages, compared to the prior winning system.
UR - http://www.scopus.com/inward/record.url?scp=85175616115&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85175616115
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 206
EP - 219
BT - ACL 2023 - Proceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas, AmericasNLP 2023
A2 - Manuel, Mager
A2 - Ebrahimi, Abteen
A2 - Oncevay, Arturo
A2 - Rice, Enora
A2 - Rijhwani, Shruti
A2 - Palmer, Alexis
A2 - Kann, Katharina
PB - Association for Computational Linguistics (ACL)
T2 - 3rd Workshop on Natural Language Processing for Indigenous Languages of the Americas, AmericasNLP 2023, co-located with ACL 2023
Y2 - 14 July 2023
ER -