A Low-Resourced Peruvian Language Identification Model

Alexandra Espichán Linares, Arturo Oncevay-Marcos

Producción científica: Capítulo del libro/informe/acta de congresoContribución a la conferenciarevisión exhaustiva

Resumen

Due to the linguistic revitalization in Perú through the last years, there is a growing interest to reinforce the bilingual education in the country and to increase the research focused in its native languages. From the computer science perspective, one of the first steps to support the languages study is the implementation of an automatic language identification tool using machine learning methods. Therefore, this work focuses in two steps: (1) the building of a digital and annotated corpus for 16 Peruvian native languages extracted from documents in web repositories, and (2) the fit of a supervised learning model for the language identification task using features identified from related studies in the state of the art, such as n-grams. The obtained results were promising (97% in average precision), and it is expected to take advantage of the corpus and the model for more complex tasks in the future.
Idioma originalEspañol
Título de la publicación alojadaCEUR Workshop Proceedings
Páginas57-63
Número de páginas7
Volumen2029
EstadoPublicada - 1 ene. 2017

Citar esto