A Low-Resourced Peruvian Language Identification Model

Alexandra Espichán Linares, Arturo Oncevay-Marcos

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Due to the linguistic revitalization in Perú through the last years, there is a growing interest to reinforce the bilingual education in the country and to increase the research focused in its native languages. From the computer science perspective, one of the first steps to support the languages study is the implementation of an automatic language identification tool using machine learning methods. Therefore, this work focuses in two steps: (1) the building of a digital and annotated corpus for 16 Peruvian native languages extracted from documents in web repositories, and (2) the fit of a supervised learning model for the language identification task using features identified from related studies in the state of the art, such as n-grams. The obtained results were promising (97% in average precision), and it is expected to take advantage of the corpus and the model for more complex tasks in the future.
Original languageSpanish
Title of host publicationCEUR Workshop Proceedings
Pages57-63
Number of pages7
Volume2029
StatePublished - 1 Jan 2017

Cite this