Lessons from Deploying the First Bilingual Peruvian Sign Language - Spanish Online Dictionary

Joe Huamani-Malca, Carlos Vasquez, Sabina Oporto, Francisco Cerna, César Ramos, Miguel Rodriguez-Mondoñedo, Gissella Bejarano

Producción científica: Capítulo del libro/informe/acta de congresoContribución a la conferenciarevisión exhaustiva

Resumen

Bilingual dictionaries present several challenges, especially for sign languages and oral languages, where multimodality plays a role. We deployed and tested the first bilingual Peruvian Sign Language (LSP) - Spanish Online Dictionary. The first feature allows the user to introduce a text and receive as a result a list of videos whose glosses are related to the input text or Spanish word. The second feature allows the user to sign in front of the camera and shows the five most probable Spanish translations based on the similarity between the input sign and gloss-labeled sign videos used to train a machine learning model. These features are constructed in a design and architecture that differentiates among the coincidence for the Spanish text searched, the sign gloss, and Spanish translation. We explain in depth how these concepts or database columns impact the search. Similarly, we share the challenges of deploying a real-world machine learning model for isolated sign language recognition through Amazon Web Services (AWS).

Idioma originalInglés
Título de la publicación alojada2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings
EditoresNicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
EditorialEuropean Language Resources Association (ELRA)
Páginas10316-10323
Número de páginas8
ISBN (versión digital)9782493814104
EstadoPublicada - 2024
EventoJoint 30th International Conference on Computational Linguistics and 14th International Conference on Language Resources and Evaluation, LREC-COLING 2024 - Hybrid, Torino, Italia
Duración: 20 may. 202425 may. 2024

Serie de la publicación

Nombre2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings

Conferencia

ConferenciaJoint 30th International Conference on Computational Linguistics and 14th International Conference on Language Resources and Evaluation, LREC-COLING 2024
País/TerritorioItalia
CiudadHybrid, Torino
Período20/05/2425/05/24

Huella

Profundice en los temas de investigación de 'Lessons from Deploying the First Bilingual Peruvian Sign Language - Spanish Online Dictionary'. En conjunto forman una huella única.

Citar esto