Peruvian Sign Language translator for people with hearing and/or communication disabilities using a convolutional neural network

Angel Briones-Cerquín, Johan Tumay Guevara, Ernesto Paiva-Peredo, Joel Palomino

Producción científica: Capítulo del libro/informe/acta de congresoContribución a la conferenciarevisión exhaustiva

Resumen

Promoting the social inclusion of people with deafness and/or communication disabilities is a priority for many countries. For this reason, considerable emphasis is currently being given to machine learning (ML) and deep learning (DL) techniques for sign language recognition and translation, as they can be a significant contribution to the social inclusion of the deaf and/or deafened community. Thus, the present research proposes the development of a translator of Peruvian Sign Language (PSL) for the recognition and translation of static signs belonging to PSL through a convolutional neural network (CNN). These signs are the numbers from 0 to 9 and the letters of the alphabet except J, Ñ and Z because they are represented with movable signs and the letters O and W because they are very similar to the numbers "0" and "6". To achieve the development of the translator, a balanced database for PSL was built from scratch, consisting of 700 images for each static sign, for a total of 22400 images. These images have a dimension of 80x80 pixels that go through a preprocessing stage, 3 convolutional layers, filters, kernels, ReLu and MaxPooling activation functions. Experimental results show that the translator recognizes static PSL signs with an accuracy of 90%, 86% and 81% for training, validation and testing respectively.

Idioma originalInglés
Título de la publicación alojadaProceedings of the 21st LACCEI International Multi-Conference for Engineering, Education and Technology
Subtítulo de la publicación alojadaLeadership in Education and Innovation in Engineering in the Framework of Global Transformations: Integration and Alliances for Integral Development, LACCEI 2023
EditoresMaria M. Larrondo Petrie, Jose Texier, Rodolfo Andres Rivas Matta
EditorialLatin American and Caribbean Consortium of Engineering Institutions
ISBN (versión digital)9786289520743
EstadoPublicada - 2023
Publicado de forma externa
Evento21st LACCEI International Multi-Conference for Engineering, Education and Technology, LACCEI 2023 - Buenos Aires, Argentina
Duración: 19 jul. 202321 jul. 2023

Serie de la publicación

NombreProceedings of the LACCEI international Multi-conference for Engineering, Education and Technology
Volumen2023-July
ISSN (versión digital)2414-6390

Conferencia

Conferencia21st LACCEI International Multi-Conference for Engineering, Education and Technology, LACCEI 2023
País/TerritorioArgentina
CiudadBuenos Aires
Período19/07/2321/07/23

Huella

Profundice en los temas de investigación de 'Peruvian Sign Language translator for people with hearing and/or communication disabilities using a convolutional neural network'. En conjunto forman una huella única.

Citar esto