Ensenas Qalab Isgaarsiin oo uu sameeyey Saeli Seira Saenz and Alana Betanzo Carriles

Naqshadda Ensenas Qalab Isgaarsiin oo uu sameeyey Saeli Seira Saenz and Alana Betanzo Carriles waa mid aad u sharaf badan oo ku guulaysatay tartanka qaybta Naqshadeynta Bulshada ee 2023 Abaalmarinta Birta ah ee A' Design Award.

BirBulshada· 2023

Ensenas Qalab Isgaarsiin

Saeli Seira Saenz and Alana Betanzo Carriles uu sameeyay

Macmiilka: Universidad de Monterrey

Ku Guuleystaha Abaalmarinta Birta ah ee A' Design Award ee Qaybta Bulshada

35,348

Ku Guuleystaha Abaalmarinta La Xaqiijiyey

Xaqiiji Xaaladda Abaalmarinta #149366

Booqo Bogga Ka Eeg A' Design Award War-saxaafadeed Calaamadda Abaalmarinta

Midabada

Naqshadeynta

Wax ku saabsan Ensenas Qalab Isgaarsiin

Ensenas waa qalab dhijitaal ah oo loo abuuray si loo hagaajiyo isgaarsiinta ka dhexeysa dadka naafada maqalka qaba iyo dadka maqalka wax ku maqla ee dalka Mexico. Ensenas waxay isticmaashaa qaab-dhismeedka barashada mishiinka (machine learning) kaas oo akhriya Luuqadda Calaamadaha ee Mexico waqti dhabta ah, kadibna u tarjuma ereyada Isbaanish qoran. Qaab-dhismeedkan waxaa lagu tababaray xog-ururin ka kooban 400 muuqaal oo ka kooban calaamado caadi ah, oo la calaamadeeyay oo la falanqeeyay jajab-jajab ahaan iyadoo la adeegsanayo qiyaasta jidhka (pose estimation). Bogga internetka ee la habeeyay (responsive website) ayaa soo bandhigaya mashruuca, wuxuuna bilaash u soo bandhigayaa cilmi-baarista, qaab-dhismeedka, iyo xog-ururinta si loo soo dejiyo. Ujeedadu waa in la yareeyo farqiga isgaarsiinta.

Aqoonsiga

Wax ku saabsan Abaalmarinta Birta ah ee A' Design Award

Ensenas Qalab Isgaarsiin waa guuleystaha Abaalmarinta Birta ah ee A' Design Award, aqoonsi sharaf leh oo la siiyo naqshado wanaagsan oo buuxiya shuruudaha xirfadeed iyo kuwa warshadeed ee laga filayo hal-abuurro si wanaagsan loo naqshadeeyay. Guuleystayaasha Birta waxay muujiyaan xirfad weyn, takhasus sare, fahan khabiir iyo awood hal-abuur oo abuurayaashooda. Ensenas Qalab Isgaarsiin waa hal-abuur la filayo inuu noqdo mid aad loo tixgeliyo, la ixtiraamo oo la jecel yahay, wax ku ool ah oo cusub. Naqshadahan ku guuleystay Abaalmarinta Birta ah ee A' Design Award wuxuu isku daraa hab-dhaqannada ugu wanaagsan warshadda wuxuuna leeyahay sifooyin farsamo oo karti leh oo ku xiran aqoon iyo hibo. Dhammaystirkeeda awgeed, Ensenas Qalab Isgaarsiin waa mudan ixtiraam, waxaana loo naqshadeeyay inay keento hagaajin nololeed oo ka caawisa in adduunka laga dhigo meel ka wanaagsan.

Gadaasha Naqshadeynta

Xirmada Warbaahinta

Shahaadooyinka, xubnaha kooxda iyo faahfaahinta farsamada ee uu bixiyay naqshadeeluhu.

Sifooyinka Gaarka ah: Likewise, thanks to technology and current tools, we were able to generate a Machine Learning model or tool which makes a real time reading of the Mexican Sign Language; where it is possible to solve the communication gap between people with hearing disabilities and people without such disability; avoiding that people make the effort to learn the Mexican Sign Language.
Cabbirka & Qaabaynta: This is a model in a website, whit a responsive design.
Summado: IA, Machine Learning, LSM, Data base, Service Design, education and tools, Sign Language,
Tiknoloojiyada Soo Saarka: We developed a model and data set of machine learning in order to create new tools and opportunities for people with hearing disabilities and make their lives easier through it. We created a platform in which anyone can learn more about the project and download the machine learning model.
Caqabadda Naqshadda: The first step in creating this project was the creation of a data set consisting of a collection of 400 videos of the most used words in the Mexican sign language. These were ordered by categorize and label individually.
The next step was the pose prediction process, in which the model analyzes the content of the data set analyzing frame by frame by means of ML pipe pose Estimation.
At the end of this estimation, our supervised learning model is able to detect patterns in the poses without the need for human intervention in order to identify which words, letters, numbers and phrases they belong to. To complete this process, a manual selection of frames was also performed in order to achieve a more accurate prediction of the signals.

In order to open this project to the public, a digital platform was created in which it is possible to freely download our research, the LSM recognition model, the data set generated so that other developers, technology companies, educational institutions can take advantage of our project and can create more inclusion tools for the non-hearing community.
Cilmi-baadhis: It is estimated that 5% of the world population, being 430 million people, will suffer a loss of disabling audio and in Mexico there are limited resources and tools to create an environment where everyone feels heard.
Following a design process, we conducted a series of interviews with experts, case studies and surveys to understand the perception of hearing impairment. We found that one of the limitations for the use of sign language is the learning curve.

We also found that some basic tasks for people with this disability can be more complicated than normal, which limits their independence. That's why we wanted to find a solution
inclusion to this problem.

This is Enseñas, an initiative that seeks inclusion through a digital tool made by through a machine learning model (LSM Model) with the purpose of creating a new way of
communication that facilitates the interaction between people with hearing disabilities and hearing people in real times. This model will be able to translate words from the Mexican sign language into Spanish written and vice versa in real time.
Dhiirrigelinta: The lack of education and tools about Mexican Sign Language to improve the communication and experience of hearing impaired people in Mexico, has led us to create awareness and promote the inclusion of this problem through a digital platform.
Muddada Mashruuca: 6 months on Universidad de Montery and Monterrey City in México
Xubnaha Kooxda: Saeli Seira Sáenz
Alana Betanzo Carriles