Ensenas Tool to Improve Communication
Udem Universidad de Monterrey
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ Ensenas Tool to Improve Communication ᱛᱮ Udem Universidad de Monterrey Ensenas is a digital tool created to improve communication between people with hearing disabilities and hearing people in Mexico. Ensenas uses a machine learning model that reads Mexican Sign Language in real time and translates words into written Spanish. The model was trained with a data set of 400 videos of common signs, labeled and analyzed frame by frame through pose estimation. A responsive website presents the project and offers the research, the model and the data set for free download. The aim is to reduce the communication gap.
A' Design Award ᱡᱤᱛᱠᱟᱹᱨ
Ensenas Tool to Improve Communication, ᱰᱤᱡᱟᱭᱤᱱᱟᱨ: Udem Universidad de Monterrey, ᱫᱚ A' ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ ᱢᱟᱱᱟᱨᱟᱝ ᱨᱮ ᱡᱤᱛᱠᱟᱹᱨ ᱠᱟᱱᱟ. Ensenas Tool to Improve Communication ᱫᱚ 2023 ᱨᱮ A' Design Award ᱧᱟᱢ ᱠᱮᱫᱟ ᱟᱨ Awarded Design ᱨᱮ ᱮᱴᱟᱜ ᱟᱥᱟᱫᱷᱟᱨᱚᱬ ᱰᱤᱡᱟᱭᱤᱱᱠᱚ ᱥᱟᱶ ᱩᱫᱩᱵ ᱟᱠᱟᱱᱟ. ᱯᱨᱚᱠᱚᱞᱯᱚ ᱨᱮᱭᱟᱜ ᱯᱩᱨᱟᱹ ᱵᱤᱵᱨᱚᱬ ᱧᱮᱞ ᱢᱮ, Udem Universidad de Monterrey ᱨᱮᱭᱟᱜ ᱮᱴᱟᱜ ᱠᱟᱹᱢᱤᱠᱚ ᱧᱮᱞ ᱢᱮ ᱟᱨ ᱵᱟᱰᱟᱭ ᱢᱮ ᱪᱮᱫᱟᱜ Ensenas Tool to Improve Communication ᱰᱤᱡᱟᱭᱤᱱ ᱫᱚ ᱟᱡᱟᱜ ᱯᱨᱚᱛᱤᱡᱳᱜᱤᱠᱚ ᱠᱷᱚᱱ ᱟᱞᱟᱜ ᱧᱮᱞᱚᱜᱟ.
Ensenas ᱵᱟᱵᱚᱛ
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ Ensenas Tool to Improve Communication ᱛᱮ Udem Universidad de Monterrey Ensenas is a digital tool created to improve communication between people with hearing disabilities and hearing people in Mexico. Ensenas uses a machine learning model that reads Mexican Sign Language in real time and translates words into written Spanish. The model was trained with a data set of 400 videos of common signs, labeled and analyzed frame by frame through pose estimation. A responsive website presents the project and offers the research, the model and the data set for free download. The aim is to reduce the communication gap. Ensenas ᱫᱚ ᱢᱮᱲᱦᱮᱫ ᱛᱷᱟᱠ ᱨᱮ A' Design Award ᱧᱟᱢ ᱠᱮᱫᱟ, ᱱᱚᱶᱟ ᱫᱚ A' Design Award & Competition ᱨᱮ ᱢᱤᱫ ᱢᱟᱱᱚᱛᱟᱱ ᱥᱤᱨᱯᱷᱟ ᱠᱟᱱᱟ. ᱢᱮᱲᱦᱮᱫ ᱛᱷᱟᱠ ᱨᱮᱭᱟᱜ ᱰᱤᱡᱟᱭᱤᱱᱠᱚ ᱫᱚ ᱯᱚᱠᱛᱟ ᱵᱤᱪᱟᱹᱨ ᱟᱨ ᱯᱮᱥᱟᱫᱟᱨ ᱰᱤᱡᱟᱭᱤᱱ ᱩᱫᱩᱵᱟ. ᱢᱟᱨᱟᱝ ᱵᱤᱪᱟᱹᱨᱤᱭᱟᱹ ᱫᱚᱞ ᱫᱚ ᱱᱭᱟᱭᱯᱩᱨᱱᱚ, ᱱᱭᱟᱭᱥᱚᱝᱜᱚᱛ, ᱜᱩᱱ ᱟᱫᱷᱟᱨᱤᱛ ᱟᱨ ᱯᱚᱠᱠᱷᱚᱯᱟᱛ ᱵᱮᱜᱚᱨ ᱥᱮᱪᱮᱫᱤᱭᱟᱹ ᱧᱮᱞᱵᱤᱰᱟᱹᱣ ᱛᱟᱭᱚᱢ, ᱥᱤᱨᱯᱷᱟ ᱧᱟᱢ ᱠᱟᱹᱢᱤᱠᱚ ᱥᱟᱶ ᱪᱷᱟᱯᱟ ᱞᱟᱹᱜᱤᱫ ᱵᱟᱪᱷᱟᱣᱟᱭ. ᱱᱚᱶᱟ ᱨᱮ ᱧᱩᱛᱩᱢ ᱚᱞ ᱰᱤᱡᱟᱭᱤᱱᱠᱚ ᱫᱚ ᱢᱟᱲᱟᱝ ᱠᱷᱚᱱ ᱛᱷᱤᱨ ᱟᱨ ᱥᱟᱱᱟᱢ ᱠᱚ ᱞᱟᱹᱜᱤᱫ ᱯᱟᱱᱛᱮ ᱢᱩᱞᱭᱟᱹᱝᱠᱚᱱ ᱢᱟᱱᱚᱠ ᱨᱮ, ᱩᱠᱩ ᱧᱩᱛᱩᱢ ᱛᱮ ᱥᱟᱱᱟᱢᱟᱱ ᱯᱮᱥᱟᱫᱟᱨ ᱧᱮᱞᱵᱤᱰᱟᱹᱣ ᱦᱚᱨᱟ ᱯᱟᱸᱡᱟ ᱠᱟᱛᱮ ᱵᱷᱳᱴ ᱧᱟᱢᱟ.
Udem Universidad de Monterrey ᱨᱮᱭᱟᱜ ᱟᱨᱦᱚᱸ ᱰᱤᱡᱟᱭᱤᱱ
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ ᱛᱷᱟᱠ ᱨᱮ ᱟᱨᱦᱚᱸ
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ Love Letters Calendar ᱛᱮ Yefan Liu and Zilan Zhou
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ Mind Without Borders App for Children ᱛᱮ Chien-Chen Lai
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ Voice Mask Device That Mutes Your Voice ᱛᱮ Kunihiko Sato
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ Pocket Spaces Social Playbook ᱛᱮ Pak Hei Wang
ᱥᱟᱢᱟᱡᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ X-Space Window ᱛᱮ Du Heli
ᱛᱮᱦᱮᱧᱟᱜ ᱥᱮᱨᱮᱥ ᱰᱤᱡᱟᱭᱤᱱ
ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱡᱟᱣ ᱢᱟᱹᱦᱤᱛ A' Design Award ᱫᱚ ᱢᱩᱞ ᱟᱨ ᱱᱟᱶᱟ ᱥᱚᱪ ᱛᱮ ᱰᱤᱡᱟᱭᱤᱱ, ᱛᱮᱭᱟᱨ ᱡᱤᱱᱤᱥ, ᱯᱨᱚᱠᱚᱞᱯᱚ ᱟᱨ ᱥᱛᱷᱟᱯᱚᱛᱭᱚ ᱥᱤᱨᱡᱟᱹᱣᱤᱡ ᱢᱤᱫ ᱟᱹᱰᱤ ᱦᱩᱱᱟᱹᱨᱟᱱ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱫᱚ ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱞᱮᱠᱟᱭ ᱩᱫᱩᱵᱟ. ᱛᱮᱦᱮᱧ ᱟᱞᱮ ᱠᱩᱥᱤ ᱛᱮ ᱚᱛᱱᱚᱜᱽ ᱨᱮᱱ ᱥᱮᱨᱮᱥ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱠᱚ ᱢᱩᱫ ᱨᱮ ᱢᱤᱫ ᱦᱚᱲ ᱟᱢ ᱥᱟᱢᱟᱝ ᱟᱹᱜᱩ ᱠᱟᱱᱟᱞᱮ, ᱚᱠᱚᱭᱟᱜ ᱰᱤᱡᱟᱭᱤᱱᱠᱚ ᱟᱵᱚᱣᱟᱜ ᱚᱛᱱᱚᱜᱽ ᱟᱹᱭᱠᱟᱹᱣ ᱦᱚᱨᱟ ᱛᱮᱭᱟᱨᱟ.
ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱥᱟᱠᱷᱭᱟᱛᱠᱟᱨ ᱰᱤᱡᱟᱭᱤᱱ ᱠᱷᱚᱵᱚᱨᱤᱭᱟᱹ ᱟᱨ ᱚᱛᱱᱚᱜᱽ ᱡᱚᱲᱟ ᱧᱩᱛᱩᱢᱟᱱ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ, ᱥᱛᱷᱚᱯᱚᱛᱤ ᱟᱨ ᱵᱨᱟᱱᱰ ᱵᱮᱵᱚᱥᱛᱷᱟᱯᱚᱠ ᱠᱚ ᱛᱟᱞᱟ ᱨᱮ ᱰᱤᱡᱟᱭᱤᱱ, ᱥᱤᱨᱡᱚᱱ ᱫᱟᱲᱮ, ᱛᱚᱠᱱᱤᱠ ᱟᱨ ᱱᱟᱶᱟ ᱥᱤᱨᱡᱚᱱ ᱵᱟᱵᱚᱛ ᱱᱟᱶᱟ ᱥᱟᱠᱷᱭᱟᱛᱠᱟᱨ ᱟᱨ ᱜᱟᱞᱢᱟᱨᱟᱣ ᱯᱟᱲᱦᱟᱣ ᱢᱮ. A' Design Award ᱡᱤᱛᱠᱟᱹᱨ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱟᱨ ᱵᱨᱟᱱᱰᱠᱚ ᱪᱮᱞᱮᱠᱟ ᱵᱤᱥᱤᱥᱴᱚ ᱥᱮᱨᱮᱥ ᱰᱤᱡᱟᱭᱤᱱ ᱠᱚ ᱟᱹᱜᱩᱭᱟ, ᱚᱱᱟ ᱵᱟᱰᱟᱭ ᱢᱮ.
ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱚᱞ ᱡᱟᱣ ᱢᱟᱹᱦᱤᱛ A' Design Award ᱫᱚ ᱢᱤᱫ ᱵᱤᱥᱤᱥᱴᱚ, ᱥᱤᱨᱯᱷᱟ ᱧᱟᱢ, ᱱᱟᱶᱟ ᱥᱤᱨᱡᱚᱱᱤᱭᱟᱹ ᱟᱨ ᱥᱤᱨᱡᱚᱱ ᱫᱟᱲᱮᱟᱱ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱚᱞ ᱫᱚ ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱚᱞ ᱞᱮᱠᱟᱭ ᱩᱫᱩᱵᱟ. ᱜᱚᱴᱟ ᱚᱛᱱᱚᱜᱽ ᱨᱮᱭᱟᱜ ᱥᱮᱨᱮᱥ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱚᱞ ᱠᱚᱣᱟᱜ ᱟᱹᱰᱤ ᱢᱩᱞ ᱟᱨ ᱥᱤᱨᱡᱚᱱ ᱫᱟᱲᱮᱟᱱ ᱥᱛᱷᱟᱯᱚᱛᱭᱚ, ᱱᱟᱯᱟᱭ ᱰᱤᱡᱟᱭᱤᱱ, ᱯᱷᱮᱥᱚᱱ, ᱜᱽᱨᱟᱯᱷᱤᱠ ᱰᱤᱡᱟᱭᱤᱱ ᱟᱨ ᱰᱤᱡᱟᱭᱤᱱ ᱠᱚᱣᱥᱚᱞ ᱯᱨᱚᱠᱚᱞᱯᱚᱠᱚ ᱧᱮᱞ ᱢᱮ.
ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱠᱤᱸᱣᱫᱚᱱᱛᱤ A' Design Award & Competition ᱦᱚᱛᱮᱛᱮ ᱵᱟᱪᱷᱟᱣ ᱟᱠᱟᱱ ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱠᱤᱸᱣᱫᱚᱱᱛᱤ ᱫᱚ ᱚᱱᱠᱚ ᱠᱤᱸᱣᱫᱚᱱᱛᱤ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱥᱟᱢᱟᱝ ᱟᱹᱜᱩᱭᱟ, ᱚᱠᱚᱭᱠᱚ ᱟᱠᱚᱣᱟᱜ ᱥᱮᱨᱮᱥ ᱛᱮᱭᱟᱨ ᱡᱤᱱᱤᱥ ᱟᱨ ᱯᱨᱚᱠᱚᱞᱯᱚ ᱛᱮ ᱥᱟᱶᱛᱟ ᱨᱮᱭᱟᱜ ᱦᱤᱛ ᱟᱨ ᱞᱟᱦᱟᱱᱛᱤ ᱠᱚ ᱟᱹᱜᱩᱭᱟ ᱟᱨ ᱟᱵᱚᱣᱟᱜ ᱚᱛᱱᱚᱜᱽ ᱟᱨᱦᱚᱸ ᱱᱟᱯᱟᱭ ᱠᱚ ᱵᱮᱱᱟᱣᱟ. ᱵᱤᱥᱣᱚᱥᱛᱚᱨᱤᱭ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ, ᱧᱩᱛᱩᱢᱟᱱ ᱥᱛᱷᱚᱯᱚᱛᱤ ᱟᱨ ᱱᱟᱶᱟ ᱥᱤᱨᱡᱚᱱᱤᱭᱟᱹ ᱠᱚᱣᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱯᱚᱴᱯᱷᱚᱞᱤᱭᱳ ᱧᱮᱞ ᱢᱮ.
ᱛᱮᱦᱮᱧᱟᱜ ᱵᱤᱥᱮᱥ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱡᱟᱣ ᱢᱟᱹᱦᱤᱛ A' Design Award & Competition ᱫᱚ ᱢᱤᱫ ᱥᱟᱹᱨᱤ ᱟᱥᱟᱫᱷᱟᱨᱚᱬ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ, ᱧᱩᱛᱩᱢᱟᱱ ᱥᱛᱷᱚᱯᱚᱛᱤ, ᱥᱤᱨᱡᱚᱱᱟᱱ ᱟᱜᱩᱣᱟᱹ ᱥᱮ ᱱᱟᱶᱟ ᱥᱤᱨᱡᱚᱱᱤᱭᱟᱹ ᱫᱚ ᱛᱮᱦᱮᱧᱟᱜ ᱵᱤᱥᱮᱥ ᱰᱤᱡᱟᱭᱤᱱᱟᱨ ᱞᱮᱠᱟᱭ ᱥᱟᱢᱟᱝ ᱟᱹᱜᱩᱭᱟ. ᱟᱡᱟᱜ ᱠᱟᱹᱢᱤᱠᱚ ᱫᱚ ᱜᱩᱱ ᱟᱫᱷᱟᱨ ᱛᱮ ᱱᱟᱯᱟᱭ ᱰᱤᱡᱟᱭᱤᱱ ᱨᱮᱭᱟᱜ ᱵᱤᱥᱤᱥᱴᱚ ᱫᱟᱹᱭᱠᱟᱹ ᱞᱮᱠᱟ ᱵᱟᱪᱷᱟᱣ ᱟᱠᱟᱱᱟ. ᱥᱤᱨᱯᱷᱟ ᱧᱟᱢ ᱰᱤᱡᱟᱭᱤᱱ ᱯᱚᱴᱯᱷᱚᱞᱤᱭᱳ ᱧᱮᱞ ᱢᱮ.
ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱵᱤᱪᱟᱹᱨ ᱡᱟᱣ ᱢᱟᱹᱦᱤᱛ A' Design Award & Competition ᱫᱚ ᱢᱩᱞ ᱥᱚᱪ ᱟᱨ ᱵᱮᱵᱷᱟᱨᱡᱚᱜᱽ ᱥᱚᱢᱟᱫᱷᱟᱱ ᱩᱫᱩᱜᱤᱡ ᱢᱤᱫ ᱟᱹᱰᱤ ᱱᱟᱶᱟ ᱥᱚᱪᱟᱱ ᱰᱤᱡᱟᱭᱤᱱ ᱵᱤᱪᱟᱹᱨ ᱥᱮ ᱥᱤᱨᱡᱚᱱᱟᱱ ᱫᱷᱟᱨᱚᱱᱟ ᱫᱚ ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱵᱤᱪᱟᱹᱨ ᱞᱮᱠᱟᱭ ᱩᱫᱩᱵᱟ. ᱜᱚᱴᱟ ᱚᱛᱱᱚᱜᱽ ᱨᱮᱭᱟᱜ ᱟᱠᱫᱟᱱᱫᱟ ᱥᱤᱨᱯᱷᱟ ᱧᱟᱢ ᱫᱷᱟᱨᱚᱱᱟ, ᱱᱟᱶᱟ ᱦᱚᱨᱟ ᱟᱨ ᱯᱨᱮᱨᱚᱬᱟᱫᱟᱭᱚᱠ ᱱᱟᱡᱟᱨᱠᱚ ᱧᱮᱞ ᱢᱮ.
ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱵᱨᱟᱱᱰ ᱡᱟᱣ ᱢᱟᱹᱦᱤᱛ A' Design Award & Competition ᱫᱚ ᱢᱤᱫ ᱵᱤᱥᱤᱥᱴᱚ ᱰᱤᱡᱟᱭᱤᱱ ᱠᱮᱱᱫᱽᱨᱤᱠ ᱵᱨᱟᱱᱰ ᱫᱚ ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱵᱨᱟᱱᱰ ᱞᱮᱠᱟᱭ ᱩᱫᱩᱵᱟ. ᱱᱚᱶᱟ ᱨᱮ ᱱᱟᱶᱟ ᱥᱤᱨᱡᱚᱱᱤᱭᱟᱹ ᱩᱫᱽᱫᱚᱜᱽ ᱟᱨ ᱜᱟᱶᱛᱟ ᱠᱚᱣᱟᱜ ᱪᱤᱱᱦᱟᱹ, ᱥᱤᱨᱡᱚᱱᱟᱱ ᱱᱟᱡᱟᱨ, ᱛᱮᱭᱟᱨ ᱡᱤᱱᱤᱥ ᱟᱨ ᱠᱚᱨᱯᱚᱨᱮᱴ ᱯᱨᱚᱠᱚᱞᱯᱚᱠᱚ ᱩᱯᱨᱩᱢᱚᱜᱟ. ᱥᱤᱨᱯᱷᱟ ᱧᱟᱢ ᱵᱨᱟᱱᱰ ᱟᱨ ᱟᱠᱚᱣᱟᱜ ᱢᱟᱨᱟᱝ ᱰᱤᱡᱟᱭᱤᱱᱠᱚ ᱧᱮᱞ ᱢᱮ.
ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱷᱟᱨᱟ ᱡᱟᱣ ᱢᱟᱹᱦᱤᱛ A' Design Award & Competition ᱫᱚ ᱢᱤᱫ ᱢᱩᱞ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱷᱟᱨᱟ ᱫᱚ ᱛᱮᱦᱮᱧᱟᱜ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱷᱟᱨᱟ ᱞᱮᱠᱟᱭ ᱩᱯᱨᱩᱢᱟ. ᱱᱚᱶᱟ ᱨᱮ ᱥᱛᱷᱟᱯᱚᱛᱭᱚ, ᱯᱷᱮᱥᱚᱱ, ᱪᱤᱛᱟᱹᱨ, ᱜᱽᱨᱟᱯᱷᱤᱠᱥ, ᱛᱮᱭᱟᱨ ᱡᱤᱱᱤᱥ ᱟᱨ ᱟᱨᱦᱚᱸ ᱟᱭᱢᱟ ᱛᱷᱟᱠ ᱨᱮ ᱩᱫᱚᱜ ᱠᱟᱱ ᱥᱮᱭᱞᱤ, ᱵᱚᱫᱚᱞᱚᱜ ᱠᱟᱱ ᱥᱩᱱᱫᱚᱨ ᱵᱩᱡᱷ ᱟᱨ ᱱᱟᱶᱟ ᱥᱤᱨᱡᱚᱱᱟᱱ ᱱᱟᱠᱷᱟᱠᱚ ᱩᱫᱩᱵᱚᱜᱟ. ᱛᱮᱦᱮᱧ ᱜᱮ ᱱᱟᱶᱟ ᱰᱤᱡᱟᱭᱤᱱ ᱫᱷᱟᱨᱟᱠᱚ ᱵᱟᱰᱟᱭ ᱢᱮ.
ᱟᱢ ᱴᱷᱮᱱ ᱥᱤᱨᱯᱷᱟ ᱧᱟᱢ ᱰᱤᱡᱟᱭᱤᱱ ᱢᱮᱱᱟᱜᱟ?
Awarded Design ᱨᱮ ᱟᱢᱟᱜ ᱠᱟᱹᱢᱤ ᱩᱫᱩᱵ ᱛᱮ ᱟᱞᱮ ᱟᱹᱰᱤ ᱠᱩᱥᱤᱭᱟᱹᱞᱮ.
ᱠᱟᱹᱢᱤ ᱡᱚᱢᱟ ᱢᱮ