My Final Project
For my Final Project I'm planing on doing a translator glove for deaf-mute individuals.
Research
Communication is very important for human interaction, relationship, learning
and passing on information. However, there is a lack of it for deaf-mute individuals.
Nowadays they can communicate with sign language but there is a barrier when interacting
with people that don't understand sign language.
Tecnology offers a solution braking the barrier. A translator glove is a wearable device
than can translate sign language to voice, using sensors, accelerometers and gyroscope.
It can make deaf individuals engage more in the word, helping them in their day-to-day.
Previous Works
There are a lot of prototypes made by diferent colleges around the word, but all of them have all
the wires exposed, programing board on top, etc. they can't be used for a real person.
There is only one company called: BrightSign that sells a glove that can translate in multiple languages.
But isn't affordable for many users, it have a price of £2,041.
Brighy Sign Glove
Sketch Design
For making this tranlator glove it will be use two accelerometers/giroscope, one in the back of the hand
and the other at the end of the index finger, this will help to know some basic movements and actiones.
For the fingers it will be using flex sensors changing thier resistance when flexed. A lipo battery will
be charged by a type-c connector. Having a switch On/Off and a Start/Stop sequence to start translating
for user comfort. Rhe transmition will be send by BT to a speaker.
Sketch design for translator glove and speaker
For the material of the glove it has to be something comfortable, flexible and easy to wash so it will
be defined later, having a better background of materials (nylon, spandex, neoprene). A unique characteristic
of the glove is that the user has to be able to detach/attach some components for washing it.
Materials (First List)
Qty |
Description |
2 |
Lipo Battery |
2 |
BT Modules |
2 |
Accelerometers/giroscopes |
5 |
Flex Sensors |
1 |
Switch On/Off |
2 |
Charging Module Type-C |
1 |
Speaker |
Getting the materials
After doing some research I found that Seeed Studio has a lot of boards after looking most of them I found
that the Xiao-nRF52840 sense is the best for my project.
Bluetooth 5.0
Audio Recongnition
6 axis IMU
Used for TinyML (gesture)
NFC
6 analog pins
While runnging a code that prints acceleration, temperature and the gyroscope y get this values.
Also I heven't work with flex sensors so getting a few test to know what values I recieve it's essential. I built the circuit using a XIAO a resistor and
the flex sensor. Using a code I found I get some values.
An interesting part I found was using Edge Impulse for gesture recongnition so I will be trying to learn more about it and see how can I implement it on the
project.
Now I have to synchronise 2 IMU (hand and finger) to get a relative position and set of 0's
Mid-Term Review
Schedule
Previous Works
Done
28/01/2024
First materials
Done
17/02/2024
Test materials (1)
Done
01/03/2024
Get second materials
Done
22/03/2024
Test materials (2)
NO
08/04/2024
Make prototype glove
NO
15/04/2024
Make speaker
NO
30/04/2024
Test speaker with audio
NO
30/04/2024
Start to train model
NO
13/05/2024
Power consumption
NO
05/05/2024
Add power modules (glove/speaker)
NO
13/05/2024
¿Magnetic Components?
NO
15/04/2024
Make PCB for speaker
NO
19/05/2024
Make PCB for glove
NO
19/05/2024
Make case for speaker
NO
20/05/2024
Presentation
NO
01/06/2024