My Final Project


For my Final Project I'm planing on doing a translator glove for deaf-mute individuals.


Research

Communication is very important for human interaction, relationship, learning and passing on information. However, there is a lack of it for deaf-mute individuals. Nowadays they can communicate with sign language but there is a barrier when interacting with people that don't understand sign language.

Tecnology offers a solution braking the barrier. A translator glove is a wearable device than can translate sign language to voice, using sensors, accelerometers and gyroscope. It can make deaf individuals engage more in the word, helping them in their day-to-day.

Previous Works

There are a lot of prototypes made by diferent colleges around the word, but all of them have all the wires exposed, programing board on top, etc. they can't be used for a real person.

There is only one company called: BrightSign that sells a glove that can translate in multiple languages. But isn't affordable for many users, it have a price of £2,041.

Brighy Sign Glove


Sketch Design

For making this tranlator glove it will be use two accelerometers/giroscope, one in the back of the hand and the other at the end of the index finger, this will help to know some basic movements and actiones. For the fingers it will be using flex sensors changing thier resistance when flexed. A lipo battery will be charged by a type-c connector. Having a switch On/Off and a Start/Stop sequence to start translating for user comfort. Rhe transmition will be send by BT to a speaker.

Sketch design for translator glove and speaker
For the material of the glove it has to be something comfortable, flexible and easy to wash so it will be defined later, having a better background of materials (nylon, spandex, neoprene). A unique characteristic of the glove is that the user has to be able to detach/attach some components for washing it.


Materials (First List)

Qty Description
2 Lipo Battery
2 BT Modules
2 Accelerometers/giroscopes
5 Flex Sensors
1 Switch On/Off
2 Charging Module Type-C
1 Speaker

Getting the materials


After doing some research I found that Seeed Studio has a lot of boards after looking most of them I found that the Xiao-nRF52840 sense is the best for my project.
    Benefits:
  • Bluetooth 5.0
  • Audio Recongnition
  • 6 axis IMU
  • Used for TinyML (gesture)
  • NFC
  • 6 analog pins


  • While runnging a code that prints acceleration, temperature and the gyroscope y get this values.

    Also I heven't work with flex sensors so getting a few test to know what values I recieve it's essential. I built the circuit using a XIAO a resistor and the flex sensor. Using a code I found I get some values.


    An interesting part I found was using Edge Impulse for gesture recongnition so I will be trying to learn more about it and see how can I implement it on the project.
    Now I have to synchronise 2 IMU (hand and finger) to get a relative position and set of 0's

    Mid-Term Review


    Schedule
    Activity
    Status
    Due Date
    Research
    Done
    28/01/2024
    Previous Works
    Done
    28/01/2024
    Sketch
    Done
    28/01/2024
    First materials
    Done
    17/02/2024
    Test materials (1)
    Done
    01/03/2024
    Get second materials
    Done
    22/03/2024
    Test materials (2)
    NO
    08/04/2024
    Make prototype glove
    NO
    15/04/2024
    Get data
    NO
    20/04/2024
    Make speaker
    NO
    30/04/2024
    Test speaker with audio
    NO
    30/04/2024
    Start to train model
    NO
    13/05/2024
    Power consumption
    NO
    05/05/2024
    Add power modules (glove/speaker)
    NO
    13/05/2024
    ¿Magnetic Components?
    NO
    15/04/2024
    Make PCB for speaker
    NO
    19/05/2024
    Make PCB for glove
    NO
    19/05/2024
    Make case for speaker
    NO
    20/05/2024
    Presentation
    NO
    01/06/2024