Glove that translates sign language into speech

The problem

A deaf person is fluent in sign language while most people aren't, so even in the simplest situations — a pharmacy, a government office, a hospital — they need an interpreter or pen and paper. The problem isn't the deaf person but the lack of a means of communication that connects both sides.

How it works

1. ReadingA flex sensor on each finger reads how much it bends.
2. SmoothingA moving average removes jitter from the readings.
3. MatchingThe finger positions are matched against stored signs.
4. PronunciationThe sign is sent over Bluetooth to the app, which speaks it aloud.

Project features

• Hand movement becomes audible speech instantly, without the other person learning anything.
• It supports the reverse direction: the other person types their message and the deaf person reads it in the same app.
• Smoothing the readings with a moving average; without it the sensors give jittery readings and signs get confused.
• An expandable sign library: a new word is added by recording its hand position.

Expected challenges

These are the main obstacles to expect during the build, laid out clearly so you know them before you start.

• ⚠ Ready-made flex sensors aren't available from us, their quality varies even when available, and many teams have made their own.
• Similar signs get confused; the fix is fewer signs, not more sensors.
• The glove must be comfortable or the user won't wear it, and the wires and enclosure decide that.
• Sign language includes facial expressions and arm movement, while the glove only reads the fingers.

The consultation gives you a solution for each one.