A communication bridge between deaf and blind people
Deaf people communicate in sign language and blind people rely on hearing, with no direct way to talk to each other. The system translates signs into text and speaks it for the blind person, and turns the blind person's speech into text with a visual sign for the deaf person, closing the loop.
The problem
Communication between a deaf person and a blind person is nearly impossible without a human intermediary, since one can't hear and the other can't see. All available solutions serve only one group, so they only solve half the problem.
How it works
- CaptureThe camera films the hands, and the system extracts the joint points.
- ClassificationThe sequence of movements is classified as a word or a letter.
- PronunciationThe text is converted into audible speech for the blind person.
- Reverse directionThe blind person's speech is converted into text shown to the deaf person with the matching sign.
Project features
- A complete two-way path, not one-way translation.
- It works with Arabic sign language, not American — a real gap.
- Instant feedback confirms to the user that the system understood correctly before sending.
- It works with a regular camera, with no glove or sensors on the hand.
Parts
All the parts you need in one place. Remove what you already have, and swap parts to fit your budget.
Prices are estimates and may change. Parts marked “other supplier” are ordered outside our main store.
Expected challenges
These are the main obstacles to expect during the build, laid out clearly so you know them before you start.
- Sign language includes facial expressions and body movement, not just hand movement; oversimplifying loses meaning.
- Arabic sign language datasets are scarce, and a custom dataset usually has to be built.
- Signing is continuous, not discrete; detecting where a word begins and ends is a problem in itself.
- Latency disrupts the conversation: the experience becomes tiring if it exceeds one second.
The consultation gives you a solution for each one.
Similar projects
Projects close to this one in idea or parts. Check the differences before deciding, and borrow ideas you can add to your own project.
Students' experiences
Add a comment on the idea: +2 points. Or share your experience with photos of your build: +10 points. Every 50 points become a JD 5 discount voucher on parts orders.
Need solutions to the challenges and a complete technical path?
In the consultation we give you a solution for each challenge above, plus a practical build plan from the first step to the last: technologies, libraries, wiring diagram, timeline, and tips for the defense.
- Consultation session
- PDF with solutions and a plan
- 20 د.أ فقط