Ravi Sharma › Projects › Setu
Setu
Sign Language Bridge (Smart India Hackathon 2026)
by Ravi Sharma · Team project, Smart India Hackathon 2026 · September 2026
What it is
Setu is a shared space for Deaf or hard-of-hearing people and the staff they need to talk to, bringing speech, sign playback and written messages to one counter.
What Ravi Sharma built
- Fixed camera recognition of face-adjacent signs by capturing full body, hand and 48-point face trajectories, so look-alike signs stopped being confused.
- Bundled the MediaPipe Holistic model for offline use with GPU-to-CPU fallback, tuned segmentation for multi-part signs and added an automated test suite.
- Rebuilt sign playback as a 2D signer with articulated hands, plus a resumable dataset pipeline (4,384 clips indexed).
Tech
- TypeScript
- React
- Python
- MediaPipe Holistic