DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation
DeepASL technology enables realtime two-way communcation between deaf population and normal hearings. In effect, deaf people simply perform sign language as usual and DeepASL will capture the hand shape and movement information, transfrom into recognized word or sentence, and "speak" with synthesized voice. To recognize them, we use a hierarhical bidirectional RNN appended with Connectionist Temporal Classification (CTC) losss.
Paper in ACM SenSys 2017. Data collection tool and dataset releasing soon.