3D Signing Avatars for Teaching American Sign Language
|
|
In this project, we design 3D Virtual Agents who can dynamically sign in American Sign Language (ASL).
We partner with the Institute for Disabilities Research and Training (IDRT) to generate real-time animations of 3D characters during real-time motion capture of human signers ASL gestures and facial expressions.
The goal of the project is to integrate these animations in IDRT English-to-ASL and ASL-to-English translation engine, Sign Generator. Sign Generator’s robust database pairs specific signs - represented as graphics and video clips, and now 3D-characters - with over 30,000 English words, idioms, phrases, numbers, and symbols.
We partner with the Institute for Disabilities Research and Training (IDRT) to generate real-time animations of 3D characters during real-time motion capture of human signers ASL gestures and facial expressions.
The goal of the project is to integrate these animations in IDRT English-to-ASL and ASL-to-English translation engine, Sign Generator. Sign Generator’s robust database pairs specific signs - represented as graphics and video clips, and now 3D-characters - with over 30,000 English words, idioms, phrases, numbers, and symbols.
