A video uploaded this week to YouTube by Microsoft Research Asia–via the Institute of Computing Technology at the Chinese Academy of Sciences Beijing Union University, shows (1)  visual recognition of sign language and (2) communication via an avatar.

A menu on the side shows icons for “ASL” and “CSL”, to which I’ll infer these are for American Sign Language and Chinese Sign Language.

Pretty amazing technology– See below.

Sign Language Recognition

The short video demonstrates four items of the Kinect-based programming:

1.0 Translation Mode
1.1 Isolated Word Recognition
1.1 Continuous Sentence Recognition
2.0 Communication Mode