Chinese Sign Language Synthesis System

Chinese Sign Language

Sign Language, including finger spelling and gesture, is the most natural communication ways of exchanging information for deaf people. Finger spelling uses finger postures and motions to express letters, through letter sequence spelling the sign word. In ancient oral communication time, human often used different hand gestures of specific meaning along with kinds of indicated and visualized gestures called natural hand gesture. After that, along with social progress, especially the education development of deaf people, hand gesture with the language characteristic is created. Based on the invention of sound language and Chinese character, the language which is close to verbal language is called as artificial gesture. Natural gesture and artificial gesture together form hand gesture language.

China is a country with vast territory and a large population whose spoken language has many kinds of local accents and has different kinds of sign language. On the latter of 50 year, the Chinese Deaf Association revised the <General Sign Language Draft for the Deaf > that began sign language standardization in China. The Chinese Deaf Association originally revised 4 volumes into 2 volumes named [General Sign Language picture for the Deaf] in 1979, and later finished volume 3 and 4. On the end of 1985, The Association again revised the 4 volumes and made additions and deletions. On the third Sign Language conference in 1987 renamed <General Sign Language picture for the Deaf > as <Chinese Sign Language>. The Chinese Sign Language book was edited by the Chinese Deaf Association formally published in 1990, and rewrote and published in 1994. All of these efforts have had a significant meaning in popularizing and standardizing sign language.

Chinese Sign Language Synthesis System (CSLSS)

CSLSS has been developed by Institute of Computing Technology of the Chinese Academy of Science and Harbin Institute of Technology. It is a system using computer technology that translates speech into text through virtual human and sign language synthesis technology in order to help hearing people communicate with the hearing impaired. At same time, the system can be used for finger language and sign language teaching.

On the days of pursuing more harmonious interaction between human and machine, the Chinese Sign Language Synthesis System based on three dimensional virtual human synthesis technology, helps deaf colonies to use TV, internet, telephone, computer, film and advanced technology productions so as to improve their life's quality. The system also play an important role in promoting sign language standardization, expanding standard sign language usage areas and improving deaf people's social communication. CSLSS will improve deaf-mute colonies' educational environment, enhance their education possibilities and challenge their ability in the society among the people.

Demonstrations

1. Chinese sign language electronic dictionary
2. TV virtual sign language anchorperson system
3. The information distribution system through sign language
4. Sign language tour guidance system
5. The dialogue system between sign language and spoken language

Manual