© DMT Competition
Award-winning Work Information & Description
Work Title
Fingertip Interpretation-Tibetan Code
Category
Ethnic Culture
Institution
Tibet University
Advisor
Zhuo Ga
Team Members
Fu Hao, Wang Yi Cheng, Lv Jia Zuo, Ba Yan Zuo, Wu
Award
First prize in the national competition
Year
2025
Description
Tibetan sign language is a sign language used by deaf people who live in a Tibetan-speaking environment or speak Tibetan as their mother tongue. It is based on the standard Tibetan language, the Lhasa sound of the Wei-Tibetan dialect. Tibetan sign language belongs to a kind of mixed sign language, and its language family has not yet been determined, which is different from Chinese sign language. In September 2001, the "Tibet Tibetan Sign Language Research and Development Project" was officially launched by the International Organization for the Disabled and the Tibet Disabled Persons' Federation. It aims to collect and standardize various informal sign language systems distributed in Tibetan-speaking areas; 2004 China's first ethnic minority sign language Tibetan sign language system was successfully developed; as of May 2007, the project has published 3 textbooks and 3 dictionaries, including more than 1000 words, arranged in alphabetical order. As the only comprehensive special education school in Tibet, Lhasa Special Education School has taught deaf-mute students every Saturday since the publication of the teaching materials, which has significantly enriched their vocabulary.
Based on YOLOv9, this system develops an accurate and real-time Tibetan letter gesture recognition system by optimizing and fusing SPPF_LSKA modules. The system can recognize 27 Tibetan letter gestures, and after a lot of training and verification, it can be applied to the fields of translation, communication and education, providing convenient interactive support. The system innovatively combines SPPF_LSKA rapid spatial pyramid pooling and large/small nuclear attention modules, which significantly improves the accuracy and speed of Tibetan sign language recognition. Through the first Tibetan sign language data set, Tibetan deaf students in the process of learning mother tongue culture to get more technical support.