The 11th grade student and his AI gloves translate and help people with disabilities

Realizing that deaf people have many difficulties in communication, an 11th grade student in Quang Tri created a pair of translation gloves to help less fortunate people study and acquire knowledge.

"Cak cac cac cac cac cac cac", the sound of the school dismissal drum rang out, Tran Ngoc Long , 11th grade student, Le Quy Don High School for the Gifted (Dong Ha city, Quang Tri province) hurriedly put on his backpack and went to a school. room, which contains a device, it is the long-cherished dream of the student of the Sacred Land.

No one thought that an 11th grade student would be able to program two artificial intelligence (AI) tools and integrate them into a device he researched - a translation glove - to help other people. disabled (mute/deaf), can communicate like normal people.

Tran Ngoc Long and AI gloves.

"I hope everyone can acquire knowledge"

Regularly going to the School for Disabled Children in Quang Tri province, Long noticed that his peers could not communicate, study and absorb knowledge, and his heart always felt heavy.

Possessing a noble soul, Tran Ngoc Long cherished creating a communication support device to help those less fortunate than himself.

"I feel that people with disabilities suffer a lot. People who want to acquire knowledge and develop themselves must listen and speak. If I were unfortunately blind, I could still learn knowledge, but what People who are born deaf and mute cannot do this," Tran Ngoc Long shared.

More than half a year ago, when starting the project, the student at that time did not know where he started, everything started from zero. There were times when he despaired and thought of giving up. , but with the dream of helping people with disabilities, the student is not afraid of hard work and diligently learns about technology to improve his products.

Train two AI tools

At 2 o'clock at night, Dong Ha city was in silence. Somewhere in a bedroom, a clicking sound was heard. Tran Ngoc Long was diligently sitting in front of the computer, his fingers quickly manipulating programming commands. The student is training the AI ​​to integrate into the translation glove.

As a student majoring in Physics, Long did not have any knowledge about programming. Fortunately, he was guided by his computer science teacher at school, teacher Ho Van Lam, who shared basic skills and documents so he could manipulate commands on the computer.

"My programming knowledge initially started from zero. I am really grateful to the teacher who taught me how to program so that I could create my own AI tool and train a capable AI software. available to suit Vietnamese sign language devices and data ," Long expressed.

"My name is. I have a passion for art" , the sentence rang out from a phone in the classroom at the School for Disabled Children in Quang Tri province , a student with a red scarf on his shoulder and face. innocent and pure, wearing a glove equipped with sensor chips.

Unfortunately, when I was born, I was born deaf and mute, my hands were moving to perform sign language. With just a few moves, the phone below made a sound introducing himself and the passion of this disabled child.

This is possible thanks to the translation glove device made by Long. This product is a pair of electronic gloves that help deaf and mute people communicate in natural language with normal people, operating through sign language conversion.

Long's translation gloves are equipped with sensors. He has trained his own artificial intelligence to match the Vietnamese sign language database, so that the process of converting sign operations into language is accurate. .

It is integrated with many outstanding features, comes with a phone software to play sound and display communication content.

Notably, these gloves can communicate two-way between normal and deaf people in both English and Vietnamese. Converts discrete words of sign language into a complete sentence, according to appropriate natural language during communication.

Products manufactured by Long are equipped with curvature sensor chips, gyroscope sensors, magnetic field sensors and acceleration sensors.

They will be responsible for measuring the difference in contraction and stretching between fingers, the difference in voltage to create a series of data to be sent to an application on the phone. Then, artificial intelligence will turn this data into a complete dialogue.

However, this device initially encountered errors in drawing orbits in space. Long solved this problem by creating an AI tool to correct the above sensor errors.

In addition, the student constantly collects Vietnamese sign language to put into the data platform and trains AI so that this technology can process dialogue accurately and compatible with hand gestures. hearing impaired people.

Touch glory

At one point, Tran Ngoc Long wanted to give up his research, because the results were going nowhere and the time spent on the project greatly affected his academic results. The student was unable to achieve good student results in his semester, the pressure made him desperate.

During testing sessions at the province's School for Disabled Children, Long's gloves did not work as expected, because the sensors could not provide accurate sign language.

Tran Ngoc Long won first prize in the National Science and Technology Competition thanks to the Translation Gloves project.

"Because I developed the device following the path of previous products, the more I developed, the more mistakes I made and I couldn't create a device that met my goals. I was stuck and fell into a state of crisis. Despair, the idea of ​​giving up appeared in my mind ," Long expressed.

With encouragement from his instructor, boldly changing and choosing a completely new direction, Tran Ngoc Long was able to overcome this difficulty by integrating technology to handle drift phenomena using learning models. Deep learning to draw precise orbits on the IMU module - equipped with orbital sensors in space.

Teacher Ho Van Lam (left), Long's instructor in the translation glove project, and the principal of Le Quy Don High School for the Gifted took a commemorative photo at the provincial Science and Technology competition.

Gradually, Long's translation gloves became more and more effective. The project "Gloves that convert sign language into natural language for deaf and mute people" won first prize in the National Science and Technology Competition and participated in the project selection round to participate in the Science Competition. International Engineering College will be held in the United States this coming May.

"I think success requires sacrifice and trade-off. Even though I was not a good student last semester, I still feel very proud and hope that one day my product will help others." Hearing impaired people can communicate easily. From there they can study and acquire knowledge to contribute to the development of the country ," Tran Ngoc Long expressed, closing the story with the reporter.