- AI is used to convert neck movements into words
- It is the work of researchers from South Korea
- The system could ultimately be used for ‘silent conversations’
One of the many talents that AI systems offer is advanced pattern recognition, and researchers from Pohang University of Science and Technology (POSTECH) in South Korea have put this to good use by developing a wearable neckband that translates muscle and skin movements into speech.
As outlined by the researchers (via New Atlas ), the device is intended to restore “lost voices” — to give back the power of speech to those who are unable to speak normally. A small camera is used to track a “gesture card” on the neck when the wearer intends to say something without the need for vocalization.
The algorithm-based assessment of what a person is trying to say is then combined with speech synthesis technology to verbalize the words. This speech synthesis system can even be trained on the wearer of the AI neckband (an example of deepfake technology actually being used for something worthwhile).
The article continues below
“It is a remarkable technology because it has a wide range of potential applications, including assisting laryngectomized patients, communicating in noisy industrial environments and even supporting silent conversations,” says Professor Sung-Min Park, who led the study at POSTECH).
85.8% recognition accuracy
These “silent conversations” could be, for example, in libraries or meeting rooms when people are unable to speak audibly for some reason. It can even be used as an alternative to radios or text messages for staff working in an area where face-to-face conversations are impractical.
However, there is a long way to go before this is ready for use by everyone. Although the tape can achieve 85.8% recognition accuracy, this is only across 26 predefined words – the NATO phonetic alphabet (“Alpha”, “Bravo” and so on). When the subject is moving, accuracy currently drops to 39.72%.
This rate should improve as the system is further trained. Encouragingly, the neckband performed well when it came to removing background noise, and words were recognizable with white noise levels of 90 decibels in the background (roughly the equivalent of a busy construction site).
Another advantage of the AI wearable system is that it is much simpler and less bulky than other mind-to-speech systems currently in development, including technology based on electroencephalography (EEG) brain wave readings. It is a significant step forward in terms of portability and accessibility.
Follow TechRadar on Google News and add us as a preferred source to get our expert news, reviews and opinions in your feeds. Be sure to click the Follow button!
And of course you can also follow TechRadar on YouTube and TikTok for news, reviews, video unboxings, and get regular updates from us on WhatsApp also.
The best laptops for all budgets
