Chinese university startup’s new AI platform translates text to sign language for deaf

Smart glasses equipped with virtual avatars now translate speech into sign language in real-time, thanks to a breakthrough AI platform developed by Chinese researchers at Xian Jiaotong-Liverpool University.

Su Jionglong and his students at their startup Limitless Mind have created a lightweight AI model that runs on mobile devices or integrates into wearable technology. The platform works both ways, translating written text to sign language and displaying real-time text for easier communication.

Local governments and industrial parks are already backing the project, eager to bring it to market. The timing couldn't be more crucial. Research published in the Chinese Medical Journal projects that by 2060, more than 240 million people in China will experience moderate to complete hearing loss, nearly doubling from 2015 numbers.

Su's team is pushing further into assistive technology, exploring platforms that translate lip movements into text and brain-computer interfaces that convert brainwaves into written language. These innovations could eventually help control driverless vehicles or enhance accessibility.

The researchers are also collaborating with Shenzhen-based Mind with Heart Robotics to develop electronic companions that analyze facial expressions and classify emotional states, potentially helping autistic children and their caregivers communicate more effectively.