Avatars and artificial intelligence can help people with
ALS - an incurable nerve disease that leads to almost complete paralysis - to communicate. The device speaks with the help of the affected person's eye movements.
The virtual character combines a circular keyboard interface with predictive
AI, modules that perceive movements of the tongue and ear muscles, and eye-tracking technology. All together, this enables people to write words, translate them into spoken language and communicate over a longer period of time almost in real time using eye control.
The avatar can capture a person's personality and mannerisms - for example when speaking or moving - with an accuracy of around 96 percent.
In the future, the avatar will also be able to provide precise simultaneous translation into foreign languages.
The assistance system was developed by the Scott Morgan Foundation, a British foundation that provides technological support for people with limited mobility and speech. The technology company Lenovo and the
AI innovator DeepBrain
AI were involved.