Alexa can now respond to sign language: How?

Posted on: Tuesday 24 July 2018

A new app has been developed that can link up with Amazon's Alexa to allow her to respond to sign language.

Share this

Alexa, the voice of the Amazon Echo, has been taught how to respond to sign language cues as well as speech thanks to a new app.

Developed by app creator Abhishek Singh, the innovation incorporates a camera and sophisticated artificial intelligence technology, which Mr Singh taught to recognise sign language gestures. The device can then translate American Sign Language as text and speech to Alexa, allowing her to respond accordingly. 

Smart home devices can exclude people who are deaf or hard of hearing, making them inaccessible to many. People with limited or no hearing function are unable to hear Alexa's responses, and the device is often unable to pick up their speech commands too.

Mr Singh therefore wants to see future devices of this kind developed with people's additional needs in mind and believes his invention could be incorporated into new models.

"Seamless design needs to be inclusive in nature," he stated.

Share this

Related content

Younger generation found to favour female smart assistants

Younger generation found to favour female smart assistants

Female voices have been shown to be more compelling and to engender more positive reaction than male voices for home assistant devices.
 

Learn more

Facebook reveals its own smart home device

Facebook is launching Portal, which will include voice controls powered by Amazon's Alexa.

Learn more

Alexa to enable Skype calls

Amazon Alexa owners will soon be able to make easy Skype calls from their devices, as the company extends its partnership with Microsoft.

Learn more

Why DMEXCO is different – and why that difference matters to marketers

Learn more

Looking to boost your skills?

Lasting two hours each, our virtual training modules have been designed to fit into your day while you work from home and provide you with the opportunity to learn new skills and keep your team up-to-date with latest best practice.