Alexa can now respond to sign language: How?

Posted on: Tuesday 24 July 2018

A new app has been developed that can link up with Amazon's Alexa to allow her to respond to sign language.

Alexa, the voice of the Amazon Echo, has been taught how to respond to sign language cues as well as speech thanks to a new app.

Developed by app creator Abhishek Singh, the innovation incorporates a camera and sophisticated artificial intelligence technology, which Mr Singh taught to recognise sign language gestures. The device can then translate American Sign Language as text and speech to Alexa, allowing her to respond accordingly. 

Smart home devices can exclude people who are deaf or hard of hearing, making them inaccessible to many. People with limited or no hearing function are unable to hear Alexa's responses, and the device is often unable to pick up their speech commands too.

Mr Singh therefore wants to see future devices of this kind developed with people's additional needs in mind and believes his invention could be incorporated into new models.

"Seamless design needs to be inclusive in nature," he stated.

Related content

Amazon Ads x Digital Upfronts: 4 things we learnt

Following the launch of IMDb TV in the UK, the team at Amazon Ads shared the content advertisers and viewers can expect to find on the service

Learn more
Younger generation found to favour female smart assistants

Younger generation found to favour female smart assistants

Female voices have been shown to be more compelling and to engender more positive reaction than male voices for home assistant devices.  

Learn more

Facebook reveals its own smart home device

Facebook is launching Portal, which will include voice controls powered by Amazon's Alexa.

Learn more

Alexa to enable Skype calls

Amazon Alexa owners will soon be able to make easy Skype calls from their devices, as the company extends its partnership with Microsoft.

Learn more

Why digital advertising works

Discover why digital advertising is effective for reaching your customers and building brands.