Could Alexa’s personal voice filter impersonate the dead?

The tech giant has shown off technology that can artificially create a voice based on hearing a one-minute recording.

Alexa has the power to speak to you in your own voice after listening to a one minute recording.

Tech giant Amazon has demonstrated technology that would allow the voice of a deceased person to read a children’s bedtime story, through its virtual assistant Alexa.

Alexa AI senior vice president and head scientist Rohit Prasad on Wednesday (Thursday AEDT) announced Amazon had developed the software to add “personal voice filters” to the tech giant’s virtual assistant.

The technology would see Alexa, accessible in Amazon devices or by mobile app, artificially create a voice based on hearing a one-minute recording of a person speak, under an advancement Mr Prasad said would help “enables lasting personal relationships”.

The process of artificially creating a voice – otherwise known as “synthesising” – was on full display at Amazon’s re: MARS conference in Las Vegas, where a crowd were played video showing a young boy being read to by Alexa in his deceased grandmother’s voice.

“We are unquestionably living in the golden era of AI, where our dreams and science fiction are becoming a reality. I'm optimistic that ambient intelligence and generalisable AI will enrich the lives of everyone everywhere,” Mr Prasad said.

In a theoretical sense, Alexa could also read text messages in the sender’s voice, order food for a person with their voice or even impersonate a celebrity.

While the technology allowing Alexa to replicate a human voice exists, Mr Prasad said there are no plans to deploy the software to Alexa devices in the near future. Misuse cases, such as impersonating someone with ill intent and concerns over whose voice should and should not be used, are likely to delay release of the software.

Companionship and the ability of AI to create conversation and dialogue have been key themes of the conference.

“One thing that surprised me the most about Alexa is the companionship relationship we have with it. In this companionship role, human attributes of empathy and effect are key for building trust,” Mr Prasad said.

“These attributes have become even more important in these times of the ongoing pandemic, when so many of us have lost someone we love. While AI can't eliminate that pain of loss, it can definitely make their memories last.”

Joseph Lam was guest of Amazon Web Services at re: MARS in Las Vegas.