Using Artificial Intelligence (AI) voice cloning, Ed Riefenstahl reclaimed his diminished natural voice, demonstrating how technology can transform communication and restore a sense of identity.
December 10, 2024
By Kelly Kjetsaa
Michele Gagne, adjunct professor of information systems and supply chain management, often reminds her students that we live in a time of rapid technological transformation. With innovations that blend the digital, physical and biological worlds, these advancements carry both great potential and significant challenges. In her Business Information Systems class, Ed Riefenstahl demonstrated firsthand how transformative new technology can be.
Riefenstahl, a Neeley School of Business faculty member and director for the Neeley & Associates MBA Consulting program, stood before the class and opened his mouth to tell his story. In the past, speaking a simple sentence came as naturally as breathing. Now, with a cup of water in hand to help him speak as clearly as possible, Riefenstahl began talking. His natural voice, once effortless, now carried a strain that wasn’t required before, each word needing strong focus to be enunciated as clearly as possible as he addressed the class.
Riefenstahl’s life took a sharp turn in July 2021, when a fall from a ladder caused a traumatic brain injury. After weeks of intensive therapy and recovery, he gradually regained the strength to resume his responsibilities at Neeley. At first, overall progress seemed steady, but in early 2023 his speech began to deteriorate. It was at TCU’s Miller Speech and Hearing Clinic, where for the first time a speech professional noticed his tongue appeared to be weak.
Ultimately, a traumatic brain injury specialist at UT Southwestern Medical Center Fort Worth diagnosed him with bulbar palsy – a condition that weakens the muscles used for speaking and swallowing. They told him the condition would not improve, it might continue to deteriorate, and there is no cure.
After months of working with a speech pathologist and facing the reality that his speech quality was not improving, Riefenstahl began searching for alternative speech solutions. For a quick fix, he utilized a text-to-speech application that provided a synthetic, robot-sounding voice for some interactions. In March 2024, he came across a webinar that introduced him to the concept of generative Artificial Intelligence (AI) and voice cloning technology.
Intrigued by the possibilities, Riefenstahl began exploring the use of AI to restore his voice. After extensive research, he connected with ElevenLabs, a company specializing in AI-generative speech. Using old recordings of his voice, the company was able to create a digital replica of Riefenstahl’s voice that could be integrated with text-to-speech technology.
“I teared up and almost cried,” Riefenstahl told Gagne’s class, describing the moment he first heard his cloned voice. “Hearing your voice again when you knew you would never have it back... it felt like a part of me had been restored.”
Riefenstahl’s wife, Valerie, who has been by his side throughout this journey, shared how incredible it was to hear his real voice again, rather than the text-to-speech voice he had relied on before and referred to as “Robot Ed.”
“Upon receiving his cloned voice in early August, Ed called the family into his office and hit play, saying, ‘Valerie, would you please bring me a glass of chardonnay?’,” Valerie Riefenstahl said, recalling the joy she felt that day. “We were so happy to hear his voice and amazed at the technology.”
Back in Gagne’s Business Information Systems class, students were struck by the real-world application of AI to help restore Riefenstahl’s voice; and the journey Riefenstahl demonstrated of his deteriorated speaking voice to the robotic sounding one and finally the cloned version.
When I heard the audio recording of Ed’s voice, I was blown away,” said Jack Moyers, a Neeley student. “The richness and authenticity of the sound was truly astonishing.”
For Riefenstahl, the experience with AI has not only provided a soundalike of his original voice, but has also given him new hope for the future. As he continues to adapt to life post-injury, he is optimistic about how technology can help others facing similar challenges.
“I hope that my story can inspire others to explore the possibilities of technology and what it can do for them,” Riefenstahl told the students. “With the right tools, we can overcome even the toughest challenges.
David Allen, senior associate dean for graduate programs at Neeley, highlighted Riefenstahl’s lasting impact on the school, emphasizing his pivotal role in shaping experiential learning for MBA students over the years and his admirable adaptability in the face of change. He noted that Riefenstahl’s ability to evolve with new technologies, like generative AI, reflects the very principles that Neeley instills in its students — innovation, resilience and embracing challenges.
“Ed’s journey serves as a powerful example of how technology, when harnessed effectively, can not only overcome personal obstacles but also inspire new ways of thinking and learning within the business world,” Allen said. “It’s a testament to Ed’s resilience and to how technology can enhance both education and personal lives.”
Riefenstahl’s experience underscores the profound human impact that technology can have. While AI is often associated with business solutions, Riefenstahl’s journey is a powerful testament to how it can go beyond that, restoring not just voices but also a sense of identity and connection for those facing communication challenges.
Riefenstahl hopes that by sharing his experience, he will continue to inspire others – whether in Neeley classrooms or beyond – to explore the transformative potential of technology in both personal and professional realms.
