A Nonspeaking Person Is the Star of This Opera. AI Made That Possible.
Professor R. Luke DuBois, who co-leads the Ability Project, built the AI voice system behind "Sensorium Ex," an opera starring nonspeaking performer Jakob Jordan. The system samples a person's own speech to infer the parameters that make a voice theirs, letting performers control pitch and pacing in real time. "It's a labor-creating tool," DuBois said. "It gives Jakob more opportunities to talk."
