YouTube is testing an AI-powered dub tool to translate creators' videos

The tool will translate videos and provide an AI-generated voiceover for YouTubers.
By Matt Binder  on 
YouTube on mobile device
YouTube is testing out an AI-powered multi-language dubbing feature for creators. Credit: Mateusz Slodkowski/SOPA Images/LightRocket via Getty Images)

YouTube has been making some big announcements for creators at this year's VidCon

Yesterday, Mashable reported on the new long-awaited thumbnail A/B split testing feature called Test & Compare which will help YouTubers maximize their video views. And now YouTube is working on a potential new way to help creators reach a larger audience: AI-powered multi-language voiceover dubbing for their video content.

The tool is powered by Aloud, an AI dubbing company that is part of Google's own Area 120 startup incubator.

Aloud first provides the creator with a transcription of their video. The user can then edit the transcribed text as they see fit. After the creator signs off on the transcription, Aloud creates an AI voiceover dub for the video. Aloud currently provides this service for free on its website, which is separate from the tool YouTube is building into its platform, but there's currently a waitlist.

A YouTube spokesperson told The Verge that the company has already been testing out the AI dubbing tool with "hundreds" of creators.

Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!

There are a few pretty big limitations with Aloud, according to the FAQ section on its website. The startup's AI-powered tool currently only works with English-language videos and can only dub into two languages, Spanish and Portuguese, at this time. However, with Google's backing and this new partnership with YouTube, it wouldn't be surprising to see Aloud roll out more language options in the near future.

This tool would mark the second major feature related to multi-language dubbing that YouTube launched this year. 

In February, the company rolled out an option to upload multiple audio tracks for individual videos, sorted by language. Viewers can now simply hit the Settings button on any YouTube video that enables this feature and choose to listen with an alternative audio track in the language of their choice. However, this feature requires creators to supply their own audio, which would require the YouTuber to go out and have their video translated and dubbed on their own.

YouTube's partnership with Aloud to create AI-powered dubs could help YouTubers save both time and money while still broadening their audience.

Topics YouTube


Recommended For You
YouTube just got more serious about its ad blocker crackdown
YouTube logo on a smartphone

Beyoncé's 'Cowboy Carter': Who are the featured Black country artists?
Composite of music artists


'Bridgerton' remains queen of classical pop covers. Here's every hidden song in Season 3.
Jessica Madsen as Cressida Cowper and Claudia Jessie as Eloise Bridgerton in the Netflix series "Bridgerton."

OpenAI reveals its ChatGPT AI voice assistant
OpenAI Spring update livestream

Trending on Mashable
NYT Connections today: See hints and answers for May 30
A phone displaying the New York Times game 'Connections.'

'Wordle' today: Here's the answer hints for May 30
a phone displaying Wordle

NYT Connections today: See hints and answers for May 29
A phone displaying the New York Times game 'Connections.'

Ticketmaster hacked. Breach affects more than half a billion users.
Ticketmaster website

'Wordle' today: Here's the answer hints for May 29
a phone displaying Wordle
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!