Monday, 26 June 2023, Bengaluru, India
The company disclosed Thursday at VidCon that YouTube is now testing a new tool that will assist producers in leveraging AI to dub their films into different languages automatically. Aloud, a dubbing service driven by AI and a member of Google’s internal incubator Area 120, collaborated with YouTube.
YouTube added functionality for multi-language audio tracks earlier this year, enabling producers to add dubbing to both new and old videos, expanding their reach to a broader global audience. According to the company, as of June 2023, creators had subtitled over 10,000 videos in more than 70 languages.
Previously, creators had to work directly with third-party dubbing companies to make their audio tracks, which may be a time-consuming and expensive procedure. They can subtitle videos with Aloud at no extra charge.
In 2022, Google first released Aloud. The AI-powered dubbing tool translates and creates a dubbed version after transcribing a video for the creator. Before Aloud makes the dub, creators can evaluate and change the transcription.
Amjad Hanif, the vice president of creative products at YouTube, told the audience yesterday that the platform is testing the tool with hundreds of creators. The business will soon make the mechanism available to all creators. Currently, Aloud is accessible in English, Spanish, and Portuguese. However, more tongues, including Hindi and Bahasa Indonesian, will be available.
According to Hanif, YouTube is “working to make translated audio tracks sound like the creator’s voice, with more expression and lip sync.” In the future, generative AI will enable Aloud to introduce capabilities like voice preservation, improved emotion transfer, and lip reanimation, according to a statement from YouTube to TechCrunch.
[Source of Information: Techcrunch.com]
