YouTube expands AI-based auto-dubbing feature to thounsands of channels

YouTube expands AI-based auto-dubbing feature to thounsands of channels

YouTube has expanded its AI-based auto-dubbing feature to “hundreds of thousands” of channels in the YouTube Partner Program. It started by limiting it to educational and informative content, but it is to extend the feature to other content types shortly to maximize its global reach.

It processes the original language video translation. For example, English videos can be dubbed into multiple languages: French, Hindi, Spanish, German, Italian, Indonesian, Japanese, and Portuguese. Likewise, content originally in those languages will now have English dubs.

How AI-Based Auto-Dubbing Feature Works

Videos uploaded by the creators will automatically be dubbed into the feature. The creator is allowed to preview, edit, or delete any dub created by the AI for their video. This feature is functional but still has many disadvantages, such as unnatural tone and emotion.

YouTube guaranteed its creators that future updates would change the AI’s ability to represent the original speaker’s intonation, emotion, and ambiance of the environment.

Development Timeline

This feature first hit the screen in June 2023 as a pilot test for select creators. From here, the feedback generated led to its wider implementation. The advancement by YouTube marks a great milestone in language breakage to cater to different kinds of content accessible worldwide.

Continual Development

While this is a milestone, YouTube admits that technology is not yet there. YouTube is set to perfect the AI to meet the very different linguistic and cultural demands of users all over the world.

YouTube Kids is also currently being redesigned to look more similar to the main service, with that change expected to drop in early 2024.

Also, see:

WhatsApp Introduces One-Minute Voice Status Updates