YouTube Auto dubbing tool has been updated with new languages along with support for lip sync through a pilot in the US.
YouTube Auto Dubbing tool has been updated by the streaming platform with a few new features including support for more languages.
Support for Hindi has been added in Expressive Speech as well. Also, the platform is testing a Lip Sync feature that will work alongside the auto-dubbing tool.
The YouTube Auto dubbing tool is now available to everyone, with an expanded library of 27 languages. In December, YouTube averaged more than 6 million daily viewers who watched at least 10 minutes of auto dubbed content, the platform said in a blog post. Moreover, the platform has launched Expressive Speech for all YouTube channels in 8 languages (English, French, German, Hindi, Indonesian, Italian, Portuguese and Spanish), to help capture a "creator's original emotion and energy."
Next, the platform has introduced Preferred Language setting for its multilingual community and anyone who wants to watch a video in its original language. While the platform already selects the default language based on your watch history, you can now indicate your preferences to manage how you want to hear the videos you watch.
In an effort to make auto dubs even more natural, YouTube is currently testing a Lip Sync pilot that subtly matches the speaker's lip movements to the translated audio so a dubbed video feels as seamless as watching the original.
For creators, the YouTube Auto dubbing tool has been updated with the following features:
- Automatic Smart Filtering: New set of video-level filters that recognise when a video shouldn't be dubbed-like music or silent vlogs-to keep the content authentic.
- Discovery-friendly: Auto dubs do not negatively
impact your original video's discovery algorithm, and it might be able to help with discovery in other languages.