Microsoft Edge’s latest video translation capability will use AI-generated voice dub

The capability should be generally available in the following weeks.

2 min. read

Published onMay 7, 2024

published onMay 7, 2024

Share this article

Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more

There is no doubt that Microsoft Edge has some good translation capabilities: fromthe live translation of its PDF readerto the more advanced video translation enhancements that effectively allow users to translate audio or subtitleswhile watching videos in the browser, Microsoft wants to make sure no one feels left behind.

This is most likely why the Redmond-based tech giant is bringing AI-generated voice dub translations to videos, according to the latest post from software enthusiast@Leopeva64.

In other words, you’ll be able to listen to video translations rather than reading them on Microsoft Edge, all due to a new enhancement that uses AI to generate that audio translation.

After many attempts and multiple crashes I was finally able to make a short recording of Edge’s video translation feature, in the first video you can hear the original audio and in the second you can hear Edge’s AI-powered translation:https://t.co/FIcnSbSZjTpic.twitter.com/ozilW5YMOc

According to the enthusiast, Microsoft Edge will have AI generate different voices for dubbing the translation based on who’s speaking. For instance, if a man is speaking in the video, AI will generate a male voice, and if a woman is speaking, then a female voice will be generated.

Here’s another example of Edge’s video translation feature, this time with a female voice (the AI uses female voices if the voice in the video is female), the first video has the original audio and the second the dubbed audio:

The capability is currently live in Edge Canary, and it supports voice translation from English, Spanish, and Korean to German, Spanish, Hindi, Italian, and Russian.

For now, however, the capability is laggy, and it crashes constantly:Currently the translation is constantly interrupted (you can hear it in the video) and the browser crashes and lags a lot when enabling this feature,says the software enthusiast, but there is no doubt Microsoft will remedy this when the capability reaches its general availability.

However, the AI-generated video translation will be a game changer for Microsoft Edge users, as it broadens accessibility to visually and hearing-impaired individuals.

The capability should make it to the stable channel in the following weeks.

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low#

Copilot in Outlook will generate personalized themes for you to customize the app#

Microsoft will raise the price of its 365 Suite to include AI capabilities#

Death Stranding Director’s Cut is now Xbox X|S at a huge discount#

Outlook will let users create custom account icons so they can tell their accounts apart easier#

Microsoft Edge’s latest video translation capability will use AI-generated voice dub#

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low

Copilot in Outlook will generate personalized themes for you to customize the app

Microsoft will raise the price of its 365 Suite to include AI capabilities

Death Stranding Director’s Cut is now Xbox X|S at a huge discount

Outlook will let users create custom account icons so they can tell their accounts apart easier

Microsoft Edge’s latest video translation capability will use AI-generated voice dub