D-ID, the Tel Aviv-based artificial intelligence (AI) startup, launched an AI-powered video translation software in beta on Wednesday. Dubbed Video Translate, the software can generate translated movies that mimic the voice of the unique speaker and sync the lip motion to match the phrases. The function is at the moment accessible to the subscribers of the platform, and the corporate mentioned will probably be accessible totally free for a restricted interval. The software will compete with comparable platforms akin to ElevenLabs, Speechify, and extra.
The AI startup introduced the launch of the video translation function in a publish on X (previously referred to as Twitter). The brand new software joins the platform’s present choices akin to avatar-based AI video era, AI agent creation, and AI-powered video marketing campaign creation. The Video Translate software is at the moment accessible in beta on the internet. Whereas D-ID does have iOS and Android apps, they don’t help this function in the intervening time.
With the brand new AI tool, customers can both add a video file from their system or drag it from a cloud server. Presently, the utmost supported file measurement is 2GB and the supported file codecs embrace MP4, MOV, and MPEG. Devices 360 workers members had been in a position to take a look at the platform and located it to be working as described, though the lip-syncing and AI voice seem barely unnatural and robotic, and figuring out these movies as AI-generated can be fairly straightforward.
Nevertheless, there are a number of limitations when producing a video as effectively. The video translation will solely work when there’s a single individual within the body of the video, and the individual is front-facing with their face seen always. Additional, background noise or music can distort the standard of era. Moreover, the platform doesn’t translate movies if the speaker is a well-known or recognisable particular person who seems in them.
The D-ID Video Translate software can translate movies into 30 completely different languages. A few of them embrace Arabic, Chinese language, English, French, German, Hindi, Italian, Japanese, Korean, Russian, Tamil, and Turkish.
Presently, the function is out there to all subscribers of the platform. Customers can subscribe to D-ID by registering an e-mail ID totally free. The free tier will get 20 credit, which isn’t replenished as soon as exhausted. The paid subscription begins at $56 (roughly Rs. 4,700) per 12 months and gives 40 credit per thirty days. The costliest plan will price $2,263 (roughly Rs. 1,90,000) per 12 months and gives 700 credit a month. The startup additionally gives enterprise-focused plans as effectively.
About The Author
