Lightricks Introduces Open-Source LTX Video AI Model With Real-Time Video Generation Capability

Lightricks, a software program firm centered on picture and video modifying, launched an open-source artificial intelligence (AI) video mannequin in preview final week. Dubbed LTX Video, the AI mannequin can generate medium-resolution movies in actual time. Whereas real-time video technology functionality exists in a number of massive language fashions (LLMs), that is the primary one to be open-sourced. The corporate additionally said that when the complete model is launched, it will likely be free for each private and business use and may be built-in into the LTX Studio.

Lightricks Introduces Open-Supply AI Video Mannequin

In a collection of posts on X (previously referred to as Twitter), Lightricks detailed its open-source AI mannequin. The LTX Video accepts each textual content and pictures as enter and may generate five-second-long movies in 768 x 512p decision. Whereas the preview mannequin caps the video high quality at medium decision, it affords close to real-time technology with 4 seconds of wait time. Nonetheless, this technology time is feasible on units outfitted with the Nvidia H100 chip.

The corporate claims that the AI mannequin can generate dynamic movies with excessive immediate adherence and doesn’t require high-end sources to run. To regionally run the LTX Video, customers will want a GPU much like the extent of RTX 4090. Lightricks additionally highlighted that the mannequin structure is predicated on the Diffusion Transformer however makes use of solely two billion parameters to maintain its dimension small.

LTX Video is at the moment accessible on GitHub, Hugging Face, and ComfyUI to obtain. To check the mannequin’s capabilities earlier than downloading it from the internet hosting web sites, customers can go to the mannequin web page on Fal.ai here.

The AI mannequin may also be built-in with a variety of exterior modifying instruments to additional fine-tune the generated movies. The corporate additionally plans to launch the complete model of the video mannequin and make it open supply for each private use circumstances and business utilization. The complete model of the device may even be built-in with the LTX Studio, the corporate’s AI-powered storyboard platform.