Lightricks, a software company focused on image and video editing, released an open-source artificial intelligence (AI) video model in preview last week. Dubbed LTX Video, the AI model can generate medium-resolution videos in real time. While real-time video generation capability exists in a few large language models (LLMs), this is the first one to be open-sourced. The company also stated that once the full version is released, it will be free for both personal and commercial use and can be integrated into the LTX Studio.
Lightricks Introduces Open-Source AI Video Model
In a series of posts on X (formerly known as Twitter), Lightricks detailed its open-source AI model. The LTX Video accepts both text and images as input and can generate five-second-long videos in 768 x 512p resolution. While the preview model caps the video quality at medium resolution, it offers near real-time generation with four seconds of wait time. However, this generation time is possible on devices equipped with the Nvidia H100 chip.
(1/13) We've been working on something special ✨
— LTX Studio (@LTXStudio) November 22, 2024
Introducing LTX Video, Lightricks' new open-source, community-driven model for video generation. Create breathtaking videos in moments, blazing past traditional playback speeds—this is LTX Video.
Learn more below. pic.twitter.com/HWSVvT8P77
The company claims that the AI model can generate dynamic videos with high prompt adherence and does not require high-end resources to run. To locally run the LTX Video, users will need a GPU similar to the level of RTX 4090. Lightricks also highlighted that the model architecture is based on the Diffusion Transformer but uses only two billion parameters to keep its size small.
LTX Video is currently available on GitHub, Hugging Face, and ComfyUI to download. To test the model's capabilities before downloading it from the hosting websites, users can go to the model page on Fal.ai here.
The AI model can also be integrated with a wide range of external editing tools to further fine-tune the generated videos. The company also plans to release the full version of the video model and make it open source for both personal use cases and commercial usage. The full version of the tool will also be integrated with the LTX Studio, the company's AI-powered storyboard platform.
