“Movie Gen is a cutting-edge generative AI video model that can produce longer, more customizable videos than competing tools”
In a blog post, Meta’s AI team stated that it intends to usher in a new era of AI-generated content for producers on its platform.
Movie Gen, according to experts, is a collection (or “cast” as they call it) of foundation models, the most prominent of which is the text-to-video component.
Meta claims it outperforms Runway’s Gen3, LumaLabs’ newest, and Kling1.5, but as is customary, this is more to demonstrate that they are all playing the same game than that Movie Gen wins.
The tech company published a paper explaining all of the components, which contains the technical details.
The Meta Movie Gen models build on the company’s previous work in generative AI content production, which began with its “Make-A-Scene” models in 2022, allowing users to produce simple photos and audio tracks, followed by movies and 3D animations.
Meta’s subsequent Llama Image foundation models built on this work by adding higher-quality photographs and videos, as well as editing features.
The first model, Video Generation, is a 30 billion-parameter transformer capable of producing films up to 16 seconds long at 16 frames per second from prompts that can be basic text, graphics, or a combination of the two.
“Given a text prompt, we can leverage a joint model that has been optimized for both text-to-image and text-to-video to create high-quality and high-definition images and videos.
“This 30B parameter transformer model has the ability to generate videos of up to 16 seconds at a rate of 16 frames per second,” Meta wrote.
Meta explained that it is based on a joint model architecture that is optimised for both text-to-image and text-to-video and that it has advanced capabilities such as the ability to reason about object motion, subject-object interactions, and camera motion, allowing it to reproduce more realistic motion in the videos it creates.
We earlier reported that OpenAI released four new tools that would make it easier for developers to create applications based on its artificial intelligence technology as the ChatGPT maker competes with IT behemoths to stay ahead in the generative AI race.
