Adobe previews a new generative AI tool

that can convert images and text into videos.

The newest item in Adobe’s Firefly AI portfolio is the sophisticated AI video model.

A new generative AI tool from Adobe may be used to generate videos using text prompts and images. The newest offering in the massive designing software company’s portfolio of generative AI services is the AI tool known as Adobe Firefly Video Model.

However, the new Firefly-powered AI model with text-to-video and image-to-video capabilities will only be available in beta later this year. Adobe also said that it is upgrading its video-editing software Premiere Pro with Generative Extend, which extends the canvas of an image or video frame with newly-generated backgrounds.
“The Firefly Video Model is designed to be commercially safe and is only trained on content we have permission to use – never on Adobe customer content,” the company said.

How to utilize the Firefly video model in Adobe
The newest creative AI tool from Adobe can turn text prompts into films. By changing the angle, motion, and zoom, it may also be used to enhance videos. With the help of this program, video editors can create B-Roll based on certain reference photos.
Moreover, it has image-to-video capabilities that enable the creation of live action videos from still photos or graphics.

“Building upon our foundational Firefly models for imaging, design and vector creation, our Firefly foundation video model is designed to help the professional video community unlock new possibilities, streamline workflows and support their creative ideation,” Ashley Still, senior vice president, Creative Product Group at Adobe, said in a statement.

Some other use cases of the AI video model are creating animations with control over camera angle and motion, generating an insert into a key video shot with camera motion, pairing AI-generated video with footage captured in real-life, and more

Since its launch in March 2023, Adobe Firefly has been gradually expanded to include a generative AI image model, vector model, design model, and soon, a video model. Generative Fill in Photoshop, Generative Remove in Lightroom, Generative Shape Fill in Illustrator, and Text-to-Template in Express are a few other popular AI features offered by Adobe.