Adobe is working on a generative AI video model for its Firefly family. This will bring new tools to Premiere Pro. Users will be able to generate video and modify objects using text prompts. It's similar to Photoshop’s Generative Fill feature. They can also extend the length of video clips.
These new tools will roll out sometime this year. Adobe has shown an early demo of what its video model can do. Users will have more choices with proposed third-party integrations.
Runway, Pika Labs, and OpenAI’s Sora models are part of this plan. Users can use Pika to extend shots and Sora or Runway AI to generate B-roll. These integrations are an “early exploration” of future possibilities, according to Adobe.
Adobe’s Content Credentials labels can be applied to these generated clips. This will help users identify which AI models were used. It aims to provide more transparency and control over AI-generated content.
Adobe is trying to give users more options and flexibility. By integrating with other AI models, they hope to enhance user experience. This could change how video editing is done in Premiere Pro.
The initiative marks a step forward in blending generative AI with video editing. It could make complex editing tasks easier and faster for users.