Adobe is working on a generative AI video model for its Firefly family. This will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations — will allow Premiere Pro users to generate video and add or remove objects using text prompts.
These integrations include Runway, Pika Labs, and OpenAI’s Sora models. They will help users extend the length of video clips, just like Photoshop’s Generative Fill feature. No release date has been set for these new video generation tools, only that they’ll roll out “this year.”
Adobe showcased what its own video model can do in an early demo. Its plans to integrate Premiere Pro with AI models from other providers aren’t certain yet. Adobe calls the third-party AI integrations an “early exploration” of what these may look like “in the future.”
The idea is to give Premiere Pro users more choice. They can use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips.
This will help users identify which AI models have been used to generate them. The move can help creators streamline their video editing process. It offers more flexibility and creative control.
Adobe’s move shows how AI can change the creative software industry. It opens up new possibilities for video production. By integrating various AI models, users can expect a more versatile and powerful editing experience.
Expectations are high as Adobe continues to push boundaries in creative technology. They aim to provide tools that make complex tasks easier and faster. The new Firefly tools could be a game-changer for video editors everywhere.