Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools—alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models—will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date—beta or otherwise—has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
Imagine you have a video project. You need to add a few extra seconds to a clip. With these new tools, you could type in a command, and the AI would fill in the extra time. Or, if you need to add or remove an object, you could do so with a simple text prompt. This kind of flexibility can save hours of editing work.
The integration of different AI models also brings more creative options. For instance, Runway AI can help with generating backgrounds, while Pika can assist with extending scenes. This means editors are not limited to just one tool or method.
Adobe’s new tools are also aimed at making content creation simpler for everyone. Even if you are not a professional video editor, these AI tools can make it easier to produce high-quality videos. This could be particularly useful for small businesses or individuals who want to create content but lack the editing skills or time.
Adobe’s focus on user choice and flexibility in video editing is a significant move. It shows the company is committed to making editing more accessible and efficient. If you work with video, these new tools could soon be a game-changer for your projects.