Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models — will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date — beta or otherwise — has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
These new tools could change video editing. Imagine, you're working on a project and need to make a scene longer. Instead of filming more, you could use the AI to extend it. Or, if there is an object in the frame you don't want, you could remove it with a simple text prompt. This could make the editing process faster and easier for users.
The implications of this are significant. Editors can now focus more on creativity rather than technical details. Having the ability to change scenes with simple commands could lead to more innovative content. Those who work in video production will likely appreciate these new features.
The integration of models like Pika, Sora, and Runway AI offers even more flexibility. Each model has different strengths, so editors can choose the one that fits their needs best. This could lead to higher quality videos and more engaging content for viewers.
Adobe’s Firefly tools and third-party integrations are still in development, but the potential is clear. Video editing could become more efficient and creative, providing new opportunities for those who use Premiere Pro.
These advancements showcase how AI can enhance creativity and streamline video editing tasks. As these tools become available, they will likely become essential parts of many editors' workflows.