Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models — will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date — beta or otherwise — has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
The development of this generative AI video model aims at making video editing more accessible and efficient. Traditional video editing can be time-consuming, requiring a lot of manual adjustments. With AI, users can streamline their workflows, focusing more on creativity rather than technical tasks.
Adobe’s move indicates a future where AI plays a larger role in creative industries. By integrating different AI models, Adobe hopes to cater to a wider range of user needs. This flexibility could make Premiere Pro an even more powerful tool for both professionals and hobbyists.
As this technology evolves, it will be important for users to stay informed about the capabilities and limitations of these new tools. Adobe's approach to integrating multiple AI models could set a new standard for video editing software, encouraging other companies to adopt similar strategies.
The future of video editing looks promising with these advancements. Users should keep an eye on these developments and be prepared to adapt to the new tools as they become available.