Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models — will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date — beta or otherwise — has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
By focusing on these new tools, Adobe aims to make video editing more accessible and efficient. With generative AI, users can streamline their workflow, spending less time on manual tasks and more time on creative work. This could be a significant boost for both amateurs and professionals in the video production industry.
Adobe’s move towards integrating multiple AI models also underscores the growing importance of collaboration in tech. Instead of limiting users to a single model, Adobe is exploring how different AI tools can work together to provide a more flexible and powerful editing experience.
Generative AI is rapidly advancing, and Adobe's latest offering could set a new standard in the industry. By making the inputs the goal, such as improving tools and workflows, the outputs—a more seamless editing experience—will naturally follow. This approach aligns with the idea that focusing on the process, rather than the end result, leads to better outcomes.
As more details emerge, it will be interesting to see how these new tools are received by the community. The potential for enhanced creativity and productivity is enormous, and Adobe's continued innovation could pave the way for future developments in AI-powered video editing.