Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models — will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date — beta or otherwise — has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
Right now, many video editors spend countless hours on tasks such as trimming clips, adding effects, or adjusting objects within a scene. With Adobe's new AI tools, these tasks could become much faster and easier. This means editors can focus more on creativity and storytelling, rather than being bogged down by tedious technical tasks.
For example, if an editor wants to extend a sunset scene but doesn't have enough footage, the AI can generate more of that scene seamlessly. This not only saves time but also opens up new possibilities for video projects that were previously limited by available footage.
Adobe's vision for integrating AI into video editing is ambitious. They aim to make powerful AI tools accessible to everyone, from beginners to professionals. This aligns with the broader trend in tech to democratize tools that were once only available to specialists.
The implications of these advancements are vast. Students, hobbyists, and professionals alike could benefit, making high-quality video production more achievable for all. With the use of AI, the boundaries of what can be created and edited in video are expanding, offering new opportunities for creativity and innovation.
Adobe’s commitment to exploring these technologies suggests a future where video editing becomes more intuitive and less about manual effort. This shift could change the landscape of digital content creation, making it more dynamic and less time-consuming.