Adobe is creating a generative AI video model for its Firefly family. This will bring new tools to its Premiere Pro video editing platform. Users will be able to generate video and add or remove objects using text prompts. This is similar to the Photoshop Generative Fill feature.
These Firefly tools, along with third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models, are expected to roll out this year. Adobe has not set a specific release date yet. The company showcased what the video model can currently do in an early demo.
Adobe plans to integrate Premiere Pro with AI models from other providers. They call these third-party AI integrations an "early exploration" of what could come in the future. The goal is to give Premiere Pro users more options. For example, users may use Pika to extend shots or Sora or Runway AI to generate B-roll for their projects.
Adobe also says its Content Credentials labels can be applied to these generated clips. This will help identify which AI models were used to create them. This feature is part of Adobe’s effort to ensure transparency and trust in AI-generated content.
The addition of these AI tools could change how video editors work. It could save them time and make post-production tasks easier. For example, extending a shot or adding an object to a scene could be done in seconds. This could lead to more creative and innovative video projects.
As AI technology continues to improve, the possibilities for video editing are growing. Adobe's new tools could help both amateur and professional video editors. They could experiment with new techniques and push the boundaries of what is possible in video creation.