Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools, along with some planned third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models, will allow Premiere Pro users to generate video and add or remove objects using text prompts, similar to Photoshop’s Generative Fill feature.
Adobe has not yet provided a release date for these new video generation tools. They have only stated that they will roll out “this year.” The creative software giant has shown what its own video model can do in an early demo, but plans to integrate Premiere Pro with AI models from other providers are still uncertain.
Adobe calls the third-party AI integrations in its video preview an “early exploration” of what they may look like in the future. The goal is to give Premiere Pro users more options, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also mentions that its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to create them.
The integration of these tools aims to streamline the editing process for users, making it easier to produce high-quality videos quickly. By providing more choices in AI models, Adobe hopes to cater to a wider range of creative needs, enhancing the overall user experience. This approach also gives users the flexibility to experiment with different AI technologies and find the best fit for their projects.
The move to include generative AI in video editing tools signifies a significant step forward in the field of video production. As these technologies continue to develop, we can expect even more innovative features and capabilities to emerge, further transforming how videos are created and edited.