Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools, alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models, will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date—beta or otherwise—has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
These new AI tools aim to give video editors more creative freedom and efficiency. With the ability to add or remove objects and extend video clips using simple text prompts, editors can streamline their workflow. This could lead to faster project completion and more innovative video content.
Integrating third-party AI models could open up even more possibilities. By collaborating with Runway, Pika Labs, and OpenAI, Adobe aims to offer a wide range of tools tailored to different editing needs. This approach can benefit both novice and professional video editors by providing flexibility and versatility in their projects.
Content Credentials can help maintain transparency in the creative process. By labeling AI-generated clips with information about the models used, Adobe ensures that editors and their audiences know how the content was created. This can be crucial for ethical considerations and maintaining trust in digital media.
Adobe’s ongoing efforts to enhance its video editing software with AI reflect the growing importance of artificial intelligence in creative industries. As these tools develop and become more integrated, they are likely to transform how video content is produced and edited, offering new opportunities and challenges for creators.