Adobe is working on a generative AI video model for its Firefly family. This will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models — will allow Premiere Pro users to generate video. They can add or remove objects using text prompts, similar to Photoshop’s Generative Fill feature. Users can also extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date — beta or otherwise — has been set for the company’s new video generation tools. They will roll out sometime this year. Adobe showcased an early demo of what its video model can do. The plans to integrate Premiere Pro with AI models from other providers are still not confirmed.
Adobe calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choices. They can use models like Pika to extend shots or Sora or Runway AI to generate B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips. This will identify which AI models have been used to generate them.
Such advancements show how AI can change video editing. These tools can make the process faster and more efficient. By using text prompts, editors can focus more on creativity and less on technical tasks. This can lead to more engaging and high-quality content.
Adobe’s move to include third-party models may also bring diverse styles and capabilities. This can cater to different user needs. Each model might offer unique features, enhancing the overall editing experience.
Keeping an eye on Adobe’s development in this area can be beneficial. For anyone involved in video creation, knowing when and how to use these tools can make a big difference. The value lies in understanding how AI can be a powerful ally in creative work.