Adobe is working on a generative AI video model for its Firefly family that will bring new tools to its Premiere Pro video editing platform. These new Firefly tools — alongside some proposed third-party integrations with Runway, Pika Labs, and OpenAI’s Sora models — will allow Premiere Pro users to generate video and add or remove objects using text prompts (just like Photoshop’s Generative Fill feature) and extend the length of video clips.
Unlike many of Adobe’s previous Firefly-related announcements, no release date — beta or otherwise — has been established for the company’s new video generation tools, only that they’ll roll out “this year.” And while the creative software giant showcased what its own video model is currently capable of in an early video demo, its plans to integrate Premiere Pro with AI models from other providers isn’t a certainty.
Adobe instead calls the third-party AI integrations in its video preview an “early exploration” of what these may look like “in the future.” The idea is to provide Premiere Pro users with more choice, according to Adobe, allowing them to use models like Pika to extend shots or Sora or Runway AI when generating B-roll for their projects. Adobe also says its Content Credentials labels can be applied to these generated clips to identify which AI models have been used to generate them.
The new tools aim to make video editing quicker and more creative. By using text prompts, editors can save time on tasks that used to take hours. For example, if you need to add a tree to a scene, you can just type it in and the AI will do it for you.
This development comes at a time when video content is more important than ever. Many people watch videos online every day, and businesses want to produce high-quality content quickly. The use of AI in video editing could help meet this demand.
Adobe is taking steps to make sure these AI tools are easy to use. They are working on user-friendly interfaces so that even those new to video editing can get the hang of it quickly. This focus on ease of use could make these tools popular with a wide range of users, from beginners to professionals.
One of the possible concerns is how these AI tools might affect jobs in the video editing industry. Some worry that AI might take over tasks that humans currently do. But Adobe suggests that these tools can help editors be more creative by taking care of repetitive tasks, allowing humans to focus on more complex and creative aspects.
Overall, Adobe’s work on integrating AI into video editing software shows promise. As these tools roll out, it will be interesting to see how they change the landscape of video production. Users can look forward to having more options and capabilities at their fingertips.