Adobe Firefly can now remove video backgrounds without frame-by-frame editing
Adobe Firefly can now automatically remove backgrounds from complete video clips, reducing the need for time-consuming frame-by-frame masking.
Adobe Firefly can now remove the background from an entire video clip automatically, giving creators a quicker way to separate people and objects from whatever is behind them.
Firefly is Adobe’s creative AI platform. While it includes tools capable of generating completely new images and video, Adobe is also increasingly using AI to speed up everyday editing jobs that creators already perform.
The new Remove Background feature is one of those practical tools. It identifies the main subject in a video, follows that subject as they move and removes the surrounding background across the clip.
Normally, separating a person or object from a video can involve something called masking. A mask tells editing software which part of the picture should remain visible and which part should disappear.
That becomes much more complicated once the subject starts moving. An editor may need to make sure the selection continues following a person accurately through dozens or even hundreds of frames, particularly when hair, clothing or other detailed edges are involved.
Firefly is designed to automate much of that work. Once the background has been removed, the isolated subject can be placed into another scene, combined with other footage or used as part of a visual effect.
It could be particularly useful for creators who do not have access to a green screen. Green screens traditionally make background removal easier because editing software can identify one clear colour and remove it, but newer AI tools are increasingly capable of recognising people and objects without needing that setup.
The feature could therefore be used for everything from online videos and promotional content to more complex filmmaking and visual-effects work.
Adobe has introduced the tool as part of a wider Firefly update that also expands some of the AI image and video models available through the platform.
One of those is Kling 3.0 Omni, an AI system capable of generating images and video. Firefly now allows creators to provide reference images when using it, meaning they can give the system a visual example of a character, object or scene instead of trying to describe everything using words alone.
That can make it easier to keep a particular appearance consistent across different generations. The background-removal tool is arguably the simpler development, but it also demonstrates an important shift in how AI is entering entertainment production. Not every AI feature is designed to generate actors, scenes or complete videos.
Some of the technology is instead being used to automate repetitive editing jobs and give creators more time to work on the parts of a project that require creative decisions.
For smaller filmmakers and independent creators in particular, tools like this could make techniques that previously required more specialist editing knowledge much easier to attempt.