YouTube adds real-time video segmentation to Stories format

Google is testing a new feature where users can add augmented green screen filters to live YouTube videos. The feature first spotted by Engadget, allows creators to insert whatever they want as their new backdrop in real time.

The feature will automatically segment the background and foreground of your videos. From there, you'll have the ability to modify the background to display a host of predetermined backgrounds. The technology can also identify when your camera moves and will expand or contract the background area to show more or less of it.

Dubbed as Mobile Real-Time Video Segmentation, the tech uses AI and machine learning to let users replace the background on their video in real-time. For now, the background replacement tool is tied to YouTube’s new “stories” video format.

In order to access the app, from the YouTube app, simply upload a video into your Story function. Immediately, you'll be given the option to edit your clip and create a custom background. In the options below your video, you can scroll through different background creations and test them by tapping each one. Your video will play and the background will dynamically change in the background as you scroll through the options.

The feature, which is currently in a limited beta, is available only in the YouTube app and is available specifically for limited YouTube creators.