Nvidia introduces RTX Broadcast Engine software with AI-green screen
NVIDIA is releasing a new feature that might appeal broadcasters, the RTX Broadcast Engine. With the development kit, streamers can dress their live streams in a rather virtual manner. thanks to an ai-green screen. Of course, you'll need a product with Tensor cores, so GeForce RTX is required.
Powered by dedicated AI processors called Tensor Cores on RTX GPUs, the new SDKs enable virtual greenscreens, style filters and augmented reality effects — the kind of techniques used by major broadcast networks — all using AI and without the need for special equipment. Livestreaming of video games has become a cultural phenomenon. Over 750 million people around the world tune in to watch people play video games. TwitchCon is where this global movement comes together. More than 50,000 streamers and fans will converge in San Diego this weekend to meet their favorite gamers and learn about the future of livestreaming. With the RTX Broadcast Engine’s AI-powered capabilities, NVIDIA is announcing a new way that RTX GPUs can enable more immersive livestreams — all without special cameras or physical props.
The new SDKs include:
- RTX Greenscreen, to deliver real-time background removal of a webcam feed, so only your face and body show up on the livestream. The RTX Greenscreen AI model understands which part of an image is human and which is background, so gamers get the benefits of a greenscreen without needing to buy one.
- RTX AR, which can detect faces, track facial features such as eyes and mouth, and even model the surface of a face, enabling real-time augmented reality effects using a standard web camera. Developers can use it to create fun, engaging AR effects, such as overlaying 3D content on a face or allowing a person to control 3D characters with their face.
- RTX Style Filters, which use an AI technique called style transfer to transform the look and feel of a webcam feed based on the style of another image. With the press of a hotkey, you can style your video feed with your favorite painting or game art.
In addition, NVIDIA is working with OBS, one of the leading livestreaming applications, to integrate RTX Greenscreen. With it, livestreamers will be able to remove their background environment or instantly teleport themselves anywhere — in this world or in virtual ones. This feature will be showcased at TwitchCon for the first time and available in the coming months.
In addition to RTX Broadcast Engine, leading applications such as OBS, XSplit, Huya, Douya and Streamlabs have deployed the NVIDIA Video Codec SDK for fast, high-quality streaming. Three new integrations made their debut this month:
- Twitch Studio, a new, easy-to-use application for new livestreamers currently in beta, has integrated the Video Codec SDK to enable high-quality livestreaming.
- Discord, the world’s leading gaming chat application, just released a new group broadcasting feature called “Go Live,” which uses NVIDIA GPUs and the Video Codec SDK to accelerate broadcasting games in Discord.
- Elgato is one of the world’s leading manufacturers of video capture cards for gaming. It recently integrated the Video Codec SDK into the software of its new 4K60 Pro MK.2 capture card for recording 4K at 60fps video in High Dynamic Range.
NVIDIA indeed to Acquire Mellanox Technology for $6.9 Billion - 03/11/2019 02:25 PM
NVIDIA and Mellanox today announced that the companies have reached a definitive agreement under which NVIDIA will acquire Mellanox....
Nvidia introduces GeForce Now Recommended Routers Certification - 12/20/2018 06:57 PM
Nvidia is starting a program intended for its GeForce Now game streaming solution, it is called the Recommended Routers program. This program selects third-party routers that are best used with NVID...
NVIDIA Introduces RAPIDS Open-Source GPU-Acceleration Platform - 10/11/2018 08:26 AM
NVIDIA today announced a GPU-acceleration platform for data science and machine learning, with broad adoption from industry leaders, that enables even the largest companies to analyze massive amounts ...
NVIDIA is listing 21 Games with RTX Support - 08/21/2018 03:19 PM
During the Gamescom NVIDIA event yesterday, the presentation on the new RTX cards, of course, was raytracing supported games. One slide caught my interest, showing 21 titles that are going to support ...
NVIDIA Introduces HGX-2, Fusing HPC and AI Computing - 05/30/2018 08:37 AM
NVIDIA today introduced NVIDIA HGX-2, the first unified computing platform for both artificial intelligence and high performance computing....
Senior Member
Posts: 11808
Joined: 2012-07-20
OK. So is nVidia turning Turing into MEME generator or something? Was not that AI stuff meant to improve general gaming?
And what about performance if one uses it for streaming of game that uses same HW blocks?
Moderator
Posts: 30217
Joined: 2007-09-19
Nope , gaming is just a really small part.
Senior Member
Posts: 11808
Joined: 2012-07-20
Nope , gaming is just a really small part.
I meant it for consumer RTX cards.

Moderator
Posts: 30217
Joined: 2007-09-19

Well its multi-functional, so it helps in more then just gaming. more like system wide.
Senior Member
Posts: 354
Joined: 2016-10-22
Very enticing features indeed. Pretty much like the latest smartphones today with their advanced video capture capabilities (for example Sony Xperia 1), these potential new features can make rather high quality content creation possible for lesser price. It is absolutely wonderful when technology gets cheaper like this, so more individuals have access to create and play with such things, possibly filming entertaining and inspiring short movies or whatever content that pleases us.
From GPU market perspective, these features make RTX 2060 and the Super variant certainly more appealing for streamers. Little performance loss compared to RX 5700 is mitigated by possibilities, which means for AMD that they really need to drop their prices. I'm one who basically never watch streams, so I'm all for the Radeon solution, but even I am compelled to have those Tensor cores available if price difference is small between RX 5700 XT and RTX 2070 Super. I want inexpensive gaming hardware first, but all these neat things surely mean many will "go green" from this point onward if AMD doesn't act.