Guru3D.com
  • HOME
  • NEWS
    • Channels
    • Archive
  • DOWNLOADS
    • New Downloads
    • Categories
    • Archive
  • GAME REVIEWS
  • ARTICLES
    • Rig of the Month
    • Join ROTM
    • PC Buyers Guide
    • Guru3D VGA Charts
    • Editorials
    • Dated content
  • HARDWARE REVIEWS
    • Videocards
    • Processors
    • Audio
    • Motherboards
    • Memory and Flash
    • SSD Storage
    • Chassis
    • Media Players
    • Power Supply
    • Laptop and Mobile
    • Smartphone
    • Networking
    • Keyboard Mouse
    • Cooling
    • Search articles
    • Knowledgebase
    • More Categories
  • FORUMS
  • NEWSLETTER
  • CONTACT

New Reviews
Intel NUC 13 Pro (Arena Canyon) review
Endorfy Arx 700 Air chassis review
Beelink SER5 Pro (Ryzen 7 5800H) mini PC review
Crucial T700 PCIe 5.0 NVMe SSD Review - 12GB/s
Sapphire Radeon RX 7600 PULSE review
Gainward GeForce RTX 4060 Ti GHOST review
Radeon RX 7600 review
ASUS GeForce RTX 4060 Ti TUF Gaming review
MSI GeForce RTX 4060 Ti Gaming X TRIO review
GeForce RTX 4060 Ti 8GB (FE) review

New Downloads
AMD Radeon Software Adrenalin 23.5.2 WHQL download
Intel ARC graphics Driver Download Version: 31.0.101.4382
CrystalDiskInfo 9.0.1 Download
Corsair Utility Engine Download (iCUE) Download v5.2
GeForce 535.98 WHQL driver download
CPU-Z download v2.06
AMD Radeon Software Adrenalin 23.5.1 WHQL download
GeForce 532.03 WHQL driver download
AMD Chipset Drivers Download 5.05.16.529
Display Driver Uninstaller Download version 18.0.6.4


New Forum Topics
Review: Endorfy Arx 700 Air PC case AMD Software: Adrenalin Edition 23.5.2 - Driver Download and Discussion MSI Presents MEG 342C QD-OLED Gaming Monitor with Exclusive Early Bird Promotion Review: Intel NUC 13 Pro (Arena Canyon) RTX 4090 Owner's thread AI drone tried to remove its human operator from commanding - under simulation Review: Beelink SER5 Pro (Ryzen 7 5800H) mini PC NVIDIA GeForce Hotfix Driver 536.09 NVIDIA GeForce Game Ready 532.03 WHQL Download & Discussion NVIDIA Power Management (NVPMM) - NVIDIA Power Limit Profile (NVPL Profile)




Guru3D.com » News » Nvidia introduces RTX Broadcast Engine software with AI-green screen

Nvidia introduces RTX Broadcast Engine software with AI-green screen

by Hilbert Hagedoorn on: 09/26/2019 07:17 PM | source: | 16 comment(s)
Nvidia introduces RTX Broadcast Engine software with AI-green screen

NVIDIA is releasing a new feature that might appeal broadcasters, the RTX Broadcast Engine. With the development kit, streamers can dress their live streams in a rather virtual manner. thanks to an ai-green screen. Of course, you'll need a product with Tensor cores, so GeForce RTX is required.

Powered by dedicated AI processors called Tensor Cores on RTX GPUs, the new SDKs enable virtual greenscreens, style filters and augmented reality effects — the kind of techniques used by major broadcast networks — all using AI and without the need for special equipment. Livestreaming of video games has become a cultural phenomenon. Over 750 million people around the world tune in to watch people play video games. TwitchCon is where this global movement comes together. More than 50,000 streamers and fans will converge in San Diego this weekend to meet their favorite gamers and learn about the future of livestreaming. With the RTX Broadcast Engine’s AI-powered capabilities, NVIDIA is announcing a new way that RTX GPUs can enable more immersive livestreams — all without special cameras or physical props.

The new SDKs include:

  • RTX Greenscreen, to deliver real-time background removal of a webcam feed, so only your face and body show up on the livestream. The RTX Greenscreen AI model understands which part of an image is human and which is background, so gamers get the benefits of a greenscreen without needing to buy one.
  • RTX AR, which can detect faces, track facial features such as eyes and mouth, and even model the surface of a face, enabling real-time augmented reality effects using a standard web camera. Developers can use it to create fun, engaging AR effects, such as overlaying 3D content on a face or allowing a person to control 3D characters with their face.
  • RTX Style Filters, which use an AI technique called style transfer to transform the look and feel of a webcam feed based on the style of another image. With the press of a hotkey, you can style your video feed with your favorite painting or game art.

 

 

In addition, NVIDIA is working with OBS, one of the leading livestreaming applications, to integrate RTX Greenscreen. With it, livestreamers will be able to remove their background environment or instantly teleport themselves anywhere — in this world or in virtual ones. This feature will be showcased at TwitchCon for the first time and available in the coming months.

In addition to RTX Broadcast Engine, leading applications such as OBS, XSplit, Huya, Douya and Streamlabs have deployed the NVIDIA Video Codec SDK for fast, high-quality streaming. Three new integrations made their debut this month:

  • Twitch Studio, a new, easy-to-use application for new livestreamers currently in beta, has integrated the Video Codec SDK to enable high-quality livestreaming.
  • Discord, the world’s leading gaming chat application, just released a new group broadcasting feature called “Go Live,” which uses NVIDIA GPUs and the Video Codec SDK to accelerate broadcasting games in Discord.
  • Elgato is one of the world’s leading manufacturers of video capture cards for gaming. It recently integrated the Video Codec SDK into the software of its new 4K60 Pro MK.2 capture card for recording 4K at 60fps video in High Dynamic Range.






« Corsair releases Virtuoso RGB Wireless and Virtuoso RGB Wireless SE · Nvidia introduces RTX Broadcast Engine software with AI-green screen · Download: Samsung SSD Magician 6.0.0 »

Related Stories

NVIDIA indeed to Acquire Mellanox Technology for $6.9 Billion - 03/11/2019 02:25 PM
NVIDIA and Mellanox today announced that the companies have reached a definitive agreement under which NVIDIA will acquire Mellanox....

Nvidia introduces GeForce Now Recommended Routers Certification - 12/20/2018 06:57 PM
Nvidia is starting a program intended for its GeForce Now game streaming solution, it is called the Recommended Routers program. This program selects third-party routers that are best used with NVID...

NVIDIA Introduces RAPIDS Open-Source GPU-Acceleration Platform - 10/11/2018 08:26 AM
NVIDIA today announced a GPU-acceleration platform for data science and machine learning, with broad adoption from industry leaders, that enables even the largest companies to analyze massive amounts ...

NVIDIA is listing 21 Games with RTX Support - 08/21/2018 03:19 PM
During the Gamescom NVIDIA event yesterday, the presentation on the new RTX cards, of course, was raytracing supported games. One slide caught my interest, showing 21 titles that are going to support ...

NVIDIA Introduces HGX-2, Fusing HPC and AI Computing - 05/30/2018 08:37 AM
NVIDIA today introduced NVIDIA HGX-2, the first unified computing platform for both artificial intelligence and high performance computing....


4 pages 1 2 3 4


WhiteLightning
Moderator



Posts: 30226
Joined: 2007-09-19

#5715424 Posted on: 09/29/2019 11:07 AM
I think his point is that if a game is using dlss or RT, which already uses the tensor cores and now your streaming that game with AI green screen, will it effect performance of the game?

The answer is presumably yes.
But doesnt RT use RT cores and not Turing cores ? dont know about dlss, that is true. i forgot about that tbh. And the number of Turing cores will also matter of course for performance fo the deep learning.

here is the whitepaper btw, if you have nothing to do and havent read it yet. it is a very interesting read, exciting times ahead. (since this will be included in future cards as well)
https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/technologies/turing-architecture/NVIDIA-Turing-Architecture-Whitepaper.pdf

4 pages 1 2 3 4


Post New Comment
Click here to post a comment for this news story on the message forum.


Guru3D.com © 2023