Guru3D.com
  • HOME
  • NEWS
    • Channels
    • Archive
  • DOWNLOADS
    • New Downloads
    • Categories
    • Archive
  • GAME REVIEWS
  • ARTICLES
    • Rig of the Month
    • Join ROTM
    • PC Buyers Guide
    • Guru3D VGA Charts
    • Editorials
    • Dated content
  • HARDWARE REVIEWS
    • Videocards
    • Processors
    • Audio
    • Motherboards
    • Memory and Flash
    • SSD Storage
    • Chassis
    • Media Players
    • Power Supply
    • Laptop and Mobile
    • Smartphone
    • Networking
    • Keyboard Mouse
    • Cooling
    • Search articles
    • Knowledgebase
    • More Categories
  • FORUMS
  • NEWSLETTER
  • CONTACT

New Reviews
MS Flight Simulator (2020): the 2021 PC graphics performance benchmark review
Radeon Series RX 6700 XT preview & analysis
Corsair MM700 & Corsair Katar Pro XT Review
Guru3D Rig of the Month - February 2021
ASUS GeForce RTX 3060 STRIX Gaming OC review
EVGA GeForce RTX 3060 XC Gaming review
MSI GeForce RTX 3060 Gaming X TRIO review
PALIT GeForce RTX 3060 DUAL OC review
ZOTAC GeForce RTX 3060 AMP WHITE review
Fractal Design Meshify 2 Compact chassis review

New Downloads
GeForce 461.81 hotfix driver download
ClockTuner for Ryzen (CTR) v2.0 RC4 Download
SiSoft Sandra 20/21 download v31.12
Intel HD graphics Driver Download Version: DCH 27.20.100.9316
AIDA64 Download Version 6.32.5644 beta
FurMark Download v1.25
MSI Afterburner 4.6.3 Final Stable Download
Display Driver Uninstaller Download version 18.0.3.7
Guru3D RTSS Rivatuner Statistics Server Download 7.3.0 Final
Media Player Classic - Home Cinema v1.9.10 Download


New Forum Topics
[Mod Driver] NimeZ Radeon Software - Signature Edition More Rocket Lake-S Gaming Benchmarks leak small differences Only Nvidia maximum power settings (per game) sometimes doesn't work.3080 Driver 457.51 3080 tuf OC ed. Same stutter in apex once/twice a game (w/frametimegraph) 3090 Owner's thread w10 defragging/trimming (both)my SSD on scheduled?w10 19042.804 EPYC Gen 3 with Zen3 cores to be announced March 15th New Upcoming ATI/AMD GPU's Thread: Leaks, Hopes & Aftermarket GPU's My experience with 4-way Sli thus far SK Hynix Fires Up Volume Production of 18-Gigabyte LPDDR5 Mobile DRAM Chips




Guru3D.com » News » Nvidia demos AI method to convert 30fps image into 480fps slow motion video

Nvidia demos AI method to convert 30fps image into 480fps slow motion video

by Hilbert Hagedoorn on: 06/18/2018 05:46 PM | source: | 46 comment(s)
Nvidia demos AI method to convert 30fps image into 480fps slow motion video

Researchers from Nvidia developed a method to use AI for the interpolation of video images. This makes it possible to convert a standard recording in for example 30fps into a slow motion video of, for example, 240 or 480fps. Check out the video below the fold, it's pretty impressive. 

Researchers from NVIDIA developed a deep learning-based system that can produce high-quality slow-motion videos from a 30-frame-per-second video, outperforming various state-of-the-art methods that aim to do the same. The researchers will present their work at the annual Computer Vision and Pattern Recognition (CVPR) conference in Salt Lake City, Utah this week.

“There are many memorable moments in your life that you might want to record with a camera in slow-motion because they are hard to see clearly with your eyes: the first time a baby walks, a difficult skateboard trick, a dog catching a ball,” the researchers wrote in the research paper.  “While it is possible to take 240-frame-per-second videos with a cell phone, recording everything at high frame rates is impractical, as it requires large memories and is power-intensive for mobile devices,” the team explained. With this new research, users can slow down their recordings after taking them. Using NVIDIA Tesla V100 GPUs and cuDNN-accelerated PyTorch deep learning framework the team trained their system on over 11,000 videos of everyday and sports activities shot at 240 frames-per-second. Once trained, the convolutional neural network predicted the extra frames. The team used a separate dataset to validate the accuracy of their system. The result can make videos shot at a lower frame rate look more fluid and less blurry.

“Our method can generate multiple intermediate frames that are spatially and temporally coherent,” the researchers said. “Our multi-frame approach consistently outperforms state-of-the-art single frame methods.”

  

  

To help demonstrate the research, the team took a series of clips from The Slow Mo Guys, a popular slow-motion based science and technology entertainment YouTube series created by Gavin Free, starring himself and his friend Daniel Gruchy, and made their videos even slower. The method can take everyday videos of life’s most precious moments and slow them down to look like your favorite cinematic slow-motion scenes, adding suspense, emphasis, and anticipation.







« Seagate launches New 2TB Game SSD Drive (For Xbox) · Nvidia demos AI method to convert 30fps image into 480fps slow motion video · AMD Exchanges your 8086K for a Threadripper 1950X »

Related Stories

Nvidia DGX-2 Is First 2 Petaflop Deep Learning System - 03/27/2018 06:18 PM
NVIDIA today unveiled a series of important advances to its world-leading deep learning computing platform, which delivers a 10x performance boost on deep learning workloads compared with the previous...

Nvidia Doubling Up prices on GeForce GXT 2080? Tackling Some Rumors - 03/02/2018 10:29 AM
Ever since a week or 3-4, there have been massive amounts of chatter about NVIDIA Ampere (GeForce cards) and, what we assume to be, Turing (Mining / HPC Cards). You might have read and heard about it ...

Aquantia Provides Multi-Gig Networking Support for NVIDIA DRIVE Xavier & Pegasus - 01/31/2018 05:48 PM
Aquantia is announcing a new suite of products targeted at autonomous vehicle platforms – their AQcelerate product line is providing the Multi-Gig networking support for the NVIDIA DRIVE Xa...

Nvidia Delivers Xavier SoC in 2018 - 09/27/2017 07:10 AM
Nvidia's Xavier based SoC for automotive purposes will be released in 2018. Xavier is based on Volta architecture and intended for autonomous cars, drones and industrial robots. ...

Nvidia DGX-1 With Tesla V100 Spotted in GeekBench With Staggering Numbers - 09/18/2017 11:40 AM
Back in May Nvidia announced its Testla Volta V100 processor with Tensor architecture. The companies TSMC’s 12nm finfet process bakes graphics processor has 5120 shader processors activated...


10 pages « 3 4 5 6 > »


WalterDasTrevas
Senior Member



Posts: 204
Joined: 2011-07-30

#5558476 Posted on: 06/19/2018 02:36 AM
The "Twixtor" effect for video editors has been doing this for a long time.

sverek
Senior Member



Posts: 6074
Joined: 2011-01-02

#5558477 Posted on: 06/19/2018 03:17 AM
What the f**k is wrong with the forums these days.

Back to good old Nvidia vs AMD fangays fest.

oh, btw Nvidia sucks. haha. Oh wait, I have Nvidia in my PC.... Ahem, AMD sucks!

Fox2232
Senior Member



Posts: 11534
Joined: 2012-07-20

#5558489 Posted on: 06/19/2018 05:39 AM
Ah, nV discovered motion vectors and someone remembered that when vectors are cut in half, you have practically double fps.
Then they came with brilliant idea to cut them again...

They did what millions thought before and thousands implemented. If they improved on something, then it is Artifacts Cleanup.

Glidefan
Don Booze



Posts: 12520
Joined: 2000-05-23

#5558515 Posted on: 06/19/2018 08:21 AM
Thing is, this interpolates from the source. If you have something that happens between those two frames, it won't be in the AI slow mo as the AI won't know it's there.

RealNC
Senior Member



Posts: 3196
Joined: 2011-11-24

#5558526 Posted on: 06/19/2018 08:34 AM
Nice idea if you can get it to work.
sadly though this is far from perfect.
But keep trying your budget is huge.
im sure in time you will crack it.
https://streamable.com/dit4h
Still looks good, even if it's not perfect. It doesn't have to be perfect to be useful.

10 pages « 3 4 5 6 > »


Post New Comment
Click here to post a comment for this news story on the message forum.


Guru3D.com © 2021