Windows 10: NVIDIA Transforming Standard Video Into Slow Motion with AI

Brink · Jun 18, 2018

Researchers from NVIDIA developed a deep learning-based system that can produce high-quality slow-motion videos from a 30-frame-per-second video, outperforming various state-of-the-art methods that aim to do the same. The researchers will present their work at the annual Computer Vision and Pattern Recognition (CVPR) conference in Salt Lake City, Utah this week.

“There are many memorable moments in your life that you might want to record with a camera in slow-motion because they are hard to see clearly with your eyes: the first time a baby walks, a difficult skateboard trick, a dog catching a ball,” the researchers wrote in the research paper. “While it is possible to take 240-frame-per-second videos with a cell phone, recording everything at high frame rates is impractical, as it requires large memories and is power-intensive for mobile devices,” the team explained.

With this new research, users can slow down their recordings after taking them.

Using NVIDIA Tesla V100 GPUs and cuDNN-accelerated PyTorch deep learning framework the team trained their system on over 11,000 videos of everyday and sports activities shot at 240 frames-per-second. Once trained, the convolutional neural network predicted the extra frames.

The team used a separate dataset to validate the accuracy of their system.

The result can make videos shot at a lower frame rate look more fluid and less blurry.

“Our method can generate multiple intermediate frames that are spatially and temporally coherent,” the researchers said. “Our multi-frame approach consistently outperforms state-of-the-art single frame methods.”

[youtube]MjViy6kyiqs[/youtube]

To help demonstrate the research, the team took a series of clips from The Slow Mo Guys, a popular slow-motion based science and technology entertainment YouTube series created by Gavin Free, starring himself and his friend Daniel Gruchy, and made their videos even slower.

The method can take everyday videos of life’s most precious moments and slow them down to look like your favorite cinematic slow-motion scenes, adding suspense, emphasis, and anticipation.

The researchers, which include Huaizu Jiang, Deqing Sun, Varun Jampani, Ming-Hsuan Yang, Erik Learned-Miller, and Jan Kautz, will present on Thursday, June 21 from 2:50 – 4:30 PM at CVPR.
Click to expand...

Source: Transforming Standard Video Into Slow Motion with AI - NVIDIA Developer News CenterNVIDIA Developer News Center

See also: https://arxiv.org/abs/1712.00080

:)

adzbowditch · Jun 19, 2018

no sound on slow motion video lumia 950

Hi, does anyone know if there is meant to be audio playback on slow motion video on Lumia 950? Sound works on standard video recording

sdpate · Jun 19, 2018

Videos showing in slow motion

Is there something wrong with YouTube today. Many of the videos are marked as not available for mobile and the videos that play are in slow motion.

Of course, this is with IE browser.

Even videos that are stored on the phone are running very slow.

I cleared the browser cache with no improvement.

First discovered watching video embedded on Huffington Post by effect is there on direct access to YouTube as well as embedded videos, Daily Motion and Vimeo

Billy Med · Jun 19, 2018

no sound on slow motion video lumia 950

Hi.

The audio playback feature for videos being played on slow motion is not available on Lumia 950.

We suggest that you put this on the feedback app for consideration on future updates.

Windows 10: NVIDIA Transforming Standard Video Into Slow Motion with AI

NVIDIA Transforming Standard Video Into Slow Motion with AI

NVIDIA Transforming Standard Video Into Slow Motion with AI

NVIDIA Transforming Standard Video Into Slow Motion with AI

NVIDIA Transforming Standard Video Into Slow Motion with AI - Similar Threads - NVIDIA Transforming Standard

Slow Motion

Slow Motion

random slow motion audio slow motion lagg

Laptop in slow motion.

microphone in slow motion

Slow Motion Booting

Error while saving slow motion video file

windows 10 slow motion online videos

Slow motion video / audio playback