Inference with Torch-TensorRT Deep Learning Prediction for Beginners - CPU vs CUDA vs TensorRT
Hi everyone! 😀 In the last video we’ve seen how to accelerate the speed of our programs with Pytorch and CUDA - today we will take it another step further with Torch-TensorRT!
We will focus on a Machine Learning process called Inference (which is when the model is trained, perfected and ready to make a prediction).
For this we will load a state-of-the-art artificial neural network and we will use it to classify a picture of my cat! 🙀🙀🙀
Specifically - we will borrow ResNet50 for our little Pytorch experiment! 😉
We will also run a speed test comparing Pytorch models running on CPU, on CUDA and on Torch-TensorRT - which of these do you think is faster??
⏲️ TIMESTAMPS ⏲️
-----------------------------------
00:00 - intro
01:05 - clone Torch-TensorRT
01:40 - install and setup Docker
03:52 - install Nvidia Container Toolkit & Nvidia Docker 2
05:02 - Torch-TensorRT container (option #1)
07:22 - Torch-TensorRT Nvidia NGC container (option #2)
09:00 - import Pytorch
09:16 - load ResNet50
10:25 - load sample image
11
23 views
5
4
4 days ago 01:41:06 1
Alexander Gorban, University of Leicester. Topological Grammars and dimensionality reduction.
1 week ago 00:10:27 4
Tang Nano 20K vs Tang Nano 9K FPGA Board
1 week ago 00:19:14 1
Memristor-based Deep Spiking Neural Network with a Computing-In-Memory Architecture
1 week ago 00:59:48 2
[1hr Talk] Intro to Large Language Models
1 week ago 00:17:27 1
INTERIUS | short film
2 weeks ago 00:04:53 1
Surprising discovery of a river next to the pyramids
2 weeks ago 00:44:59 1
National Geographic - The Great Wall of China - Documentary
2 weeks ago 00:13:28 1
Charlie Parker - Funky Blues - August 20th, 1953
3 weeks ago 00:00:15 1
Chicken walking like a dinosaur
3 weeks ago 00:00:31 1
My Mother Told Me - Viking Chant with @PeytonParrish and @sampopemusic #basssinger #acappella
3 weeks ago 12:00:00 3
A Very Brief Analysis: The Phantom Menace
1 month ago 00:20:52 1
Free Houdini Tutorial: Volume Style Transfer With ONNX
1 month ago 00:14:20 1
Spider-Man: Return of the Sinister Six (NES) Playthrough - NintendoComplete
2 months ago 00:30:40 1
YOLOv5: How to Train a Object Detection Model on Custom Dataset
2 months ago 00:46:24 4
Ivan Komarov: Mastering Causal - Causal Inference in ML Track 2020
2 months ago 00:05:21 1
Hurrian Hymn To Nikkal / No. 6 (1400 BCE)
2 months ago 00:02:23 1
Iceland Volcano Shattered : KayOne Crater Walls Collapse, Lava Overflow Stopped From West Side