vangvassalos / nvidia-gpu-tensor-core-accelerator-pytorch-opencv

A complete machine vision container that includes Jupyter notebooks with built-in code hinting, Anaconda, CUDA-X, TensorRT inference accelerator for Tensor cores, CuPy (GPU drop in replacement for Numpy), PyTorch and OpenCV for accelerated workloads on NVIDIA Tensor cores and GPUs.

Containerized NVIDIA GPU/Tensor Core Accelerator for PyTorch + OpenCV

A complete machine vision container that includes Jupyter notebooks with built-in code hinting, Anaconda, CUDA-X, TensorRT inference accelerator for Tensor cores, CuPy (GPU drop in replacement for Numpy), PyTorch & OpenCV for accelerated workloads on NVIDIA Tensor cores and GPUs.

---

Features

• Anaconda: Accelerated Python, version 3.7.3
• CuPy: GPU accelerated drop in for Numpy
• OpenCV, latest version
• PyTorch with Torchvision for GPU, latest version
• NVIDIA TensorRT inference accelerator for Tensor core access and CUDA 10 for GPUs

Built in code hinting in Jupyter Notebook

Press tab to see what methods you have access to, sometimes you may want to show the Jupyter original complete temporally, then click shift + space.

Security Concern for Code Hinting

The enabled code hinting for the Juypter Notebook causes a known security breach, if security is a concern go into the Dockerfile and comment out line 119:

1. Line 119: RUN pip install jupyter-tabnine

2. Code hinting won't be installed, but this shores up/fixes the security exploit.

3. You can use the new VSCode and install the Python module which supports code hinting, as well as chart generation. It works no different than a jupyter notebook does, as an alternative option to presereve same dev features. Just open an existing project in VSCode at the /app folder level, and it will automatically do "hot-updates" and reload the container for you, as you save your work and run it from VSCode. (So don't worry, all the charts and things you're used to seeing in juypter will be generated in VSCode for you via the container).

---

Before you begin (This might be optional)

Link to nvidia-docker2 install: Tutorial

You must install nvidia-docker2 and all it's deps first, assuming that is done, run:

sudo apt-get install nvidia-docker2

sudo pkill -SIGHUP dockerd

sudo systemctl daemon-reload

sudo systemctl restart docker

How to run this container:

Step 1

docker build -t <container name> . < note the . after

Step 2

Run the image, mount the volumes for Jupyter and app folder for your fav IDE, and finally the expose ports 8888 for Jupyter Notebook:

docker run --rm -it --runtime=nvidia --user $(id -u):$(id -g) --group-add container_user --group-add sudo -v "${PWD}:/app" -p 8888:8888 <container name>

Step 3: Check to make sure GPU drivers and CUDA is running

• Exec into the container and check if your GPU is registering in the container and CUDA is working:

• Get the container id:

docker ps

• Exec into container:

docker exec -u root -t -i <container id> /bin/bash

• Check if NVIDIA GPU DRIVERS have container access:

nvidia-smi

• Check if CUDA is working:

nvcc -V

---

Known conflicts with nvidia-docker and Ubuntu

AppArmor on Ubuntu has sec issues, so remove docker from it on your local box, (it does not hurt security on your computer):

sudo aa-remove-unknown

---