Compute Setup#

The following platforms are supported. Depending on what platform you are installing on, follow the instructions on that tab.

Prepare a NVIDIA-powered platform with the following minimum specs:
- Ubuntu 22.04+
  - Experimental: WSL2 on Windows 11
- 16 GB general RAM
- Discrete NVIDIA GPU with the following specs:
  - supports CUDA 12.6+ with Ampere NVIDIA GPU Architecture or newer
  - minimum 8GB of VRAM and recommended 12GB+
  Note
  
  Various DNN models when loaded together can consume more memory than you may have available.
Install Docker from official instructions. Recommended 27.2.0 or newer.
Install the latest NVIDIA GPU Driver from official instructions. Minimum 560+ is required, see release notes.

Install Jetpack including the nvidia-container package.
After boot, confirm that you have installed the correct version of Jetpack by running the following command. Confirm that the output has the terms R36 (release), REVISION: 4.0.
```
cat /etc/nv_tegra_release
```
Run the following command to set the GPU and CPU clock to max. See Maximizing Jetson Performance for more details.
```
sudo /usr/bin/jetson_clocks
```
Run the following command to set the to power to MAX settings. See Power Mode Controls for more details.
```
sudo /usr/sbin/nvpmodel -m 0
```

Add your user to the docker group.

sudo usermod -aG docker $USER
newgrp docker

Setup Docker.

From the official Docker install instructions (here), install the docker-buildx-plugin.

# Add Docker's official GPG key:
sudo apt-get update
sudo apt-get install ca-certificates curl gnupg
sudo install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/keyrings/docker.gpg
sudo chmod a+r /etc/apt/keyrings/docker.gpg

# Add the repository to Apt sources:
echo \
"deb [arch="$(dpkg --print-architecture)" signed-by=/etc/apt/keyrings/docker.gpg] https://download.docker.com/linux/ubuntu \
"$(. /etc/os-release && echo "$VERSION_CODENAME")" stable" | \
sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt-get update

sudo apt install docker-buildx-plugin

Add Extra Jetson Storage#

If your chosen platform is Jetson, consider adding more storage for a better experience. The following links provide some instruction and options for doing so: