Skip to content
GPUFlow Documentation

Linux NVIDIA Setup

This guide covers Linux systems with NVIDIA GPUs. You will install either Docker or Podman, configure GPU passthrough, and deploy the GPUFlow provider.

Prerequisites

Section titled “Prerequisites”
  • NVIDIA GPU with 8GB+ VRAM
  • Ubuntu 22.04+, Fedora 39+, or Debian 12+
  • NVIDIA drivers installed and working

Step 1: Verify NVIDIA drivers

Section titled “Step 1: Verify NVIDIA drivers”

Check that your drivers are working:

Terminal window
nvidia-smi

You should see your GPU listed with driver version. If this command fails, install drivers first:

Terminal window
# Ubuntu/Debian
sudo apt update
sudo apt install nvidia-driver-535


# Fedora
sudo dnf install akmod-nvidia


# Reboot after installation
sudo reboot

Step 2: Choose container runtime

Section titled “Step 2: Choose container runtime”

Pick either Docker or Podman. Do not install both.

Docker (Recommended for beginners)

Easier setup, more tutorials online

Continue with Docker →

Podman (Recommended for security)

Rootless containers, better security

Continue with Podman →

What’s next

Section titled “What’s next”

After completing your container runtime setup, you will:

  1. Install NVIDIA Container Toolkit
  2. Configure GPU passthrough
  3. Deploy the GPUFlow provider agent
  4. Create your provider account