Vcloudai: /* NVidia driver installation */

2025-05-30T06:13:25Z

NVidia driver installation

← Older revision		Revision as of 07:13, 30 May 2025
Line 8:		Line 8:
	4. Update docker-compose config		4. Update docker-compose config

	=== ~~NVidia~~ driver installation ===		=== NVIDIA driver installation ===

	==== Install CUDA Keyring and update the system ====		==== Install CUDA Keyring and update the system ====

Vcloudai: /* NVidia drive installation */

2025-05-30T06:13:10Z

NVidia drive installation

← Older revision		Revision as of 07:13, 30 May 2025
Line 8:		Line 8:
	4. Update docker-compose config		4. Update docker-compose config

	=== NVidia ~~drive~~ installation ===		=== NVidia driver installation ===

	==== Install CUDA Keyring and update the system ====		==== Install CUDA Keyring and update the system ====

Vcloudai: Created page with "=== What you require === 1. OS: Ubuntu 22.04 2. Nvidia GPU 3. Driver Version: 550 (check if the driver is installed correctly using: lspci | grep -i nvidia) 4. Update docker-compose config === NVidia drive installation === ==== Install CUDA Keyring and update the system ==== sudo apt-get update && apt-get upgrade -y wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb sudo dpkg -i cuda-keyr..."

2025-05-30T06:12:53Z

Created page with "=== What you require === 1. OS: Ubuntu 22.04 2. Nvidia GPU 3. Driver Version: 550 (check if the driver is installed correctly using: lspci | grep -i nvidia) 4. Update docker-compose config === NVidia drive installation === ==== Install CUDA Keyring and update the system ==== sudo apt-get update && apt-get upgrade -y wget <nowiki>https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb</nowiki> sudo dpkg -i cuda-keyr..."

New page

=== What you require ===
1. OS: Ubuntu 22.04

2. Nvidia GPU

3. Driver Version: 550 (check if the driver is installed correctly using: lspci | grep -i nvidia)

4. Update docker-compose config

=== NVidia drive installation ===

==== Install CUDA Keyring and update the system ====
sudo apt-get update && apt-get upgrade -y

wget <nowiki>https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb</nowiki>

sudo dpkg -i cuda-keyring_1.1-1_all.deb

sudo apt-get update
''*If Secure boot is enabled, use signed drivers (550-open)''

==== Install the CUDA Toolkit and required drivers ====
sudo apt-get -y install cuda-toolkit-12-4

sudo apt-get install -y nvidia-driver-550-open

sudo apt-get install -y cuda-drivers-550

==== Install NVIDIA Docker ====
sudo apt-get install -y nvidia-docker2

==== Edit Docker daemon.json to use NVIDIA runtime ====
<blockquote>nano /etc/docker/daemon.json

{

"log-driver": "json-file",

"log-opts": {

   "max-size": "100m",

   "max-file": "3"

},

"default-runtime": "nvidia",

"runtimes": {

   "nvidia": {

   "path": "/usr/bin/nvidia-container-runtime",

   "runtimeArgs": []

   }

}

}</blockquote>

==== Share CUDA Drivers by setting environment variables ====
sudo systemctl restart docker

export PATH=/usr/local/cuda-12.4/bin:$PATH

export LD_LIBRARY_PATH=/usr/local/cuda-12.4/lib64:$LD_LIBRARY_PATH

=== Prepare the VMS ===

==== Amend the ai part in docker-compose.yml ====
<blockquote>nano docker-compose.yml

ai:

   image: vcloudaiorg/vcloudai-vms-ai:latest

   container_name: ai

   restart: always

   privileged: true

   volumes:

   - ./static/customAIModels:/app/Models/customAIModels

   - ./static/customAIstatic:/app/static

   - ./static/customAIStorage:/app/Storage

   - /etc/timezone:/etc/timezone

   - /etc/localtime:/etc/localtime

   network_mode: host

   depends_on:

   - appback

   - appfont

   environment:

   MYSQL_HOST: ${MACHINE_HOST}

   MYSQL_USER: ${MYSQL_USER}

   MYSQL_PASSWORD: ${MYSQL_PASSWORD}

   MYSQL_DB: ${MYSQL_DB}

   EXTERNAL_MYSQL_PORT: ${EXTERNAL_MYSQL_PORT}

   MACHINE_HOST: ${MACHINE_HOST}

   APP_HOST: ${APP_HOST}

   SERVER_PORT: ${LOCAL_PORT}

   SECRET_WORD: ${SECRET_WORD}

   AI_PORT: ${AI_PORT}

   NVIDIA_VISIBLE_DEVICES: all

   NVIDIA_DRIVER_CAPABILITIES: all

   runtime: nvidia

   deploy:

   resources:

   reservations:

   devices:

   - driver: nvidia

   count: all

   capabilities: [gpu]</blockquote>

==== Save and restart ai container ====
docker-compose down ai

docker-compose up ai -d

How to enable GPU for AI in Linux - Revision history

Vcloudai: /* NVidia driver installation */

Vcloudai: /* NVidia drive installation */