Nano vLLM

Pre-requires

• Adding a vGPU to a Proxmox VM
• or proxmox GPU PCI passthrough
• Install NVIDIA driver on ubuntu

VM setting

In VM → Hardware:

Click Display, set to Default (or VirtIO-GPU).

Edit your PCI Device (01:00.0) and UNTICK “Primary GPU”. Keep All Functions + PCI-Express checked.

Referernce List

1. https://github.com/GeeeekExplorer/nano-vllm