GPU-enabled VMs support GPU passthrough (directly allocating physical GPUs to a VM) and GPU splitting (splitting a GPU into multiple vGPUs that are allocated to multiple VMs). These VMs are ideal for graphics-intensive and compute-intensive service scenarios, such as 3D graphics rendering, AI deep learning, and database acceleration. China-made GPUs (such as Cambricon MLU370 and Huawei Atlas 300V Pro) are supported for GPU passthrough. To enable GPU passthrough, install the corresponding GPU drivers first. To enable GPU splitting, obtain NVIDIA licenses (vWS or vCS) first. For details about compatibility, visit the following link:[1]
Common Features of GPU-Enabled VMs
Feature
Supported or Not
Offline Specification Change
Yes. You can change CPU and memory specifications, and add and remove GPUs (when VMs are powered off).
Online Specification Change
Yes. You can only increase the number of CPUs and the memory size. To change GPU specifications (GPU passthrough or splitting), power off the VM first.
Cold Migration (Run Location)
Yes. The source and destination nodes must use the same model of GPUs and the same GPU splitting configuration (vGPUs must be of the same size).
Live Migration (Run Location)
No. Live migration is not supported for VMs allocated with GPUs (through GPU passthrough or splitting).
HA
Yes. Other nodes in the cluster must have available GPU resources (same model and splitting configuration).
VM Snapshot
Yes. To create snapshots for VMs allocated with vGPUs, ensure the node where the VMs reside has sufficient GPU resources. The snapshots of VMs with GPU passthrough enabled do not contain GPU configuration.
Cloning
Yes. GPU resources need to be reallocated after the cloning. (Obtain licenses for GPU splitting again or reconnect to GPUs for GPU passthrough.)
vGPU Licensing
Yes. NVIDIA licensing (vWS or vCS) is required to split an NVIDIA GPU into vGPUs. No additional licensing is required to split a China-made GPU into vGPUs.
Multi-GPU Allocation
Yes. Up to 8 GPUs (such as NVIDIA Tesla T4 and GeForce RTX 2080Ti GPUs) can be directly connected to a VM through GPU passthrough.