Deep Learning not using GPU

Why is matlab not using GPU for deep learning, even though it says that it is?

Answer 1

[sanidhyak]

Hi Tanmay,

I understand that you are trying to train a deep learning model in MATLAB using GPU, but MATLAB is not utilizing the GPU effectively despite displaying that it is training on a single GPU.

This issue may arise due to multiple factors, such as GPU compatibility, execution settings, or memory limitations.

Please consider the following workarounds to enable utilization of the GPU:

• Run “gpuDevice” to ensure your GPU is CUDA-enabled and compatible with MATLAB. Verify GPU drivers and CUDA/cuDNN toolkit installation.
• Run the following command to explicitly use GPU:

options = trainingOptions('sgdm', 'ExecutionEnvironment', 'gpu'); 

• GPU Detection: Run “gpuDevice”. If not detected, restart MATLAB and reinstall CUDA/cuDNN.
• Increase batch size in “trainingOptions” to optimize GPU usage.
• Ensure the “Parallel Computing Toolbox” is installed for GPU support.
• Use “nvidia-smi” (Windows) or “watch -n 1 nvidia-smi” (Linux) to check GPU activity.

For further reference, kindly check MATLAB’s official GPU support documentation:

• https://www.mathworks.com/help/parallel-computing/gpu-support-by-release.html

Cheers & Happy Coding!