Need Help with GPU Acceleration in PyTorch

Hello everyone,

I am currently working on a computer vision project where GPU acceleration is crucial for performance. Despite activating the GPU through the green icon in the top right corner of my Studio environment, Torch indicates that CUDA is not available (torch.cuda.is_available() returns False). Here are the details of my setup and the issue I’m encountering:

System Information:

  • CUDA Compiler Version: nvcc reports CUDA compilation tools release 12.4.
  • GPU Information: According to lspci, my system has an NVIDIA Tesla T4 GPU (revision a1).
  • NVIDIA Driver and CUDA Version: nvidia-smi reports NVIDIA Driver Version 535.183.06 and CUDA Version 12.2.

Current GPU Status:

  • nvidia-smi Output:
    +---------------------------------------------------------------------------------------+
    | NVIDIA-SMI 535.183.06             Driver Version: 535.183.06   CUDA Version: 12.2     |
    |-----------------------------------------+----------------------+----------------------+
    | GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
    | Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
    |                                         |                      |               MIG M. |
    |=========================================+======================+======================|
    |   0  Tesla T4                       Off | 00000000:00:1E.0 Off |                    0 |
    | N/A   31C    P8               9W /  70W |      0MiB / 15360MiB |      0%      Default |
    |                                         |                      |                  N/A |
    +-----------------------------------------+----------------------+----------------------+
                                                                                           
    +---------------------------------------------------------------------------------------+
    | Processes:                                                                            |
    |  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
    |        ID   ID                                                             Usage      |
    |=======================================================================================|
    |  No running processes found                                                           |
    +---------------------------------------------------------------------------------------+