Setup and installation of NVIDIA CUDA Suit on Azure

This section describes how to provision and connect to NVIDIA CUDA Suit on Azure.

1. Open NVIDIA CUDA Suit VM listing on Azure Marketplace

2. Click on Get It Now. Login with your credentials if not logged in already. A pop up menu will appear, click on Continue button.

It will take you to the Product details page. Click on Create.

Select a Resource group for your virtual machine

Select a Region where you want to launch the VM(such as East US)

• Note: If you see “This image is not compatible with selected security type. To keep trusted launch virtual machines, select a compatible image. Otherwise change your security type back to Standard” error message below the Image name as shown in the screenshot below then please change the Security type to Standard.

Optionally change the number of cores and amount of memory.

Note: Make sure to select NVIDIA based GPU instance for the deployment. The VM can only be deployed using NVIDIA GPU instance.

GPU availability is limited to certain region and zones

NOTE: While deploying the instance on GPU, if you encounter the quota exhaust error or you are unable to deploy the instance on GPU VM then please refer to our Request Quota on Azure Cloud Platform

Select the Authentication type as Password and enter Username as ubuntu and Password of your choice. Click on Next.

Optionally change the OS disk type. Click on Next.

Optionally change the network and subnetwork names. Be sure that whichever network you specify has ports 22 (for ssh) and 3389 (for RDP) exposed.

The VM comes with the preconfigured NSG rules. You can check them by clicking on Create New option available under the security group option.

Optionally go to the Management, Advanced and Tags tabs for any advance settings you want for the VM.

Click on Review + create and then click on Create when you are done.
Virtual Machine will begin deploying.

3. A summary page displays when the virtual machine is successfully created. Click on Go to resource link to go to the resource page. It will open an overview page of virtual machine.

4. If you want to update your password, go to the left navigation pane, select Run command, select RunShellScript and enter following command to change the password of the vm .

sudo echo ubuntu:yourpassword | chpasswd

Now the password for ubuntu user is set, you can SSH to the VM. To do so, first note the public IP address of the VM from VM details page as highlighted below

Open putty, paste the IP address and click on Open.

login as ubuntu and provide the password for ‘ubuntu’ user.

5. You can also connect to the VM’s desktop environment from any local windows machine using RDP protocol or local linux machine using Remmina.

6. To connect using RDP via Windows Machine, note the public IP of the VM.

7. Then From you local windows machine, goto “start” menu, in the search box type and select “Remote desktop connection”.
   In the “Remote Desktop connection” wizard, copy the public IP address and click connect

8. This will connect you to the VM’s desktop environment. Provide the username (e.g “ubuntu”) and the password set in the step4 to authenticate. Click OK

9. Now you are connected to the out of box NVIDIA CUDA Suit environment via Windows Machine.

10. To connect using RDP via Linux machine, first note the external IP of the VM from VM details page,then from your local Linux machine, goto menu, in the search box type and select “Remmina”.

Note: If you don’t have Remmina installed on your Linux machine, firstInstall Remmina as per your linux distribution.

11. In the “Remmina Remote Desktop Client” wizard, select the RDP option from dropdown and paste the external ip and click enter.

12. This will connect you to the VM’s desktop environment. Provide “ubuntu” as the userid and the password set in above reset password step to authenticate. Click OK

13. Now you are connected to out of box NVIDIA CUDA Suit environment via Linux machine.

14. The VM comes with various NVIDIA utilities and Cuda utilities installed out of the box. To access the Nvidia Nsight Compute , open the terminal from the RDP desktop window and run below command. This command will launch the Nsight Compute user interface.

ncu-ui

15. To access the Nvidia Nsight System ,open the terminal from the RDP desktop window and run below command. This command will launch the Nsight System user interface.

nsys-ui

16. You can also monitor the GPU utilization of these utilites. To do so, open the new terminal window and run

watch -n 1 nvidia-smi

17. You can find the nsight compute and nsight system setup under /opt/nvidia/ directory.

18. The VM comes with various Nvidia utilies installed out of the box.

19. The VM also comes with various CUDA utilies installed out of the box.

20. Below is the CUDA installation directory

/usr/local/cuda-12.4/

21. All cuda utilities are installed under

/usr/local/cuda-12.4/bin

22. The VM also comes with the “Nsight compute visual studio code Edition” extension installed out of the box.

Please refer to NVIDIA official documentation for more details on how to use these tools.

NVIDIA Official Documentation