Go back

Setup and installation of 'GPU Supported DeepSeek & Llama powered All-in-One LLM Suite' on AWS

  1. On the EC2 Console page, instance is up and running. To connect to this instance through putty, copy the IPv4 Public IP Address. (refer Putty Guide available at https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/connect-linux-inst-from-windows.html for details on how to connect using putty/ssh).

  2. Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to SSH- >Auth->Credentials , click on Open.

  3. Login as ubuntu user.

  4. Update the password of ubuntu user using below command :

 sudo passwd ubuntu
  1. Once ubuntu user password is set, access the GUI environment using RDP on Windows machine or Remmina on Linux machine.

  2. Copy the Public IP of the VM and paste it in the RDP. Login with ubuntu user and its password.

  3. To access the Open-WebUI , open your browser and copy paste the public IP of the VM as https://public_ip_of_vm . Accept the browser SSL Warning and continue to next page.

  4. Click on Get Started Link at the bottom and Create your first admin account on the registration page.

/img/aws/multi-llm-vm/open-webui-get-started.png

/img/aws/multi-llm-vm/open-webui-registration-page.png

Go back