Setup and installation of LLaMa Factory on AWS

1. On the EC2 Console page, instance is up and running. To connect to this instance through putty, copy the IPv4 Public IP Address ( refer Putty Guide for details on how to connect using putty/ssh).

2. Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to SSH- >Auth, click on Open.

3. login as ubuntu.

4. Set the password of Ubuntu user using:

sudo passwd ubuntu

5. Open Remote Desktop client from your Windows machine (or Remmina if you are on Linux system), copy paste the public ip of the VM. Login with same “ubuntu” user and password set in above step.

6. The VM will generate a random password to login to LLaMa Factory Web Interface. To get the password, connect via SSH terminal as shown in above steps and run below command.

cat llama-factory-passwd.txt

Here username is admin with random password.

7. To access the Llama Factory Web Interface, copy the public IP address of the VM and paste it in your local browser as https://public_ip_of_vm. Make sure to use https and not http.

Browser will display a SSL certificate warning message. Accept the certificate warning and Continue.

8. Provide the ‘admin’ user and its password we got in above step.

9. Now you are logged in to LLaMa Factory Web Interface. Here you can select different values and train/chat/evaluate the models.