Setup and installation of 'LocalAI: Self-Hosted Alternative to OpenAI & Anthropic' on AWS

This section describes how to launch and connect to “LocalAI: Self-Hosted Alternative to OpenAI & Anthropic” on AWS.

1. On the EC2 Console page, instance is up and running. To connect to this instance through putty, copy the IPv4 Public IP Address
   (refer Putty Guide for details on how to connect using putty/ssh))

2. Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to SSH->Auth, click on Open.

3. login as ubuntu.

4. run below command to update the password of ubuntu user.

sudo passwd ubuntu

5. To connect using RDP via Windows Machine, copy the public IP address of the VM from VM details page , then From your local windows machine, goto “start” menu, in the search box type and select “Remote desktop connection”. In the “Remote Desktop connection” wizard, copy the public IP address and click connect

6. This will connect you to the VM’s desktop environment. Provide the username as ubuntu and the password set in the step 4 to authenticate. Click OK

7. Now you are connected to the out of box “LocalAI: Self-Hosted Alternative to OpenAI & Anthropic” VM’s desktop environment via Windows Machine.

8. To access the LocalAI Web Interface, copy the public IP address of the VM and paste it in your local browser as https://public_ip_of_vm.

Browser will display an SSL certificate warning message. Expand the warning message, accept the certificate warning and Continue.

9. It will open a Signup page. Provide the Email-ID, Username and Password of your choice and click Create Admin Account button.

10. Now you are logged in to LocalAI Web Interface.