Setup and installation of 'Hermes Agent – Build, Deploy & Scale Autonomous AI' on AWS

This section describes how to launch and connect to ‘Hermes Agent – Build, Deploy & Scale Autonomous AI’ VM solution on AWS.

1. Open Hermes Agent – Build, Deploy & Scale Autonomous AI VM listing on AWS marketplace.

2. Click on View purchase options.

• Login with your credentials and follow the instruction.
• Review the prices and subscribe to the product by clicking on subscribe button located at the bottom of this page. Once you are subscribed to the offer, click on Launch your software button.

• Next page will show you the options to launch the instance, Launch through EC2 and One-click launch from AWS Marketplace. Tick the 2nd option One-click launch from AWS Marketplace.

• Select a Region where you want to launch the VM(such as US East (N.Virginia))

• Optionally change the EC2 instance type. (This defaults to t2.xlarge instance type, 4 vCPUs and 16 GB RAM.)

Please note that the VM can also be deployed using NVIDIA GPU instance. If you want to deploy this instance with GPU configuration then Please choose NVIDIA GPU (e.g g4dn.xlarge) or check the available NVIDIA GPU instances on AWS documentation page.

• Optionally change the network name and subnetwork names.

• Select the Security Group. Be sure that whichever Security Group you specify have ports 22 (for SSH) and 443 (for HTTPS) exposed. Or you can create the new SG by clicking on “Create Security Group” button. Provide the name and description and save the SG for this instance.

• Be sure to download the key-pair which is available by default, or you can create the new key-pair and download it.

• Click on Launch..

• Hermes Agent – Build, Deploy & Scale Autonomous AI will begin deploying.

3. A summary page displays. To see this instance on EC2 Console click on View instance on EC2 link.

4. To connect to this instance through putty, copy the IPv4 Public IP Address from the VM’s details page.

5. Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to SSH->Auth->Credentials, click on Open. Enter ubuntu as userid

6. The VM will generate a random password to login to Hermes Web Interface. To get the password, connect via SSH terminal as shown in above step and run below command.

cat /home/ubuntu/.hermes/.env | grep HERMES_DASHBOARD_BASIC_AUTH

7. To access the Hermes Web Interface, copy the public IP address of the VM and paste it in your local browser as https://public_ip_of_vm. Make sure to use https and not http.

Browser will display an SSL certificate warning message. Expand the warning message, accept the certificate warning and Continue.

8. It will open a login page. Provide the password we got at above step and click Sign In.

9. Now you are connected to out of box Hermes Web Interface.

10. You can use the Hermes chat feature to run tasks or ask questions.

11. By default the LLM model set is “deepseek-r1:8b"h. You can pull other ollama models using.

ollama pull <model_name>

e.g ollama pull gemma2:9b

12. Once your model is pulled you can set it to default from web interface as well as from terminal. To switch model from web interface, simply click on model dropdown from the right top of your chat window. Choose the model you want to set and click Switch

or from terminal you can run,

hermes config set model <provider_name>/<model_name>

e.g hermes config set model ollama/gemma2:9b

13. To change the LLM provider and set the API Keys, please run below command.

hermes model

choose your provider of choice and follow the on screen instruction. Once the process is complete, go back to web interface and refresh the page to see the changes.

14. If for any ollama model you are getting context length error as shown in below screenshot, while running the chat then set the context_length and ollama_num_ctx to required value by running below commands in terminal then refresh the WebUI.

Note: This is specific to ollama, if you want to do it for other providers then make the appropriate changes in below commands.

 hermes config set model.ollama_num_ctx 65536

hermes config set model.context_length 65536

For more details, please visit Official Documentation page