Go back

Hermes Agent — Private, GPU-Ready AI Automation on AWS, Azure and Google Cloud

Logo
About GCP Deployment Guide AWS Deployment Guide Azure Deployment Guide User Guide

Hermes Agent — Private, GPU-Ready AI Automation on AWS, Azure and Google Cloud

Hermes Agent VM for AWS, Azure and Google Cloud

Get a ready-to-use AI assistant that completes tasks, remembers useful information and automates everyday work. Use the included private local model, run a more powerful model on a GPU, or connect OpenAI, Anthropic or another popular model of your choice.

Overview

Hermes Agent is an AI assistant that can complete multi-step tasks, use tools, work with files and remember useful information. This ready-to-use cloud VM keeps Hermes separate from your personal computer and includes a local AI model for greater privacy. You can also use a larger local model on a compatible GPU or connect OpenAI, Anthropic or another popular model of your choice.

Available on: AWS Marketplace, Microsoft Azure Marketplace and Google Cloud Marketplace.

Publisher: TechLatest.net.

Primary use: Isolated, cloud-hosted autonomous AI with optional local inference.

Start with local AI out of the box

Hermes Agent, its browser dashboard, the Hermes CLI and Ollama are pre-installed on the VM. The latest best-performing local model is configured by default and runs on your cloud VM, so you can begin using Hermes after deployment without first configuring an external LLM service.

  • No third-party LLM API required: Use the configured local model without sending prompts to an external LLM provider.
  • GPU-ready local inference: Deploy a compatible NVIDIA GPU instance to run a more capable local model supported by your selected hardware.
  • Separate from your personal computer: Hermes runs on a dedicated cloud VM and does not automatically gain access to files, email or credentials on your personal device.
  • Choose another local model: Download a compatible open-source model through Ollama and configure it as your preferred Hermes model.

Why use the VM instead of a local installation?

Running an autonomous agent on a separate VM creates a clearer boundary between Hermes and the information stored on your personal computer. Hermes only receives the data, credentials and integrations that you deliberately add to the VM. This helps reduce accidental exposure of personal files, email and other sensitive information.

Privacy by default for local inference

When Hermes uses the configured Ollama model, the prompt does not need to be sent to a third-party LLM API. Network tools, websites, messaging services and other integrations may still transmit data when you choose to use them.

Scale to a more powerful local model with NVIDIA GPU

For larger or more capable local models, deploy the VM on a compatible NVIDIA GPU instance on AWS, Azure or Google Cloud. Pull the model you want through Ollama, then configure Hermes to use that Ollama model. Model compatibility, speed and capacity depend on the selected GPU, available GPU memory, system memory and model requirements.

ollama pull <model_name>

What is included

  • Hermes Agent browser dashboard and command-line interface
  • Ollama installed and ready to use
  • gemma4:e2b configured as the default local model
  • NVIDIA GPU software support pre-installed for compatible cloud GPU instances
  • Support for downloading and using other compatible Ollama models
  • Persistent memory, reusable skills and tool-based workflows
  • Step-by-step deployment guides for AWS, Azure and Google Cloud

Get started in three steps

  1. Choose AWS, Azure or Google Cloud.
  2. Deploy the VM using the TechLatest deployment guide.
  3. Open the Hermes dashboard and start using the configured local model.

Which cloud should I choose?

Cloud Choose it when
AWS Your workloads and billing already use AWS or EC2.
Azure Your organization manages workloads through Microsoft Azure.
Google Cloud Your workloads and service accounts are managed in Google Cloud.

Frequently asked questions


What is Hermes Agent?

Hermes Agent is an AI assistant that can complete multi-step tasks, use tools, work with files and remember useful information.


Can I use Hermes Agent without a third-party LLM API?

Yes. Ollama and the latest best-performing local model are configured by default, so you can start without an external LLM API key.


Can I run a larger local model?

Yes. Deploy a compatible NVIDIA GPU instance, pull a model supported by that hardware with Ollama, and configure Hermes to use it.


Does the VM keep all Hermes activity private?

Prompts processed by the local Ollama model do not need to go to a third-party LLM API, but external tools, websites, messaging services and integrations may transmit data when you enable them.


Why use a cloud VM instead of installing Hermes on my computer?

The VM creates a separate environment. Hermes does not automatically receive access to files, email or credentials stored on your personal computer; you choose what to add to the VM.


GPU instances generally have higher infrastructure costs than CPU instances. Local inference behavior and model compatibility depend on the chosen instance, GPU memory, model and configuration. Data may leave the VM when you enable external tools, websites, model providers or integrations.