Go back

Danswer: GPT to chat & query your own data on AWS


This section describes how to launch and connect to Techlatest Danswer VM solution on Amazon Web Services (AWS).

  1. Open Danswer:GPT to chat & query your own data VM listing on AWS marketplace

/img/aws/danswer/marketplace.png

  1. Click on Continue to subscribe.
  • Login with your credentials and follow the instruction.
  • On the subscription page, subscribe to the product and Click on Continue to configuration button on top right corner.
  • Select a Region where you want to launch the VM(such as US East (N.Virginia))

/img/aws/danswer/region.png

  • Click on Continue to Launch Button.
  • Choose Action: You can launch it through EC2 or from Website.(Let’s choose Launch from website)

/img/aws/danswer/launch.png

  • Optionally change the EC2 instance type. (This defaults to t2.xlarge instance type, 4 vCPUs and 16 GB RAM)
  • Optionally change the network name and subnetwork names.

/img/aws/blackarch-linux/vpc.png

  • Select the Security Group. Be sure that whichever Security Group you specify have ports 22 (for SSH), 3389 (for RDP) and 443 (for HTTPS) exposed. Or you can create the new Security Group by Clicking the Create New based on seller settings.
  • Be sure to download the key-pair which is available by default, or you can create the new key-pair and download it.

/img/aws/danswer/SG.png

  • Click on Launch..
  • Danswer:GPT to chat & query your own data will begin deploying.
  1. A summary page displays.To see this instance on EC2 Console click on EC2 Console link.

/img/aws/danswer/deployed.png

  1. On the EC2 Console page, instance is up and running. To connect to this instance through putty, copy the IPv4 Public IP Address

/img/aws/danswer/public-ip.png

  1. Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to **SSH->Auth **, click on Open.

/img/aws/ethereum-fullnode/putty-01.png

/img/aws/ethereum-fullnode/putty-02.png

  1. login as ubuntu.

/img/aws/danswer/ssh-login.png

  1. run below command to update the ubuntu password.
sudo passwd ubuntu

/img/aws/danswer/ubuntu-passwd.png

  1. Now the password for ubuntu user is set, you can connect to the VM’s desktop environment from any local windows machine using RDP protocol or local linux machine using Remmina.

  2. To connect using RDP via Windows Machine, first note the public IP address of the VM from VM details page as highlighted below

/img/aws/danswer/public-ip.png

  1. Then From you local windows machine, goto “start” menu, in the search box type and select “Remote desktop connection”.
    In the “Remote Desktop connection” wizard, copy the public IP address and click connect

/img/azure/ansible-awx/rdp.png

  1. This will connect you to the VM’s desktop environment. Provide the username (e.g “ubuntu”) and the password set in the step7 to authenticate. Click OK

/img/azure/ansible-awx/rdp-login.png

  1. Now you are connected to the out of box Danswer VM desktop environment via Windows Machine.

/img/gcp/puppet-support/rdp-desktop.png

  1. To connect using RDP via Linux machine, first note the external IP of the VM from VM details page,then from your local Linux machine, goto menu, in the search box type and select “Remmina”.

Note: If you don’t have Remmina installed on your Linux machine, firstInstall Remmina as per your linux distribution.

/img/gcp/common/remmina-search.png

  1. In the “Remmina Remote Desktop Client” wizard, select the RDP option from dropdown and paste the external ip and click enter.

/img/gcp/common/remmina-external-ip.png

  1. This will connect you to the VM’s desktop environment. Provide “ubuntu” as the userid and the password set in above reset password step to authenticate. Click OK

/img/gcp/common/remmina-rdp-login.png

  1. Now you are connected to out of box Danswer VM desktop environment via Linux machine.

/img/gcp/puppet-support/rdp-desktop.png

  1. To access the Danswer GUI environment via browser, Copy the Public IP address of the VM from the VM’s details page and enter the address as https://vm_public_ip/ in the browser. Hit enter.

Note: Please use https and not http in the URL when accessing Danswer GUI, e.g. https://35.223.255.180/

  1. While accessing GUI via browser, ssl certification warning will be shown.
  • On Firefox Browser, Click on Advanced and then select Accept the risk and Continue. /img/aws/danswer/accept-warning.png

  • On Chrome Browser, Click on Advanced and select the Proceed to … option.

/img/aws/danswer/chrome-warning-01.png

/img/aws/danswer/chrome-warning-02.png

  • On Edge Browser , click on Advanced and select the Proceed to … option.

/img/aws/danswer/edge-warning-01.png

/img/aws/danswer/edge-warning-02.png

  1. When accessing the UI for the first time , click on the create an account link on the login page, provide your email id and password and hit Sign Up button. This will create the first user with admin role.

Note: You can also limit the new user registration for specific domain. Please follow How to secure user registration page for more details.

/img/aws/danswer/create-account.png

/img/aws/danswer/sign-up.png

  1. After your first login, it will take you to the connector Page. You can choose any from the available list. Like Files connector here. Have the file uploaded from the selected connector. It will do indexing of the file.

/img/aws/danswer/add-connector.png

/img/aws/danswer/upload-file.png

  1. Note: On the initial visit, Danswer will prompt for an OpenAI API key. Without this Danswer will be able to provide search functionalities but not direct Question Answering. You can get it from OpenAI API key .

Once you have created your OpenAI API keys, Go to Danswer GUI, from the admin panel page , click on OpenAI tab in left panel. Add your keys here.

/img/aws/danswer/add-openai.png

  1. Once indexing of the uploaded file is complete and you have the API Key added, you can use search/chat functionality to query the document. To check the indexing status , go to Existing connector tab from admin menu.

/img/aws/danswer/connector-status.png

  1. Now you are good to go. Click on search tab to search for anything from the uploaded documents.

/img/aws/danswer/search-feature.png

  1. Click on Chat tab to start the Chat. You can also ask the follow up questions here.

/img/aws/danswer/chat-page.png

  1. You can also use public IPv4 DNS to access the Web UI. Copy the DNS address from the VM’s details page.

/img/aws/danswer/public-ipv4-dns.png

/img/aws/danswer/danswer-over-dns.png

  1. We recommend to reserve the Public IP address and make it static in order to access Danswer in browser over the same IP after VM restart.
  • Below are the steps for reserving public IP and making it static:
  • Note down the Availability Zone of Elastic IP cloud ide instance.

/img/aws/vscode/availability-zone-for-elastic-ip.png

  • In the left pane of EC2 go to Network & Security and select Elastic IPs option.

/img/aws/vscode/elastic-ip-option.png

  • On Elastic IPs page click on Allocate Elastic IP Address

/img/aws/vscode/allocate-elastic-ip-address.png

  • Select the Network Border Group as per the availability zone of the instance. Select Amazon’s pool of IPv4 addresses radio button and click on allocate.

/img/aws/vscode/Elastic-ip-address-setting.png

  • Once the Elastic IP is allocated, select the Elastic IP and under Actions dropdown select Associate Elastic IP address.

/img/aws/vscode/associate-elastic-ip.png

  • On this page select the instance radio button,enter Instance id, Private IP Adress of the VM and click Associate.

/img/aws/danswer/associate-elastic-ip-setting.png

  • Now go to the instance details page and navigate to Networking tab. Here you can see Elastic IP is associated to the instance.

/img/aws/danswer/danswer-instance-detail-page-elastic-ip.png

Go back