Setup and installation of 'Open Notebook - The AI Podcast creator' on AWS

This section describes how to launch and connect to ‘Open Notebook - The AI Podcast creator’ VM solution on AWS.

1. Open Open Notebook - The AI Podcast creator VM listing on AWS marketplace.

2. Click on View purchase options.

• Login with your credentials and follow the instruction.
• Review the prices and subscribe to the product by clicking on subscribe button located at the bottom of this page. Once you are subscribed to the offer, click on Launch your software button.

• Next page will show you the options to launch the instance, Launch through EC2 and One-click launch from AWS Marketplace. Tick the 2nd option One-click launch from AWS Marketplace.

• Select a Region where you want to launch the VM(such as US East (N.Virginia))

• Optionally change the EC2 instance type. (This defaults to t2.xlarge instance type, 4 vCPUs and 16 GB RAM.)

• Optionally change the network name and subnetwork names.

• Select the Security Group. Be sure that whichever Security Group you specify have ports 22 (for SSH), 3389 (for RDP), 80 (for HTTP) and 443 (for HTTPS) exposed. Or you can create the new SG by clicking on “Create Security Group” button. Provide the name and description and save the SG for this instance.

• Be sure to download the key-pair which is available by default, or you can create the new key-pair and download it.

• Click on Launch..

• Open Notebook - The AI Podcast creator will begin deploying.

3. A summary page displays. To see this instance on EC2 Console click on View instance on EC2 link.

4. To connect to this instance through putty, copy the IPv4 Public IP Address from the VM’s details page.

5. Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to SSH->Auth->Credentials, click on Open. Enter ubuntu as userid

6. Once connected, change the password for ubuntu user using below command

sudo passwd ubuntu

7. Now the password for ubuntu user is set, you can connect to the VM’s desktop environment from any local Windows Machine using RDP protocol or Linux Machine using Remmina.

From your local windows machine, goto “start” menu, in the search box type and select “Remote desktop connection”. In the “Remote Desktop connection” wizard, copy the public IP address and click connect

8. This will connect you to the VM’s desktop environment. Provide the username “ubuntu” and the password set in the above “Reset password” step to authenticate. Click OK

9. Now you are connected to the out of box Open Notebook - The AI Podcast creator VM’s desktop environment via Windows Machine.

10. To connect using RDP via Linux machine, first note the external IP of the VM from VM details page, then from your local Linux machine, goto menu, in the search box type and select “Remmina”.

Note: If you don’t have Remmina installed on your Linux machine, first Install Remmina as per your linux distribution.

11. In the “Remmina Remote Desktop Client” wizard, select the RDP option from dropdown and paste the external ip and click enter.

12. This will connect you to the VM’s desktop environment. Provide “ubuntu” as the userid and the password set in above reset password step to authenticate. Click OK

13. Now you are connected to out of box Open Notebook - The AI Podcast creator VM’s desktop environment via Linux machine.

14. The VM will generate a random password to login to Open Notebook Web Interface as well as an encryption key for database access. To get the password, connect via SSH terminal as shown in above steps and run below command.

cat /home/ubuntu/open-notebook-local/open_notebook_credentials.txt

15. To access the Open Notebook Web Interface, copy the public IP address of the VM and paste it in your local browser as https://public_ip_of_vm. Make sure to use https and not http.

Browser will display a SSL certificate warning message. Expand the warning message, accept the certificate warning and Continue.

16. It will open a login page. Provide the password we got at step 14 above and click Sign In.

17. Now you are logged in to Open Notebook Web Interface.

18. The VM comes with “Ollama setup” and few models are already pulled for you to get started. To begin with the Open Notebook, first you need to configure the ollama models. To do so, Click on Models option from left menu and scroll down to Ollama section. Click on Add Configuration button.

19. Give a name to your configuration, leave API Key blank, for Base URL enter http://ollama:11434 . As the ollama is running in container make sure to enter Base URL as http://ollama:11434 and not http://localhost:11434.

20. Scroll up and you should see ollama successfully configured. Now next we need to add language and embedding models. For that click on models option as shown in the below screenshot.

21. Select Model Type as Language. By default following ollama models are already pulled on this VM. Select language model(s) from the list of available models.

22. Selected models will get added as shown below. Similarly again click on models option to add embedding models. Select Model Type as Embedding and tick mxbai-embed-large:latest from the list of available models.

Note: If you want to go with other LLM providers like OpenAI/Anthropic etc, then configure the same from this Models page.

23. Now we configured the ollama models, we need to set the default models. On the same Models page, scroll up to the top to Default Model Assignments section. Select various models from the dropdown.

24. Now you are all set to use Open Notebook. The basic workflow include, creating a new notebook with a detailed description (as detailed description helps LLM to understand the context of the notebook and provide you with better answers), add sources , gather insights from the added sources using transformations and finally talk to Assistant.

25. To add the sources, click on New from left menu and select Sources option. Choose from various options.

Click on Next to select the Notebook for this sources.

Click on Next and lastly select the Transformation option.

You can see the list of added sources here.

26. Once your sources are ready, you can use notebook, Ask and Search and Podcast features.

27. For Podcast feature, you will need some extra configuration. you will need to update the podcast profiles and need to provide the various models including voice. Once it is ready, go to podcast tab from left pane, clik on Generate podcast and provide the details here. For more details please refer to official documentation here

28. Lastly, to pull more ollama models on this VM, connect via SSH terminal and run below command.

sudo docker exec open-notebook-local-ollama-1 ollama pull <modelname>

e.g sudo docker exec open-notebook-local-ollama-1 ollama pull qwen2.5:latest

For more details, please visit Official Documentation page