Mini-RAG

Local Retrieval Augmented Generation for your Obsidian notes

What is Mini-RAG?

Mini-RAG lets you chat with a locally running LLM, in the context of selected Obsidian notes and folders. For the LLM, you can select any locally installed Ollama model (see: Configure Mini-Rag).

Setting Up Mini-RAG

Install Ollama

If you don't already have Ollama installed, you can download and install Ollama here.

This is necessary because Mini-RAG relies on a locally running instance of Ollama for its responses. This is the same reason that Mini-RAG is currently a desktop-only plugin.

Configure Mini-RAG

Open "options" by clicking on the gear icon then navigate to Community Plugins > Mini-RAG > Options. Here you can set the:

• Ollama URL: If left unset, Ollama's default URL is used
• Model: From a dropdown list of AI Models installed on your local Ollama setup
• Temperature: Higher temperatures give more creative response, but also lead to more hallucinations
• Enable context-free chats: Provides the option to chat with an LLM without the context of a note or folder

Using Mini-RAG

Opening a Mini-RAG Chat

This is done from the right-click context menu. You will see the "Mini-RAG" option when you:

• Right-Click within a note
• Right-Click a note in the sidebar
• Right-Click a folder in the sidebar
• Open a note's triple-dot menu

Saving Conversations

To save a Mini-RAG conversation, click the "Save" button. If you continue the conversation after this, you will need to click "save" again to update the saved conversation.

Author

For more about the author visit JJWheatley.com