From f4b3bc788e99364a490572c4aaa69861d196ad21 Mon Sep 17 00:00:00 2001 From: Martin <49105846+Fosowl@users.noreply.github.com> Date: Sun, 2 Mar 2025 22:15:15 +0100 Subject: [PATCH 1/2] Update README.md --- README.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index e619ef4..5075c6c 100644 --- a/README.md +++ b/README.md @@ -21,13 +21,15 @@ ## Installation ### 1️⃣ **Install Dependencies** -Make sure you have [Ollama](https://ollama.com/) installed, then run: + ```sh pip3 install -r requirements.txt ``` ### 2️⃣ **Download Models** +Make sure you have [Ollama](https://ollama.com/) installed. + Download the `deepseek-r1:7b` model from [DeepSeek](https://deepseek.com/models) ```sh @@ -105,4 +107,4 @@ python3 main.py - Web browsing - Knowledge base RAG - Graphical interface -- Speech-to-text using distil-whisper/distil-medium.en \ No newline at end of file +- Speech-to-text using distil-whisper/distil-medium.en From 32a9918123b39cfd969faf6ffc06d267b6d53eef Mon Sep 17 00:00:00 2001 From: Martin <49105846+Fosowl@users.noreply.github.com> Date: Sun, 2 Mar 2025 22:16:24 +0100 Subject: [PATCH 2/2] Update README.md --- README.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 5075c6c..5dc2a70 100644 --- a/README.md +++ b/README.md @@ -60,12 +60,6 @@ python3 main.py ### 4️⃣ **Alternative: Run the Assistant (Own Server)** -On the other machine that will run the model execute the script in stream_llm.py - - -```sh -python3 stream_llm.py -``` Get the ip address of the machine that will run the model @@ -73,6 +67,12 @@ Get the ip address of the machine that will run the model ip a | grep "inet " | grep -v 127.0.0.1 | awk '{print $2}' | cut -d/ -f1 ``` +On the other machine that will run the model execute the script in stream_llm.py + +```sh +python3 stream_llm.py +``` + Change the `config.ini` file to set the `provider_name` to `server` and `provider_model` to `deepseek-r1:7b`. Set the `provider_server_address` to the ip address of the machine that will run the model.