diff --git a/README.md b/README.md index 469ab1f..6b61648 100644 --- a/README.md +++ b/README.md @@ -59,12 +59,6 @@ python3 main.py ### 4️⃣ **Alternative: Run the Assistant (Own Server)** -On the other machine that will run the model execute the script in stream_llm.py - - -```sh -python3 stream_llm.py -``` Get the ip address of the machine that will run the model @@ -72,6 +66,12 @@ Get the ip address of the machine that will run the model ip a | grep "inet " | grep -v 127.0.0.1 | awk '{print $2}' | cut -d/ -f1 ``` +On the other machine that will run the model execute the script in stream_llm.py + +```sh +python3 stream_llm.py +``` + Change the `config.ini` file to set the `provider_name` to `server` and `provider_model` to `deepseek-r1:7b`. Set the `provider_server_address` to the ip address of the machine that will run the model. @@ -106,4 +106,4 @@ python3 main.py - Web browsing - Knowledge base RAG - Graphical interface -- Speech-to-text using distil-whisper/distil-medium.en \ No newline at end of file +- Speech-to-text using distil-whisper/distil-medium.en