tcsenpai/ollama
1
0
Fork 0
mirror of https://github.com/tcsenpai/ollama.git synced 2025-06-08 12:15:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Jeffrey Morgan 2024-05-18 19:49:43 -07:00 committed by jmorganca
parent 870e91be76
commit 02089baf70
1 changed files with 11 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
llama/README.md
View File

@ -44,12 +44,13 @@ go build -tags=avx2 .
Install the [CUDA toolkit v11.3.1](https://developer.nvidia.com/cuda-11-3-1-download-archive) then build ggml-cuda: Install the [CUDA toolkit v11.3.1](https://developer.nvidia.com/cuda-11-3-1-download-archive) then build ggml-cuda:
Build `ggml-cuda.dll`:
```shell ```shell
# builds ggml-cuda.dll
./cuda.sh ./cuda.sh
``` ```
Then build this package with the `cuda` tag: Then build the package with the `cuda` tag:
```shell ```shell
go build -tags=cuda . go build -tags=cuda .
@ -57,17 +58,24 @@ go build -tags=cuda .
### ROCm ### ROCm
Install [ROCm 5.7.1](https://rocm.docs.amd.com/en/docs-5.7.1/) and [Strawberry Perl](https://strawberryperl.com/):
Build `ggml-hipblas.dll`:
```shell ```shell
# builds ggml-hipblas.dll
./hipblas.sh ./hipblas.sh
``` ```
Then build the package with the `rocm` tag:
```shell ```shell
go build -tags=rocm . go build -tags=rocm .
``` ```
## Syncing with llama.cpp ## Syncing with llama.cpp
To update this package to the latest llama.cpp code, use the `sync.sh` script.
``` ```
./sync.sh ../../llama.cpp ./sync.sh ../../llama.cpp
``` ```