tcsenpai/ollama
1
0
Fork 0
mirror of https://github.com/tcsenpai/ollama.git synced 2025-06-07 03:35:21 +00:00
Code Issues Packages Projects Releases Wiki Activity

add clip and parallel requests to the todo list

Browse Source
This commit is contained in:
jmorganca 2024-05-19 14:01:52 -07:00
parent 593d6836ab
commit e37651cca0
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
llama/README.md
View File

@ -2,6 +2,8 @@
This package integrates llama.cpp as a Go package that's easy to build with tags for different CPU and GPU processors.
Supported:
- [x] CPU
- [x] avx, avx2
- [ ] avx512
@ -10,6 +12,8 @@ This package integrates llama.cpp as a Go package that's easy to build with tags
- [x] Windows ROCm
- [ ] Linux CUDA
- [ ] Linux ROCm
- [ ] Clip
- [ ] Parallel Requests
Extra build steps are required for CUDA and ROCm on Windows since `nvcc` and `hipcc` both require using msvc as the host compiler. For these small dlls are created: