tcsenpai/ollama
1
0
Fork 0
mirror of https://github.com/tcsenpai/ollama.git synced 2025-06-11 05:27:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
ollama/server
History
Michael Yang 1b7183c5a1 enable metal gpu acceleration 
ggml-metal.metal must be in the same directory as the ollama binary
otherwise llama.cpp will not be able to find it and load it.

1. go generate llama/llama_metal.go
2. go build .
3. ./ollama serve
2023-07-06 16:34:44 -04:00
..
routes.go
enable metal gpu acceleration
2023-07-06 16:34:44 -04:00