mirror of
https://github.com/tcsenpai/ollama.git
synced 2025-06-08 20:25:22 +00:00
Go
This commit is contained in:
parent
0998d4f0a4
commit
944bd13de1
@ -11,7 +11,7 @@ Run large language models with `llama.cpp`.
|
|||||||
- Download and run popular large language models
|
- Download and run popular large language models
|
||||||
- Switch between multiple models on the fly
|
- Switch between multiple models on the fly
|
||||||
- Hardware acceleration where available (Metal, CUDA)
|
- Hardware acceleration where available (Metal, CUDA)
|
||||||
- Fast inference server written in C++, powered by [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
- Fast inference server written in Go, powered by [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
||||||
- REST API to use with your application (python, typescript SDKs coming soon)
|
- REST API to use with your application (python, typescript SDKs coming soon)
|
||||||
|
|
||||||
## Install
|
## Install
|
||||||
|
Loading…
x
Reference in New Issue
Block a user