Daniel Hiltgen 71b287264d Fix parallel requests

2024-07-31 15:21:43 -07:00

..

ext_server

update llama.cpp submodule to 6eeaeba1 (#6039)

2024-07-29 13:20:26 -07:00

generate

Fix parallel requests

2024-07-31 15:21:43 -07:00

llama.cpp@6eeaeba126

update llama.cpp submodule to 6eeaeba1 (#6039)

2024-07-29 13:20:26 -07:00

patches

update llama.cpp submodule to 6eeaeba1 (#6039)

2024-07-29 13:20:26 -07:00

filetype.go

revert llm changes

2024-07-29 15:38:51 -07:00

ggla.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

ggml_test.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

ggml.go

revert llm changes

2024-07-29 15:38:51 -07:00

gguf.go

add chat and generate tests with mock runner

2024-07-16 09:39:31 -07:00

llm_darwin_amd64.go

Enable windows error dialog for subprocess startup

2024-07-22 14:07:27 -07:00

llm_darwin_arm64.go

Enable windows error dialog for subprocess startup

2024-07-22 14:07:27 -07:00

llm_linux.go

Enable windows error dialog for subprocess startup

2024-07-22 14:07:27 -07:00

llm_windows.go

Enable windows error dialog for subprocess startup

2024-07-22 14:07:27 -07:00

llm.go

Update sync with latest llama.cpp layout, and run against b3485

2024-07-31 09:50:39 -07:00

memory_test.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

memory.go

handle asymmetric embedding KVs

2024-06-20 09:57:27 -07:00

payload.go

Fix corner cases on tmp cleaner on mac

2024-07-03 13:10:14 -07:00

server.go

feat: add support for min_p (resolve #1142) (#1825)

2024-07-27 14:37:40 -07:00

status.go

fix error detection by limiting model loading error parsing (#5472)

2024-07-03 20:04:30 -04:00