Sam e15307fdf4

feat: add support for flash_attn (#4120) ...

* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: add flash_attn support

2024-05-20 13:36:03 -07:00

..

CMakeLists.txt

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

httplib.h

Import server.cpp as of b2356

2024-03-12 13:58:06 -07:00

json.hpp

Import server.cpp as of b2356

2024-03-12 13:58:06 -07:00

server.cpp

feat: add support for flash_attn (#4120)

2024-05-20 13:36:03 -07:00

utils.hpp

log clean up

2024-05-09 14:55:36 -07:00