4 Commits

Author	SHA1	Message	Date
Daniel Hiltgen	8da7bef05f	Support multiple variants for a given llm lib type ... In some cases we may want multiple variants for a given GPU type or CPU. This adds logic to have an optional Variant which we can use to select an optimal library, but also allows us to try multiple variants in case some fail to load. This can be useful for scenarios such as ROCm v5 vs v6 incompatibility or potentially CPU features.	2024-01-10 17:27:51 -08:00
Jeffrey Morgan	2c6e8f5248	Update submodule to 6efb8eb30e7025b168f3fda3ff83b9b386428ad6 (#1885) ... * update submodule to `6efb8eb30e7025b168f3fda3ff83b9b386428ad6` * unblock condition variable in `update_slots` when closing server	2024-01-10 16:48:38 -05:00
Jeffrey Morgan	dbdd50b283	add -DCMAKE_SYSTEM_NAME=Darwin cmake flag (#1832)	2024-01-07 00:46:17 -05:00
Daniel Hiltgen	77d96da94b	Code shuffle to clean up the llm dir	2024-01-04 12:12:05 -08:00