19 Commits

Author	SHA1	Message	Date
Daniel Hiltgen	71b287264d	Fix parallel requests	2024-07-31 15:21:43 -07:00
jmorganca	2abf81885d	lint	2024-07-29 15:38:52 -07:00
jmorganca	ac090b6b71	fix issues with runner	2024-07-29 15:38:51 -07:00
jmorganca	028fda3582	cleanup stop code	2024-07-29 15:38:51 -07:00
jmorganca	a796b7aeaf	num predict	2024-07-29 15:38:51 -07:00
jmorganca	89cb4b8d6b	basic progress	2024-07-29 15:38:51 -07:00
jmorganca	0d365e8d34	add more runner params	2024-07-29 15:38:51 -07:00
jmorganca	72ff94efe0	truncate stop properly	2024-07-29 15:38:51 -07:00
jmorganca	240d4cf0aa	wip stop tokens	2024-07-29 15:38:51 -07:00
jmorganca	424627c347	embeddings	2024-07-29 15:38:51 -07:00
jmorganca	1a801fba2a	remove dependency on llm	2024-07-29 15:38:51 -07:00
jmorganca	727494ea54	grammar	2024-07-29 15:38:51 -07:00
jmorganca	b39fca7088	sampling	2024-07-29 15:38:51 -07:00
jmorganca	db55b1b89d	better example module, add port	2024-07-29 15:38:51 -07:00
jmorganca	1124e24aff	wip	2024-07-29 15:38:51 -07:00
jmorganca	df44d119a3	add llava to runner	2024-07-29 15:38:51 -07:00
jmorganca	878eb9a19f	add llava	2024-07-29 15:38:51 -07:00
jmorganca	4dd63c1fef	move runner package down	2024-07-29 15:38:51 -07:00
jmorganca	82214396b5	replace static build in llm	2024-07-29 15:38:51 -07:00