143 Commits

Author	SHA1	Message	Date
arkohut	378e5bf445	feat: support modelscope	2024-09-10 01:32:00 +08:00
arkohut	241911d1d2	feat(index): use different bs for embedding	2024-09-10 00:58:57 +08:00
arkohut	f5aae87f40	feat: use concurrency of 1 by default	2024-09-10 00:54:20 +08:00
arkohut	41c7e136d9	fix: skip flash attn ... https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-10 00:31:56 +08:00
arkohut	a30fe62bc3	fix: yaml parse related	2024-09-09 23:39:04 +08:00
arkohut	3912d165f6	Revert "fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d" ... This reverts commit 5b1194f1bc6ad055fe69a9a2207ef1c31cc73721.	2024-09-09 23:27:40 +08:00
arkohut	5b1194f1bc	fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-09 22:26:48 +08:00
arkohut	6107c22def	fix: support parse secret	2024-09-09 22:26:26 +08:00
arkohut	81ba2cd2d2	feat: add default library and command shortcuts for it	2024-09-09 20:58:06 +08:00
arkohut	7e43bc0861	feat(ml_backend): move florence 2 as a default vlm plugin	2024-09-09 20:30:58 +08:00
arkohut	d7e6c32e86	feat: init default library	2024-09-09 19:57:07 +08:00
arkohut	69aca0153a	feat: make embedding a default plugin	2024-09-09 19:43:17 +08:00
arkohut	dbbc2792ef	feat: enable baisc auth	2024-09-06 18:18:18 +08:00
arkohut	e062636c08	feat(ocr): update import flow	2024-09-05 18:15:27 +08:00
arkohut	80c261ba8a	feat: add ml backend server	2024-09-03 23:37:23 +08:00
arkohut	a9f34b09d4	feat(index): do not add ocr for embedding	2024-09-03 18:36:08 +08:00
arkohut	e99792a974	feat(vlm): force jpeg option	2024-09-03 18:35:41 +08:00
arkohut	2b2d616775	feat(ocr): support local paddleocr	2024-09-01 22:40:20 +08:00
arkohut	d3b45ad197	feat: enable config.yaml	2024-09-01 19:01:49 +08:00
arkohut	1a08a44a4d	fix(index): ignore empty text for embedding	2024-08-29 21:38:01 +08:00
arkohut	2135b11f6c	chore: hidden vector content for search param log	2024-08-29 21:16:36 +08:00
arkohut	7fbb05e0cd	feat: add force indexing	2024-08-29 21:16:15 +08:00
arkohut	2f844eae80	chore: typo	2024-08-29 19:00:57 +08:00
arkohut	49879ad20e	fix: use global import	2024-08-29 18:02:51 +08:00
arkohut	a448fd0c9a	feat: support initialization	2024-08-29 17:47:14 +08:00
arkohut	0970e73da5	feat: make server host configurable	2024-08-29 17:01:02 +08:00
arkohut	75bb7aeef9	feat: update default config for embedding and vlm	2024-08-29 16:49:44 +08:00
arkohut	9db92908a6	feat(indexing): do not repeatly indexing updated entity by last_scan_at	2024-08-29 13:57:46 +08:00
arkohut	439adfa955	feat: support cascade delete entity	2024-08-29 13:24:23 +08:00
arkohut	16ef927c38	feat(indexing): manully control embedding generation	2024-08-29 13:24:00 +08:00
arkohut	abfc2814cf	feat: make server port configurable	2024-08-29 13:11:26 +08:00
arkohut	290636ca08	feat(indexing): make some fields optional	2024-08-27 23:34:57 +08:00
arkohut	b10b080800	fix(ollama): make vlm plugin support ollama	2024-08-25 16:49:48 +08:00
arkohut	67a5e10d3e	feat(plugins): add ocr as build plugin	2024-08-25 16:49:48 +08:00
arkohut	ec7ba1f989	feat(plugin): allow unbind plugin	2024-08-25 16:49:48 +08:00
arkohut	cead5d9755	feat(plugin): add vlm plugin	2024-08-25 16:49:48 +08:00
arkohut	4b9b2ce8e1	fix(typesense): no sort for tags	2024-08-23 23:25:17 +08:00
arkohut	420d972513	fix(webp): failed to save metadata for webp	2024-08-23 18:25:19 +08:00
arkohut	0d371d759e	fix: use str instead of path	2024-08-22 10:00:20 +08:00
arkohut	9a38b0c17d	fix: update utils import	2024-08-21 23:22:58 +08:00
arkohut	15972b9c0f	feat: use utiles for read metadata	2024-08-21 21:21:32 +08:00
arkohut	b3e73e4c40	feat(screen-recorder): generate video from webp	2024-08-21 21:21:32 +08:00
arkohut	b53d816b17	feat(typesense): use ollama bge m3	2024-08-21 08:48:55 +08:00
arkohut	1d4faf2652	fix: skip system files in screenshots folder	2024-08-21 08:35:20 +08:00
arkohut	9267fdc018	feat(indexing): add sort for fields	2024-08-21 00:12:54 +08:00
arkohut	11e447bcbb	feat(indexing): support facet	2024-08-21 00:12:31 +08:00
arkohut	2cf75bee7f	feat(index): extract collection name to settings	2024-08-20 18:35:35 +08:00
arkohut	f0dfaf387e	feat(index): add date month year for index	2024-08-20 13:18:34 +08:00
arkohut	1d10b0ef7b	fix(indexing): do not check entity exists when delete index	2024-08-20 13:18:05 +08:00
arkohut	ef2022fa10	feat(screen-recorder): insert tag of app name	2024-08-20 13:17:22 +08:00