158 Commits

Author	SHA1	Message	Date
arkohut	04621f74ff	feat: merge memos-record into memos	2024-09-28 23:28:43 +08:00
arkohut	228cdee66f	feat: remove local inference for ocr and vlm	2024-09-27 23:29:52 +08:00
arkohut	bd27bbae25	chore: bump 0.6.14	2024-09-20 00:28:27 +08:00
arkohut	a47ee00e59	feat(ocr): use multiple process for ppocr	2024-09-19 22:12:35 +08:00
arkohut	7b346b9e25	fix: import run server in serve command	2024-09-16 10:18:40 +08:00
arkohut	805414d94f	feat(ocr): skip ocr if exists	2024-09-16 00:05:27 +08:00
arkohut	e9c2e4d6fa	feat(command): list folders scannning	2024-09-14 18:48:17 +08:00
arkohut	a4a3387bdc	feat: add memosignore	2024-09-14 18:12:21 +08:00
arkohut	4a8d8fa54a	Merge branch 'master' of https://github.com/arkohut/memos	2024-09-11 23:20:49 +08:00
arkohut	d98eab9ebd	fix: ocr fetch bug fix	2024-09-11 23:20:42 +08:00
arkohut	167fd31053	feat: add builtin plugins for default library	2024-09-10 15:47:36 +08:00
arkohut	fca387b22d	feat: support bind plugin by name	2024-09-10 13:55:52 +08:00
arkohut	5882950c39	feat(cli): add extra args	2024-09-10 12:39:08 +08:00
arkohut	7f78eb1a4a	chore: update yaml generate config	2024-09-10 11:54:56 +08:00
arkohut	6bbf1a8a68	fix: use modelscope for sub config	2024-09-10 01:59:37 +08:00
arkohut	378e5bf445	feat: support modelscope	2024-09-10 01:32:00 +08:00
arkohut	241911d1d2	feat(index): use different bs for embedding	2024-09-10 00:58:57 +08:00
arkohut	f5aae87f40	feat: use concurrency of 1 by default	2024-09-10 00:54:20 +08:00
arkohut	41c7e136d9	fix: skip flash attn ... https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-10 00:31:56 +08:00
arkohut	a30fe62bc3	fix: yaml parse related	2024-09-09 23:39:04 +08:00
arkohut	3912d165f6	Revert "fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d" ... This reverts commit 5b1194f1bc6ad055fe69a9a2207ef1c31cc73721.	2024-09-09 23:27:40 +08:00
arkohut	5b1194f1bc	fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-09 22:26:48 +08:00
arkohut	6107c22def	fix: support parse secret	2024-09-09 22:26:26 +08:00
arkohut	81ba2cd2d2	feat: add default library and command shortcuts for it	2024-09-09 20:58:06 +08:00
arkohut	7e43bc0861	feat(ml_backend): move florence 2 as a default vlm plugin	2024-09-09 20:30:58 +08:00
arkohut	d7e6c32e86	feat: init default library	2024-09-09 19:57:07 +08:00
arkohut	69aca0153a	feat: make embedding a default plugin	2024-09-09 19:43:17 +08:00
arkohut	dbbc2792ef	feat: enable baisc auth	2024-09-06 18:18:18 +08:00
arkohut	e062636c08	feat(ocr): update import flow	2024-09-05 18:15:27 +08:00
arkohut	80c261ba8a	feat: add ml backend server	2024-09-03 23:37:23 +08:00
arkohut	a9f34b09d4	feat(index): do not add ocr for embedding	2024-09-03 18:36:08 +08:00
arkohut	e99792a974	feat(vlm): force jpeg option	2024-09-03 18:35:41 +08:00
arkohut	2b2d616775	feat(ocr): support local paddleocr	2024-09-01 22:40:20 +08:00
arkohut	d3b45ad197	feat: enable config.yaml	2024-09-01 19:01:49 +08:00
arkohut	1a08a44a4d	fix(index): ignore empty text for embedding	2024-08-29 21:38:01 +08:00
arkohut	2135b11f6c	chore: hidden vector content for search param log	2024-08-29 21:16:36 +08:00
arkohut	7fbb05e0cd	feat: add force indexing	2024-08-29 21:16:15 +08:00
arkohut	2f844eae80	chore: typo	2024-08-29 19:00:57 +08:00
arkohut	49879ad20e	fix: use global import	2024-08-29 18:02:51 +08:00
arkohut	a448fd0c9a	feat: support initialization	2024-08-29 17:47:14 +08:00
arkohut	0970e73da5	feat: make server host configurable	2024-08-29 17:01:02 +08:00
arkohut	75bb7aeef9	feat: update default config for embedding and vlm	2024-08-29 16:49:44 +08:00
arkohut	9db92908a6	feat(indexing): do not repeatly indexing updated entity by last_scan_at	2024-08-29 13:57:46 +08:00
arkohut	439adfa955	feat: support cascade delete entity	2024-08-29 13:24:23 +08:00
arkohut	16ef927c38	feat(indexing): manully control embedding generation	2024-08-29 13:24:00 +08:00
arkohut	abfc2814cf	feat: make server port configurable	2024-08-29 13:11:26 +08:00
arkohut	290636ca08	feat(indexing): make some fields optional	2024-08-27 23:34:57 +08:00
arkohut	b10b080800	fix(ollama): make vlm plugin support ollama	2024-08-25 16:49:48 +08:00
arkohut	67a5e10d3e	feat(plugins): add ocr as build plugin	2024-08-25 16:49:48 +08:00
arkohut	ec7ba1f989	feat(plugin): allow unbind plugin	2024-08-25 16:49:48 +08:00