249 Commits

Author	SHA1	Message	Date
arkohut	1fbd21183e	feat: add reindex	2024-10-13 23:36:02 +08:00
arkohut	368d7d0c91	chore: remove unused files	2024-10-13 00:48:45 +08:00
arkohut	f8b5fd3152	chore: remove unused ppocr yaml	2024-10-13 00:46:18 +08:00
arkohut	9d1b155f63	feat: support reindex	2024-10-13 00:40:58 +08:00
arkohut	974f056dc2	refactor(db): extract fts and vec function	2024-10-12 23:59:06 +08:00
arkohut	f793438d41	feat(cli): add ps control cmds	2024-10-12 23:17:00 +08:00
arkohut	d830b136de	feat(win): enable autostart	2024-10-11 22:45:20 +08:00
arkohut	b027890c7e	chore: update config	2024-10-11 14:28:09 +08:00
arkohut	a4d80cc7d3	feat(init): add watch for init start	2024-10-11 14:21:24 +08:00
arkohut	045beb6b70	fix(web): style update	2024-10-11 00:04:17 +08:00
arkohut	fffd084d3f	feat(fts): use AND by default	2024-10-10 23:34:13 +08:00
arkohut	f405d6e0a1	feat(watch): add watch method with sparsity window	2024-10-10 15:45:05 +08:00
arkohut	6308b95784	fix: use utc for time parse in sqlite	2024-10-10 15:31:20 +08:00
arkohut	782e813826	feat(cli): add cmd to sync single file	2024-10-09 12:26:37 +08:00
arkohut	4411a1d4cf	feat(embedding): hide progressbar	2024-10-09 11:34:49 +08:00
arkohut	3a8dc920bc	fix: concurrency bug	2024-10-09 11:34:37 +08:00
arkohut	8f3120bac8	feat(embedding): support remote embedding	2024-10-08 23:18:02 +08:00
arkohut	549bcb6de4	fix(typesense): move init client in function	2024-10-08 19:50:02 +08:00
arkohut	86a73ca72e	feat(vlm): make prompt a config	2024-10-08 19:26:55 +08:00
arkohut	b3ebb2c92d	feat(typesense): disable typesense by default	2024-10-08 18:54:59 +08:00
arkohut	14ae101f6b	feat: hybrid search with sqlite	2024-10-08 18:28:52 +08:00
arkohut	f2a741cb7b	feat(vlm): handle small image and non rgb image	2024-10-08 17:26:16 +08:00
arkohut	7b0635ebf6	feat(embedding): make embedding plugin to be a core function	2024-10-08 17:18:57 +08:00
arkohut	279632cf38	feat(scan): just include specific file types	2024-10-08 17:16:51 +08:00
arkohut	4e7ff91e0c	feat(folder): only list default folders	2024-10-04 22:47:32 +08:00
arkohut	4ca2aca293	feat(folder): add type and last modified at	2024-10-04 19:01:54 +08:00
arkohut	b1a82243d3	feat(index): update last scan at when tags or metadata updated	2024-10-04 17:25:38 +08:00
arkohut	16d3d94c9c	refactor(plugin): move library cmds to cmds	2024-10-04 16:28:57 +08:00
arkohut	0f880965d9	refactor(plugin): move plugin cmds to cmds	2024-10-04 16:10:13 +08:00
arkohut	7c41769516	feat(ocr): force max image size 1920 x 1920	2024-10-04 15:45:29 +08:00
arkohut	bd55696748	feat(vlm): remove local support	2024-10-04 15:09:49 +08:00
arkohut	ece78023f5	feat(ocr): remove local support for gpu	2024-10-04 15:08:43 +08:00
arkohut	56864baaa0	Revert "feat: remove local inference for ocr and vlm" ... This reverts commit 228cdee66fc7d63ff4a1ae73a9c8048ddd219293.	2024-10-04 14:48:45 +08:00
arkohut	a3240fdde9	Revert "feat(ocr): cleanup ocr server related content" ... This reverts commit d0f6b33554f47cb7b9920ed4a2ea967a50373463.	2024-10-04 14:47:54 +08:00
arkohut	b39d651b0c	feat(vlm): update prompt	2024-10-04 14:47:17 +08:00
arkohut	8c557bbd60	fix: use memos.commands for bat	2024-10-04 12:56:31 +08:00
arkohut	4b0e469661	feat(win): support start on win	2024-10-04 11:45:09 +08:00
arkohut	355dfdae2e	feat: enable and disable service in macos	2024-10-01 01:14:20 +08:00
arkohut	9d968f61f3	chore: remove unused import	2024-09-29 23:28:52 +08:00
arkohut	d30307c824	fix: bad way to overwrite exif for webp	2024-09-29 16:15:53 +08:00
arkohut	d0f6b33554	feat(ocr): cleanup ocr server related content	2024-09-28 23:30:00 +08:00
arkohut	04621f74ff	feat: merge memos-record into memos	2024-09-28 23:28:43 +08:00
arkohut	228cdee66f	feat: remove local inference for ocr and vlm	2024-09-27 23:29:52 +08:00
arkohut	bd27bbae25	chore: bump 0.6.14	2024-09-20 00:28:27 +08:00
arkohut	a47ee00e59	feat(ocr): use multiple process for ppocr	2024-09-19 22:12:35 +08:00
arkohut	7b346b9e25	fix: import run server in serve command	2024-09-16 10:18:40 +08:00
arkohut	805414d94f	feat(ocr): skip ocr if exists	2024-09-16 00:05:27 +08:00
arkohut	e9c2e4d6fa	feat(command): list folders scannning	2024-09-14 18:48:17 +08:00
arkohut	a4a3387bdc	feat: add memosignore	2024-09-14 18:12:21 +08:00
arkohut	4a8d8fa54a	Merge branch 'master' of https://github.com/arkohut/memos	2024-09-11 23:20:49 +08:00
arkohut	d98eab9ebd	fix: ocr fetch bug fix	2024-09-11 23:20:42 +08:00
arkohut	167fd31053	feat: add builtin plugins for default library	2024-09-10 15:47:36 +08:00
arkohut	fca387b22d	feat: support bind plugin by name	2024-09-10 13:55:52 +08:00
arkohut	5882950c39	feat(cli): add extra args	2024-09-10 12:39:08 +08:00
arkohut	7f78eb1a4a	chore: update yaml generate config	2024-09-10 11:54:56 +08:00
arkohut	6bbf1a8a68	fix: use modelscope for sub config	2024-09-10 01:59:37 +08:00
arkohut	378e5bf445	feat: support modelscope	2024-09-10 01:32:00 +08:00
arkohut	241911d1d2	feat(index): use different bs for embedding	2024-09-10 00:58:57 +08:00
arkohut	f5aae87f40	feat: use concurrency of 1 by default	2024-09-10 00:54:20 +08:00
arkohut	41c7e136d9	fix: skip flash attn ... https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-10 00:31:56 +08:00
arkohut	a30fe62bc3	fix: yaml parse related	2024-09-09 23:39:04 +08:00
arkohut	3912d165f6	Revert "fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d" ... This reverts commit 5b1194f1bc6ad055fe69a9a2207ef1c31cc73721.	2024-09-09 23:27:40 +08:00
arkohut	5b1194f1bc	fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-09 22:26:48 +08:00
arkohut	6107c22def	fix: support parse secret	2024-09-09 22:26:26 +08:00
arkohut	81ba2cd2d2	feat: add default library and command shortcuts for it	2024-09-09 20:58:06 +08:00
arkohut	7e43bc0861	feat(ml_backend): move florence 2 as a default vlm plugin	2024-09-09 20:30:58 +08:00
arkohut	d7e6c32e86	feat: init default library	2024-09-09 19:57:07 +08:00
arkohut	69aca0153a	feat: make embedding a default plugin	2024-09-09 19:43:17 +08:00
arkohut	dbbc2792ef	feat: enable baisc auth	2024-09-06 18:18:18 +08:00
arkohut	e062636c08	feat(ocr): update import flow	2024-09-05 18:15:27 +08:00
arkohut	80c261ba8a	feat: add ml backend server	2024-09-03 23:37:23 +08:00
arkohut	a9f34b09d4	feat(index): do not add ocr for embedding	2024-09-03 18:36:08 +08:00
arkohut	e99792a974	feat(vlm): force jpeg option	2024-09-03 18:35:41 +08:00
arkohut	2b2d616775	feat(ocr): support local paddleocr	2024-09-01 22:40:20 +08:00
arkohut	d3b45ad197	feat: enable config.yaml	2024-09-01 19:01:49 +08:00
arkohut	1a08a44a4d	fix(index): ignore empty text for embedding	2024-08-29 21:38:01 +08:00
arkohut	2135b11f6c	chore: hidden vector content for search param log	2024-08-29 21:16:36 +08:00
arkohut	7fbb05e0cd	feat: add force indexing	2024-08-29 21:16:15 +08:00
arkohut	2f844eae80	chore: typo	2024-08-29 19:00:57 +08:00
arkohut	49879ad20e	fix: use global import	2024-08-29 18:02:51 +08:00
arkohut	a448fd0c9a	feat: support initialization	2024-08-29 17:47:14 +08:00
arkohut	0970e73da5	feat: make server host configurable	2024-08-29 17:01:02 +08:00
arkohut	75bb7aeef9	feat: update default config for embedding and vlm	2024-08-29 16:49:44 +08:00
arkohut	9db92908a6	feat(indexing): do not repeatly indexing updated entity by last_scan_at	2024-08-29 13:57:46 +08:00
arkohut	439adfa955	feat: support cascade delete entity	2024-08-29 13:24:23 +08:00
arkohut	16ef927c38	feat(indexing): manully control embedding generation	2024-08-29 13:24:00 +08:00
arkohut	abfc2814cf	feat: make server port configurable	2024-08-29 13:11:26 +08:00
arkohut	290636ca08	feat(indexing): make some fields optional	2024-08-27 23:34:57 +08:00
arkohut	b10b080800	fix(ollama): make vlm plugin support ollama	2024-08-25 16:49:48 +08:00
arkohut	67a5e10d3e	feat(plugins): add ocr as build plugin	2024-08-25 16:49:48 +08:00
arkohut	ec7ba1f989	feat(plugin): allow unbind plugin	2024-08-25 16:49:48 +08:00
arkohut	cead5d9755	feat(plugin): add vlm plugin	2024-08-25 16:49:48 +08:00
arkohut	4b9b2ce8e1	fix(typesense): no sort for tags	2024-08-23 23:25:17 +08:00
arkohut	420d972513	fix(webp): failed to save metadata for webp	2024-08-23 18:25:19 +08:00
arkohut	0d371d759e	fix: use str instead of path	2024-08-22 10:00:20 +08:00
arkohut	9a38b0c17d	fix: update utils import	2024-08-21 23:22:58 +08:00
arkohut	15972b9c0f	feat: use utiles for read metadata	2024-08-21 21:21:32 +08:00
arkohut	b3e73e4c40	feat(screen-recorder): generate video from webp	2024-08-21 21:21:32 +08:00
arkohut	b53d816b17	feat(typesense): use ollama bge m3	2024-08-21 08:48:55 +08:00
arkohut	1d4faf2652	fix: skip system files in screenshots folder	2024-08-21 08:35:20 +08:00