218 Commits

Author	SHA1	Message	Date
arkohut	ece78023f5	feat(ocr): remove local support for gpu	2024-10-04 15:08:43 +08:00
arkohut	56864baaa0	Revert "feat: remove local inference for ocr and vlm" ... This reverts commit 228cdee66fc7d63ff4a1ae73a9c8048ddd219293.	2024-10-04 14:48:45 +08:00
arkohut	a3240fdde9	Revert "feat(ocr): cleanup ocr server related content" ... This reverts commit d0f6b33554f47cb7b9920ed4a2ea967a50373463.	2024-10-04 14:47:54 +08:00
arkohut	b39d651b0c	feat(vlm): update prompt	2024-10-04 14:47:17 +08:00
arkohut	8c557bbd60	fix: use memos.commands for bat	2024-10-04 12:56:31 +08:00
arkohut	4b0e469661	feat(win): support start on win	2024-10-04 11:45:09 +08:00
arkohut	355dfdae2e	feat: enable and disable service in macos	2024-10-01 01:14:20 +08:00
arkohut	9d968f61f3	chore: remove unused import	2024-09-29 23:28:52 +08:00
arkohut	d30307c824	fix: bad way to overwrite exif for webp	2024-09-29 16:15:53 +08:00
arkohut	d0f6b33554	feat(ocr): cleanup ocr server related content	2024-09-28 23:30:00 +08:00
arkohut	04621f74ff	feat: merge memos-record into memos	2024-09-28 23:28:43 +08:00
arkohut	228cdee66f	feat: remove local inference for ocr and vlm	2024-09-27 23:29:52 +08:00
arkohut	bd27bbae25	chore: bump 0.6.14	2024-09-20 00:28:27 +08:00
arkohut	a47ee00e59	feat(ocr): use multiple process for ppocr	2024-09-19 22:12:35 +08:00
arkohut	7b346b9e25	fix: import run server in serve command	2024-09-16 10:18:40 +08:00
arkohut	805414d94f	feat(ocr): skip ocr if exists	2024-09-16 00:05:27 +08:00
arkohut	e9c2e4d6fa	feat(command): list folders scannning	2024-09-14 18:48:17 +08:00
arkohut	a4a3387bdc	feat: add memosignore	2024-09-14 18:12:21 +08:00
arkohut	4a8d8fa54a	Merge branch 'master' of https://github.com/arkohut/memos	2024-09-11 23:20:49 +08:00
arkohut	d98eab9ebd	fix: ocr fetch bug fix	2024-09-11 23:20:42 +08:00
arkohut	167fd31053	feat: add builtin plugins for default library	2024-09-10 15:47:36 +08:00
arkohut	fca387b22d	feat: support bind plugin by name	2024-09-10 13:55:52 +08:00
arkohut	5882950c39	feat(cli): add extra args	2024-09-10 12:39:08 +08:00
arkohut	7f78eb1a4a	chore: update yaml generate config	2024-09-10 11:54:56 +08:00
arkohut	6bbf1a8a68	fix: use modelscope for sub config	2024-09-10 01:59:37 +08:00
arkohut	378e5bf445	feat: support modelscope	2024-09-10 01:32:00 +08:00
arkohut	241911d1d2	feat(index): use different bs for embedding	2024-09-10 00:58:57 +08:00
arkohut	f5aae87f40	feat: use concurrency of 1 by default	2024-09-10 00:54:20 +08:00
arkohut	41c7e136d9	fix: skip flash attn ... https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-10 00:31:56 +08:00
arkohut	a30fe62bc3	fix: yaml parse related	2024-09-09 23:39:04 +08:00
arkohut	3912d165f6	Revert "fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d" ... This reverts commit 5b1194f1bc6ad055fe69a9a2207ef1c31cc73721.	2024-09-09 23:27:40 +08:00
arkohut	5b1194f1bc	fix: skip flash attn https://huggingface.co/microsoft/Florence-2-base-ft/discussions/13#66836a8d67d2ccf03a96df8d	2024-09-09 22:26:48 +08:00
arkohut	6107c22def	fix: support parse secret	2024-09-09 22:26:26 +08:00
arkohut	81ba2cd2d2	feat: add default library and command shortcuts for it	2024-09-09 20:58:06 +08:00
arkohut	7e43bc0861	feat(ml_backend): move florence 2 as a default vlm plugin	2024-09-09 20:30:58 +08:00
arkohut	d7e6c32e86	feat: init default library	2024-09-09 19:57:07 +08:00
arkohut	69aca0153a	feat: make embedding a default plugin	2024-09-09 19:43:17 +08:00
arkohut	dbbc2792ef	feat: enable baisc auth	2024-09-06 18:18:18 +08:00
arkohut	e062636c08	feat(ocr): update import flow	2024-09-05 18:15:27 +08:00
arkohut	80c261ba8a	feat: add ml backend server	2024-09-03 23:37:23 +08:00
arkohut	a9f34b09d4	feat(index): do not add ocr for embedding	2024-09-03 18:36:08 +08:00
arkohut	e99792a974	feat(vlm): force jpeg option	2024-09-03 18:35:41 +08:00
arkohut	2b2d616775	feat(ocr): support local paddleocr	2024-09-01 22:40:20 +08:00
arkohut	d3b45ad197	feat: enable config.yaml	2024-09-01 19:01:49 +08:00
arkohut	1a08a44a4d	fix(index): ignore empty text for embedding	2024-08-29 21:38:01 +08:00
arkohut	2135b11f6c	chore: hidden vector content for search param log	2024-08-29 21:16:36 +08:00
arkohut	7fbb05e0cd	feat: add force indexing	2024-08-29 21:16:15 +08:00
arkohut	2f844eae80	chore: typo	2024-08-29 19:00:57 +08:00
arkohut	49879ad20e	fix: use global import	2024-08-29 18:02:51 +08:00
arkohut	a448fd0c9a	feat: support initialization	2024-08-29 17:47:14 +08:00
arkohut	0970e73da5	feat: make server host configurable	2024-08-29 17:01:02 +08:00
arkohut	75bb7aeef9	feat: update default config for embedding and vlm	2024-08-29 16:49:44 +08:00
arkohut	9db92908a6	feat(indexing): do not repeatly indexing updated entity by last_scan_at	2024-08-29 13:57:46 +08:00
arkohut	439adfa955	feat: support cascade delete entity	2024-08-29 13:24:23 +08:00
arkohut	16ef927c38	feat(indexing): manully control embedding generation	2024-08-29 13:24:00 +08:00
arkohut	abfc2814cf	feat: make server port configurable	2024-08-29 13:11:26 +08:00
arkohut	290636ca08	feat(indexing): make some fields optional	2024-08-27 23:34:57 +08:00
arkohut	b10b080800	fix(ollama): make vlm plugin support ollama	2024-08-25 16:49:48 +08:00
arkohut	67a5e10d3e	feat(plugins): add ocr as build plugin	2024-08-25 16:49:48 +08:00
arkohut	ec7ba1f989	feat(plugin): allow unbind plugin	2024-08-25 16:49:48 +08:00
arkohut	cead5d9755	feat(plugin): add vlm plugin	2024-08-25 16:49:48 +08:00
arkohut	4b9b2ce8e1	fix(typesense): no sort for tags	2024-08-23 23:25:17 +08:00
arkohut	420d972513	fix(webp): failed to save metadata for webp	2024-08-23 18:25:19 +08:00
arkohut	0d371d759e	fix: use str instead of path	2024-08-22 10:00:20 +08:00
arkohut	9a38b0c17d	fix: update utils import	2024-08-21 23:22:58 +08:00
arkohut	15972b9c0f	feat: use utiles for read metadata	2024-08-21 21:21:32 +08:00
arkohut	b3e73e4c40	feat(screen-recorder): generate video from webp	2024-08-21 21:21:32 +08:00
arkohut	b53d816b17	feat(typesense): use ollama bge m3	2024-08-21 08:48:55 +08:00
arkohut	1d4faf2652	fix: skip system files in screenshots folder	2024-08-21 08:35:20 +08:00
arkohut	9267fdc018	feat(indexing): add sort for fields	2024-08-21 00:12:54 +08:00
arkohut	11e447bcbb	feat(indexing): support facet	2024-08-21 00:12:31 +08:00
arkohut	2cf75bee7f	feat(index): extract collection name to settings	2024-08-20 18:35:35 +08:00
arkohut	f0dfaf387e	feat(index): add date month year for index	2024-08-20 13:18:34 +08:00
arkohut	1d10b0ef7b	fix(indexing): do not check entity exists when delete index	2024-08-20 13:18:05 +08:00
arkohut	ef2022fa10	feat(screen-recorder): insert tag of app name	2024-08-20 13:17:22 +08:00
arkohut	01a294a70a	feat: add active_app from active_window when scanning	2024-08-20 13:12:25 +08:00
arkohut	44f015d3fe	fix: handle none response exception	2024-08-16 23:10:32 +08:00
arkohut	95acfdd174	feat: stop print metadata when read it	2024-08-14 19:44:56 +08:00
arkohut	9640e00d54	feat(cli): return lib info after add folder	2024-08-14 19:43:29 +08:00
arkohut	39887c827f	feat: add more indices	2024-08-14 12:20:32 +08:00
arkohut	2314ad544e	fix(index): can not support number and string at the same field	2024-08-14 12:14:31 +08:00
arkohut	fc95061672	feat(metadata): support create tags and metadata when create new entity	2024-08-14 11:31:50 +08:00
arkohut	016264f13f	feat: support extract raw image from video	2024-08-13 15:35:48 +08:00
arkohut	0fff358e4d	feat: add http timeout	2024-08-08 20:05:14 +08:00
arkohut	5285831d03	feat: support filter by folders and libraries	2024-07-31 18:58:50 +08:00
arkohut	025879792c	fix: tolerate none response exception	2024-07-31 18:57:56 +08:00
arkohut	d0cfd91f5a	feat(indexing): add time filter	2024-07-31 00:41:29 +08:00
arkohut	83bd59ca80	fix: add logconfig	2024-07-30 15:55:56 +08:00
arkohut	58ab45c100	feat(scan): tolerate add entity failed	2024-07-29 19:18:28 +08:00
arkohut	18d30e6567	feat: show update last_scan_at for any update	2024-07-29 18:25:24 +08:00
arkohut	7e7fa02e23	feat: use bulk upsert when indexing	2024-07-29 17:50:29 +08:00
arkohut	2794e6b7b4	feat: show full progress when index a folder	2024-07-29 16:50:40 +08:00
arkohut	7029ebc5b8	fix: wrong datetime	2024-07-29 16:39:31 +08:00
arkohut	6d18a3aa05	fix: retry and try catch exception when update entity	2024-07-29 16:09:06 +08:00
arkohut	873034c76b	feat(scan): batching check file exists	2024-07-26 18:35:39 +08:00
arkohut	badbfd70bc	feat(scan): support batching check file exists	2024-07-26 18:34:59 +08:00
arkohut	4a90d86c16	feat(scan): give the entity count when scan lib to delete entities	2024-07-26 17:14:30 +08:00
arkohut	e7be69f0ef	feat: return total count in header when list foler entities	2024-07-26 17:13:42 +08:00
arkohut	4e1ce5ef96	feat: support indexing for specific folders	2024-07-26 16:27:01 +08:00
arkohut	506e5eedd0	feat(scan): support concurrent webhook trigger	2024-07-22 16:34:11 +08:00