osmarks/meme-search-engine
1
0
Fork 0
mirror of https://github.com/osmarks/meme-search-engine.git synced 2026-08-05 09:58:57 +00:00
Code Issues Releases Wiki Activity
96 Commits 2 Branches 0 Tags
ea3375a7bf6b606ca8a8b9aae009a866df911ec9
Commit Graph
96 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
osmarks ea3375a7bf ??? 2025-03-26 12:33:26 +00:00
osmarks 9af7eed0f9 update requirements again 2025-03-26 12:26:53 +00:00
osmarks ec6cde1ca4 update openclip 2025-03-26 12:13:27 +00:00
osmarks a1e694ed6d oops 2025-03-26 12:02:42 +00:00
osmarks 2fc0389f79 remove requirements not needed for rust backend 2025-03-26 11:56:27 +00:00
osmarks 14ede42b96 broaden python package versions (maybe works) 2025-03-26 11:50:00 +00:00
osmarks 435a9812dc model path argument 2025-03-26 11:02:40 +00:00
osmarks ec27deddbf fixed SAE export code 2025-01-31 17:12:25 +00:00
osmarks 899fbb7092 fix embedding-from-URL feature 2025-01-31 14:10:15 +00:00
osmarks e57931d47f Multithread query server 
While profiling suggests that most operations are cheap and IO-bound rather than CPU-bound, the GEMM for deduplication is pretty slow. As such, use multiple threads for higher throughput.
 2025-01-31 13:47:47 +00:00
osmarks 5215822e39 mlock 2025-01-29 14:48:15 +00:00
osmarks 3b2664ca98 update README 2025-01-25 16:56:54 +00:00
osmarks 257486678d connect metrics correctly 2025-01-24 15:23:53 +00:00
osmarks ee23b81444 release version 2025-01-24 09:24:28 +00:00
osmarks 3852d0078d integrate rating model correctly 2025-01-23 13:45:59 +00:00
osmarks fbf9b3421d fix lockfile 2025-01-18 19:35:21 +00:00
osmarks 3e568ff613 restore stashed code 2025-01-18 19:07:16 +00:00
osmarks fcd28a5ede add missing files 2025-01-18 17:09:44 +00:00
osmarks a5a6e960bb query code 2025-01-18 17:09:00 +00:00
osmarks 63caba2746 integrate rating model 2025-01-18 11:29:03 +00:00
osmarks d3fcedda09 cleanup 2025-01-18 07:25:21 +00:00
osmarks 0a542ef579 repurpose meme rater 2025-01-18 07:19:08 +00:00
osmarks 163dceca4b enforce r, oops 2025-01-16 21:36:15 +00:00
osmarks 9291eacead remove rogue debug code 2025-01-16 21:28:01 +00:00
osmarks f4376f62ed RobustVamana algorithm for big index run 2025-01-16 21:10:12 +00:00
osmarks d341a8c243 accursed k-means balance thing 2025-01-16 16:02:59 +00:00
osmarks 5ab91aa17e CLI switch for L 2025-01-14 08:31:03 +00:00
osmarks 2cebce1b73 new PQ training code 2025-01-14 07:46:09 +00:00
osmarks 4dd97631df fix entire index algorithm (very silly bug) 2025-01-12 19:48:53 +00:00
osmarks 0a196694b1 minor tweaks 2025-01-11 12:19:10 +00:00
osmarks 44ffe80102 fix gitignore 2025-01-11 07:54:23 +00:00
osmarks 087419f470 remove vestigal r_cap 2025-01-11 07:36:46 +00:00
osmarks 8ce51bcb56 correct DiskANN algorithm (silly bug with greedy search) 2025-01-11 07:35:04 +00:00
osmarks e9ee563381 tweak some parameters 2025-01-03 09:22:39 +00:00
osmarks 4d08ec370b oops, dependencies 2025-01-02 21:04:50 +00:00
osmarks 265502f141 tweak index build, this had better work, aaa 2025-01-02 21:04:26 +00:00
osmarks f1283137d6 release WIP DiskANN index orchestration code 2025-01-01 14:40:24 +00:00
osmarks 35df1201e2 fix overflow bug 2025-01-01 14:40:00 +00:00
osmarks e0cf65204b release early draft of index code 2024-12-31 23:05:48 +00:00
osmarks 512b776e10 use slightly worse image scaling 2024-11-13 18:31:18 +00:00
osmarks 8097ce8d91 improve dump processing and misc performance fixes 2024-11-11 19:43:07 +00:00
osmarks c277b49dc1 fix resumption, oops 2024-11-07 20:43:26 +00:00
osmarks b9bb629e6f performance improvements 2024-11-07 16:52:58 +00:00
osmarks 7fa14d45ae improve observability and fix up Reddit dump for full-scale run 2024-11-02 19:38:05 +00:00
osmarks 1d0ff95955 Sparse autoencoder testing 2024-10-05 17:22:44 +01:00
osmarks fc6d0c9409 Fix crawler (rate limit changes) 2024-07-15 18:48:55 +01:00
osmarks 43ff9215fb File metadata storage. 
The backend now knows how big images are, so the frontend can size images correctly before they're loaded.
This should significantly improve the UI on slow connections.
Also fix bug where videos weren't erased from the index properly.
 2024-06-26 20:02:12 +01:00
osmarks 1ab254ff1d Adjust index storage for memory efficiency and fix SQLite interface type confusion 2024-06-25 08:23:30 +01:00
osmarks e7adf738f6 Fix typo, in the sense of application-killing bug. 2024-05-31 00:35:16 +01:00
osmarks 747058e254 misc fixes 
- thumbnails/OCR off was broken
- problematic video files caused segfaults (I blame ffmpeg for this)
 2024-05-30 19:05:54 +01:00