osmarks
43ff9215fb
File metadata storage.
...
The backend now knows how big images are, so the frontend can size images correctly before they're loaded.
This should significantly improve the UI on slow connections.
Also fix bug where videos weren't erased from the index properly.
2024-06-26 20:02:12 +01:00
osmarks
1ab254ff1d
Adjust index storage for memory efficiency and fix SQLite interface type confusion
2024-06-25 08:23:30 +01:00
osmarks
e7adf738f6
Fix typo, in the sense of application-killing bug.
2024-05-31 00:35:16 +01:00
osmarks
747058e254
misc fixes
...
- thumbnails/OCR off was broken
- problematic video files caused segfaults (I blame ffmpeg for this)
2024-05-30 19:05:54 +01:00
osmarks
3257521068
Video search
2024-05-30 15:58:31 +01:00
osmarks
74d91d52e5
probably I should do better testing
2024-05-29 21:25:50 +01:00
osmarks
5eae8674ce
video parsing basics
2024-05-28 22:28:41 +01:00
osmarks
129b769a56
hackily patch horrifyingly nondeterministic-but-fast image encoder in
2024-05-27 20:21:44 +01:00
osmarks
d4e136b6a7
AITemplate builds of the image encoder work, at great personal cost
2024-05-27 19:05:25 +01:00
osmarks
a8329e43fc
more progress on Reddit
2024-05-27 15:22:28 +01:00
osmarks
f8d68d9d54
WIP Reddit dump loader
2024-05-24 17:47:18 +01:00
osmarks
978aadda6a
Improved UI for sliders
2024-05-22 20:26:23 +01:00
osmarks
d8c147df52
Predefined embedding modes in search
2024-05-22 20:17:13 +01:00
osmarks
14387a61a3
refactor configuration
2024-05-22 19:02:34 +01:00
osmarks
ffc3d648a6
basic monitoring implementation
2024-05-22 18:49:32 +01:00
osmarks
ce590298a7
concurrent index queries and fix database typo yet again
2024-05-22 18:25:50 +01:00
osmarks
349fe802f7
meme interpretability
2024-05-22 16:18:45 +01:00
osmarks
bd426a30ba
Port meme acquisition pipeline to new API, database
...
Also fix a really stupid oversight in crawling code.
2024-05-22 15:43:56 +01:00
osmarks
30b1b72712
I really should test database queries better
2024-05-22 14:35:29 +01:00
osmarks
9455438bab
frontend fixes
2024-05-21 20:17:23 +01:00
osmarks
24fbc0dd1f
apparently, that quality value is too low
2024-05-21 20:09:28 +01:00
osmarks
63a9b3d9a6
the consequences of my own actions
2024-05-21 12:39:04 +01:00
osmarks
e705a9db21
I hate precedence
2024-05-21 12:33:32 +01:00
osmarks
b7010b41dd
oops
2024-05-21 01:58:50 +01:00
osmarks
7cb42e028f
Rewrite entire application (well, backend) in Rust and also Go
...
I decided I wanted to integrate the experimental OCR thing better, so I rewrote in Go and also integrated the thumbnailer.
However, Go is a bad langauge and I only used it out of spite.
It turned out to have a very hard-to-fix memory leak due to some unclear interaction between libvips and both sets of bindings I tried, so I had Claude-3 transpile it to Rust then spent a while fixing the several mistakes it made and making tweaks.
The new Rust version works, although I need to actually do something with the OCR data and make the index queryable concurrently.
2024-05-21 00:09:04 +01:00
osmarks
fa863c2075
"release" unfinished scripts and miscellaneous JSON files
2024-05-18 14:34:30 +01:00
osmarks
caa8306ff7
oops
2024-05-18 13:21:13 +01:00
osmarks
6491e02e88
preliminary work on OCR
2024-05-18 00:39:05 +01:00
osmarks
a3574674d0
"documentation"
2024-04-27 17:33:24 +01:00
osmarks
2447e134ef
There were more memes than anticipated.
2024-04-27 17:24:01 +01:00
osmarks
80db16d02a
full pipeline
2024-04-22 18:44:29 +01:00
osmarks
7bae095384
accidentally lost some manual labels, oops, etc
2024-04-22 13:54:07 +01:00
osmarks
cebb4f9d00
better evals
2024-04-22 13:43:06 +01:00
osmarks
58ce70bb5e
meme rater model code (documentation "later")
2024-04-21 23:50:48 +01:00
osmarks
0b0261f625
preliminary meme rater work
2024-04-20 16:55:11 +01:00
osmarks
e9a7493343
stop requiring internal aiosqlite patch
2024-01-25 00:01:02 +00:00
osmarks
e3ffc426b7
Actually delete missing files
2024-01-02 14:12:26 +00:00
osmarks
4626f53bcb
Return to OpenCLIP
2023-11-13 17:31:43 +00:00
osmarks
74bb1bc343
thumbnailer system
2023-10-27 15:50:21 +01:00
osmarks
5b5ef271aa
""documentation""
2023-10-09 12:35:26 +01:00
osmarks
68a14d7da9
unignore device
2023-10-08 22:54:06 +01:00
osmarks
20fcc9317f
forgot the README
2023-10-08 22:52:57 +01:00
osmarks
46fca3eb7f
faster indexing, SigLIP models
2023-10-08 22:52:17 +01:00
osmarks
2c9ce67ab2
I really should do better testing
2023-09-30 21:10:27 +01:00
osmarks
c235217751
read from query strings
2023-09-30 15:56:04 +01:00
osmarks
8abe384cd1
fix concurrency bug
2023-09-29 18:35:42 +01:00
osmarks
120edc1a47
oops
2023-09-29 18:34:06 +01:00
osmarks
33f4382146
also typo
2023-09-28 17:32:41 +01:00
osmarks
aa6163a784
typo
2023-09-28 17:30:44 +01:00
osmarks
9d89e6e4f5
initial commit
2023-09-28 17:30:20 +01:00
osmarks