osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Edit ‘autogollark’

Browse Source
This commit is contained in:
osmarks
2025-12-29 17:22:16 +00:00
committed by wikimind
parent c9e7aa0aa9
commit 5388718f3a
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
autogollark.myco
+3 -1
View File
@@ -48,7 +48,9 @@ Autogollark currently comprises the dataset, the search API server and the [[htt
* Context length issues, and subquadratic models are sort of bad, though maybe we can "upcycle" a midsized model to RWKV. This exists somewhere. Not sure of efficiency. Inference code will be awful.
}
* Train on e.g. Discord Unveiled (local copy available).
* Is vision practical? Probably not without a pretrained model for it, and those don't seem to be base models. Perhaps CLIP embeddings are good enough but I wouldn't count on it.
* {Is vision practical? Probably not without a pretrained model for it, and those don't seem to be base models. Perhaps CLIP embeddings are good enough but I wouldn't count on it.
* Vision "output" via retrieval over Nooscope/MSE.
}
== Versions