osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Edit ‘autogollark’

Browse Source
This commit is contained in:
osmarks
2025-12-29 17:21:56 +00:00
committed by wikimind
parent 390d91aefd
commit c9e7aa0aa9
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
autogollark.myco
View File

@@ -48,6 +48,7 @@ Autogollark currently comprises the dataset, the search API server and the [[htt
* Context length issues, and subquadratic models are sort of bad, though maybe we can "upcycle" a midsized model to RWKV. This exists somewhere. Not sure of efficiency. Inference code will be awful.
}
* Train on e.g. Discord Unveiled (local copy available).
* Is vision practical? Probably not without a pretrained model for it, and those don't seem to be base models. Perhaps CLIP embeddings are good enough but I wouldn't count on it.
== Versions