From 5388718f3a9899b1b48116e0a5a7f27df0c31a3d Mon Sep 17 00:00:00 2001 From: osmarks Date: Mon, 29 Dec 2025 17:22:16 +0000 Subject: [PATCH] =?UTF-8?q?Edit=20=E2=80=98autogollark=E2=80=99?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- autogollark.myco | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/autogollark.myco b/autogollark.myco index 825dea6..0c1a4d7 100644 --- a/autogollark.myco +++ b/autogollark.myco @@ -48,7 +48,9 @@ Autogollark currently comprises the dataset, the search API server and the [[htt * Context length issues, and subquadratic models are sort of bad, though maybe we can "upcycle" a midsized model to RWKV. This exists somewhere. Not sure of efficiency. Inference code will be awful. } * Train on e.g. Discord Unveiled (local copy available). -* Is vision practical? Probably not without a pretrained model for it, and those don't seem to be base models. Perhaps CLIP embeddings are good enough but I wouldn't count on it. +* {Is vision practical? Probably not without a pretrained model for it, and those don't seem to be base models. Perhaps CLIP embeddings are good enough but I wouldn't count on it. +* Vision "output" via retrieval over Nooscope/MSE. +} == Versions