diff --git a/autogollark.myco b/autogollark.myco index e3b88bc..63cdc3d 100644 --- a/autogollark.myco +++ b/autogollark.myco @@ -38,6 +38,7 @@ Autogollark currently comprises the dataset, the search API server and the [[htt * Context length issues, and subquadratic models are sort of bad, though maybe we can "upcycle" a midsized model to RWKV. This exists somewhere. Not sure of efficiency. } } +* Train on e.g. Discord Unveiled (local copy available). == Versions