Edit ‘autogollark’
This commit is contained in:
@@ -38,6 +38,7 @@ Autogollark currently comprises the dataset, the search API server and the [[htt
|
|||||||
* Context length issues, and subquadratic models are sort of bad, though maybe we can "upcycle" a midsized model to RWKV. This exists somewhere. Not sure of efficiency.
|
* Context length issues, and subquadratic models are sort of bad, though maybe we can "upcycle" a midsized model to RWKV. This exists somewhere. Not sure of efficiency.
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
* Train on e.g. Discord Unveiled (local copy available).
|
||||||
|
|
||||||
== Versions
|
== Versions
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user