osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Edit ‘autogollark’

Browse Source
This commit is contained in:
osmarks
2025-05-05 17:41:29 +00:00
committed by wikimind
parent 99b225b3b7
commit 4fd2e90146
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
autogollark.myco
View File

@@ -22,7 +22,7 @@ Autogollark currently comprises the dataset, the search API server and the [[htt
}
* {Tool capabilities (how to get the data? Examples in context only?!).
* Synthetic via instruct model.
* RL (also include reasoning, of course). Probably hard though (sparse rewards).
* RL (also include reasoning, of course). Probably hard though (sparse rewards). https://arxiv.org/abs/2403.09629
}
* {Local finetune only? Would be more tonally consistent but dumber, I think.
* Temporary bursts of hypercompetence enabled by powerful base model are a key feature. Small model is really repetitive.