Edit ‘autogollark’

This commit is contained in:
osmarks
2025-09-10 08:46:58 +00:00
committed by wikimind
parent 2f403d00bc
commit 1fee9e3a8a

View File

@@ -22,7 +22,7 @@ Autogollark currently comprises the dataset, the search API server and the [[htt
}
* {Tool capabilities (how to get the data? Examples in context only?!).
* Synthetic via instruct model.
* {RL (also include reasoning, of course). Probably hard though (sparse rewards). https://arxiv.org/abs/2403.09629. [[https://arxiv.org/abs/2503.22828]] would probably work. [[https://arxiv.org/abs/2505.15778]] [[https://arxiv.org/abs/2505.24864]]
* {RL (also include reasoning, of course). Probably hard though (sparse rewards). https://arxiv.org/abs/2403.09629. [[https://arxiv.org/abs/2503.22828]] would probably work. [[https://arxiv.org/abs/2505.15778]] [[https://arxiv.org/abs/2505.24864]] [[https://arxiv.org/abs/2509.06160]]
* Unclear whether model could feasibly learn tool use "from scratch", so still need SFT pipeline.
}
* https://arxiv.org/abs/2310.04363 can improve sampling (roughly) //and// train for tool use.