osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Edit ‘autogollark’

Browse Source
This commit is contained in:
osmarks
2025-12-25 23:14:22 +00:00
committed by wikimind
parent 83e24b9c9a
commit d7869b09b9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
autogollark.myco
View File

@@ -38,7 +38,7 @@ Autogollark currently comprises the dataset, the search API server and the [[htt
* https://arxiv.org/abs/2507.01335
* https://github.com/d0rc/egg.c and https://eshyperscale.github.io/. Does this actually work (at scale)? Why? Would be really nice for using AMX units.
* Maybe compute grants are available for training.
* Substantial bandwidth bottleneck on CPU. Specdec/MTP would be useful.
* Substantial bandwidth bottleneck on CPU (230GB/s nominal; 200GB/s benchmarked; 100GB/s per NUMA node, which llama.cpp handles awfully). Specdec/MTP would be useful.
}
* Search over conversations with non-gollark simulacra? Should find //something// to use spare parallelism on local inference. Best-of-n? https://arxiv.org/abs/2505.10475
* {Longer context, mux several channels.