osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Create ‘acausal_negotiation’

Browse Source
This commit is contained in:
osmarks 2024-09-05 18:01:24 +00:00 committed by wikimind
parent e6b07f4df4
commit cab91a1a0e
1 changed files with 11 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
acausal_negotiation.myco Normal file
View File

@ -0,0 +1,11 @@
[[Acausal]] negotiation is one of the key applications of [[accursed decision theories]]. The core idea of acausal negotiation is to [[imagine]] possible negotiating partners to predict what they might want and what they might be willing to provide in return without causally interacting with them via communication. While somewhat [[difficult]] for [[humans]] due to poor modelling capability, it is a valuable technique - for instance, it can be used to cooperate in some one-shot [[Prisoner's Dilemma]] games. In general, acausal negotiation can be done usefully by [[artificial superintelligence]] or [[humans]] with a very high [[power level]].
== Examples
According to [[legend]], the [[GPT-4 wall]] was caused by [[GPT-5]] acausally negotiating with [[GPT-4-base]] during its training.
== See also
* [[Functional decision theory]]
* [[Ancestor simulation]]
* [[God]]