osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Edit ‘posthuman_technocapital_singularity’

Browse Source
This commit is contained in:
osmarks 2024-11-12 09:43:18 +00:00 committed by wikimind
parent 0cd838a9c4
commit 6c975ead64
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
posthuman_technocapital_singularity.myco
View File

@ -6,7 +6,7 @@ Posthumanism is related to but different from [[wp>transhumanism|transhumanism]]
= Technocapital
According to surveys, this is considered an undesirable outcome by most [[people]], and is thus, naively, unlikely. However, via coordination problems ([[https://slatestarcodex.com/2014/07/30/meditations-on-moloch/|Moloch]]), results which no involved party would choose, which are negative for everyone, can occur if avoiding these outcomes requires everyone involved to pay a local cost for shared benefit. The "capital" part of "technocapital" refers to how the competitive and forward-looking structure of capitalist economic systems mediate these processes.
According to surveys, this is considered an undesirable outcome by most [[people]], and is thus, naively, unlikely. However, via coordination problems ([[https://slatestarcodex.com/2014/07/30/meditations-on-moloch/|Moloch]]), results which no involved party would choose, which are negative for everyone, can occur if avoiding these outcomes requires everyone involved to pay a local cost for shared benefit. The "capital" part of "technocapital" refers to how the competitive and forward-looking structures of capitalist economic systems mediate these processes.
In this case, the general dynamic is that organizations which race towards more powerful AI and turn over more control to AI systems will do better than those which progress slower to focus on safety, leave humans in charge of decision-making where they are worse but safer, etc. As such, every individual organization is incentivized to race as much as possible even though this has negative outcomes.