osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Edit ‘consciousness’

Browse Source
This commit is contained in:
osmarks 2024-10-09 15:43:34 +00:00 committed by wikimind
parent de6ce33ff8
commit f229af5676
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
consciousness.myco
View File

@ -9,8 +9,8 @@ Twin studies in relativistic trolley collisions estimate that consciousness is r
Consciousness is widely held to result from certain kinds of computation. For instance, [[https://scottaaronson.blog/?p=1799|integrated information theory]] holds that computations which "integrate information" are conscious. This neatly avoids various problems with other models. However, it has many flaws if considered in depth:
* "Computations" aren't exactly a low-level physical property of the universe: the same systems can be interpreted as "computing" many different things.
* This leads to a number of [[confusing]] scenarios - for example, a [[homomorphically encrypted]] computation may or may not be conscious, but this cannot be tested externally, creating moral problems.
* You can check externally if you have a key. What happens if the key is deleted? What if it is not deleted, but is very difficult to obtain (timelock encryption)?
* {This leads to a number of [[confusing]] scenarios - for example, a [[homomorphically encrypted]] computation may or may not be conscious, but this cannot be tested externally, creating moral problems.
* You can check externally if you have a key. What happens if the key is deleted? What if it is not deleted, but is very difficult to obtain (timelock encryption)?}
* There is also the problem of measuring "how much" consciousness is happening: for example, what happens if I run a conscious mind on a pair of computers in lockstep, and then disable one half? What if instead of disabling one half, it is instead subjected to slightly different stimuli?
* "Incidental computations" by all kinds of systems should plausibly be creating consciousness in very strange scenarios. Why do we experience a rulebound, consistent, simple universe? See also [[Boltzmann brains]].
* What if I represent my computable, conscious function as a very big lookup table?