osmarks/documentation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Create ‘reward_hack’

Browse Source
This commit is contained in:
osmarks 2024-11-25 16:30:14 +00:00 committed by wikimind
parent e4ca9fe465
commit ae222cf097
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
reward_hack.myco Normal file
View File

@ -0,0 +1,3 @@
Reward hacking, also known as specification gaming and approximately [[Goodhart's law]], is when an [[agentic]] system is given [[incentives]] designed to induce it to act in one way but discovers and applies an easier, undesired way to
A large list of examples can be found [[https://docs.google.com/spreadsheets/d/e/2PACX-1vRPiprOaC3HsCf5Tuum8bRfzYUiKLRqJmbOoC-32JorNdfyTiRRsR7Ea5eWtvsWzuxo8bjOxCG84dAg/pubhtml|here]].