Create ‘scaling_laws’

2024-06-17 08:18:12 +00:00 · 2024-06-17 08:18:12 +00:00 · 15966845f9
commit 15966845f9
parent eceef777d6
1 changed files with 1 additions and 0 deletions
--- a/scaling_laws.myco
+++ b/scaling_laws.myco
@ -0,0 +1 @@
+The principle on which scaling laws are based is that straight lines on graphs are the most powerful force in the universe. If a sufficiently smooth trendline (on a linear or log scale) is discovered, the universe will contrive to extend this trend line (until it doesn't; see [[Moore's Law]]). Scaling laws are important to [[biology]], as organisms are constrained by limits such as heat dissipation, gas/chemical exchange across membranes or via lungs, and power consumption, and [[deep learning]], in which metrics such as [[training loss]] usually scale smoothly according to power laws, due to the [[fundamental apiostructure of reality]].
				`@ -0,0 +1 @@`
				The principle on which scaling laws are based is that straight lines on graphs are the most powerful force in the universe. If a sufficiently smooth trendline (on a linear or log scale) is discovered, the universe will contrive to extend this trend line (until it doesn't; see [[Moore's Law]]). Scaling laws are important to [[biology]], as organisms are constrained by limits such as heat dissipation, gas/chemical exchange across membranes or via lungs, and power consumption, and [[deep learning]], in which metrics such as [[training loss]] usually scale smoothly according to power laws, due to the [[fundamental apiostructure of reality]].