From 15966845f9e782ad66937454b1cea75d7f127796 Mon Sep 17 00:00:00 2001 From: osmarks Date: Mon, 17 Jun 2024 08:18:12 +0000 Subject: [PATCH] =?UTF-8?q?Create=20=E2=80=98scaling=5Flaws=E2=80=99?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- scaling_laws.myco | 1 + 1 file changed, 1 insertion(+) create mode 100644 scaling_laws.myco diff --git a/scaling_laws.myco b/scaling_laws.myco new file mode 100644 index 0000000..94daa9f --- /dev/null +++ b/scaling_laws.myco @@ -0,0 +1 @@ +The principle on which scaling laws are based is that straight lines on graphs are the most powerful force in the universe. If a sufficiently smooth trendline (on a linear or log scale) is discovered, the universe will contrive to extend this trend line (until it doesn't; see [[Moore's Law]]). Scaling laws are important to [[biology]], as organisms are constrained by limits such as heat dissipation, gas/chemical exchange across membranes or via lungs, and power consumption, and [[deep learning]], in which metrics such as [[training loss]] usually scale smoothly according to power laws, due to the [[fundamental apiostructure of reality]]. \ No newline at end of file