osmarks/nanogpt-experiments
1
0
Fork 0
mirror of https://github.com/osmarks/nanogpt-experiments.git synced 2024-11-10 20:09:58 +00:00
Code Issues Releases Wiki Activity
40 Commits 1 Branch 0 Tags 2.3 MiB
27fc6a4112
Commit Graph

3 Commits

Author SHA1 Message Date
Andrej Karpathy
27fc6a4112 small tweaks to notebook 2023-01-06 02:13:04 +00:00
Andrej Karpathy
69d1a5f1af update scaling laws. basically i can't reproduce any of params, flops, or scaling laws of the Chinchilla paper atm... 2023-01-06 02:01:08 +00:00
Andrej Karpathy
c72ecf5d93 add a notebook trying to reproduce chinchilla scaling laws. I can't get the numbers to be exactly right, have to look at more 2023-01-04 00:59:34 +00:00