osmarks/nanogpt-experiments
1
0
Fork 0
mirror of https://github.com/osmarks/nanogpt-experiments.git synced 2024-12-18 14:10:28 +00:00
Code Issues Releases Wiki Activity

ty lambda labs

Browse Source
This commit is contained in:
Andrej Karpathy 2023-01-03 21:16:07 +00:00
parent 97fc42616e
commit 5acba4b005
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -114,3 +114,7 @@ Suspiciousness
Results Results
- Actually reproduce GPT-2 results and have clean configs that reproduce the result. It was estimated ~3 years ago that the training cost of 1.5B model was ~$50K (?). Sounds a bit too high. - Actually reproduce GPT-2 results and have clean configs that reproduce the result. It was estimated ~3 years ago that the training cost of 1.5B model was ~$50K (?). Sounds a bit too high.
# acknowledgements
Thank you [Lambda labs](https://lambdalabs.com) for supporting the training costs of nanoGPT experiments.