osmarks/nanogpt-experiments
1
0
Fork 0
mirror of https://github.com/osmarks/nanogpt-experiments.git synced 2025-10-17 16:47:39 +00:00
Code Issues Releases Wiki Activity

Merge pull request #463 from goswamig/test1

Browse Source 
Fixing eval path in README
This commit is contained in:
Andrej
2024-06-03 09:51:52 -07:00
committed by GitHub
parent 7c7e627108 3ab86ce851
commit 9755682b98
1 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@@ -131,10 +131,10 @@ Finally, to train on a single GPU simply run the `python train.py` script. Have
OpenAI GPT-2 checkpoints allow us to get some baselines in place for openwebtext. We can get the numbers as follows:
```sh
python train.py eval_gpt2
python train.py eval_gpt2_medium
python train.py eval_gpt2_large
python train.py eval_gpt2_xl
$ python train.py config/eval_gpt2.py
$ python train.py config/eval_gpt2_medium.py
$ python train.py config/eval_gpt2_large.py
$ python train.py config/eval_gpt2_xl.py
```
and observe the following losses on train and val: