1
0
mirror of https://github.com/osmarks/nanogpt-experiments.git synced 2024-09-21 19:59:44 +00:00
Commit Graph

9 Commits

Author SHA1 Message Date
Oleksandr Kuvshynov
542ac51d1f nanogpt: fix multiprocessing in load_dataset on os x
The issue seems to be that _fixup_main_from_path in multiprocessing
module in python is unable to find entry point, thus, adding
```
if __name__ == '__main__'
```
2023-06-17 20:35:38 -04:00
Oleksandr Kuvshynov
bb7e96754a nanogpt: allow multithreading in load dataset 2023-06-16 20:00:17 -04:00
Laiho
6649b299eb np.sum overflows on windows 2023-05-09 16:36:59 +03:00
Andrej
d9f4735f5e
Merge pull request #10 from LaihoE/master
batch file write
2023-04-13 00:39:41 -07:00
DG
edb7a7eab0 use relative paths so that running the data prep scripts always create files in local folder, no matter where run from 2023-01-20 10:39:45 -08:00
Laiho
0a2ea95338 batch file write 2023-01-02 17:49:21 +02:00
Andrej Karpathy
2febf4463c candidate changes to apis, have to think through more 2023-01-01 01:29:48 +00:00
Andrej Karpathy
7c6ea8409e simplify the prepare script a lot, write only using one process, seems sufficient for now. ty @LaihoE for suggestion and @proger for flagging 2022-12-30 22:18:20 +00:00
Andrej Karpathy
fe8042867c first very bad commit 2022-12-28 00:58:19 +00:00