osmarks/nanogpt-experiments
1
0
Fork 0
mirror of https://github.com/osmarks/nanogpt-experiments.git synced 2024-12-18 14:10:28 +00:00
Code Issues Releases Wiki Activity
f35dc82437
nanogpt-experiments/data/shakespeare
History
Adam Isakov f35dc82437 fix: prepare.py - added input file opening in UTF-8 encoding
2024-01-26 01:34:44 +03:00
..
prepare.py fix: prepare.py - added input file opening in UTF-8 encoding 2024-01-26 01:34:44 +03:00
readme.md candidate changes to apis, have to think through more 2023-01-01 01:29:48 +00:00

readme.md

tiny shakespeare

Tiny shakespeare, of the good old char-rnn fame :)

After running prepare.py:

  • train.bin has 301,966 tokens
  • val.bin has 36,059 tokens