diff --git a/README.md b/README.md index 14ff385..92b5b07 100644 --- a/README.md +++ b/README.md @@ -11,15 +11,19 @@ Because the code is so simple, it is very easy to hack to your needs, train new ## install +``` +pip install torch numpy transformers datasets tiktoken wandb tqdm +``` + Dependencies: - [pytorch](https://pytorch.org) <3 - [numpy](https://numpy.org/install/) <3 -- `pip install transformers` for huggingface transformers <3 (to load GPT-2 checkpoints) -- `pip install datasets` for huggingface datasets <3 (if you want to download + preprocess OpenWebText) -- `pip install tiktoken` for OpenAI's fast BPE code <3 -- `pip install wandb` for optional logging <3 -- `pip install tqdm` <3 +- `transformers` for huggingface transformers <3 (to load GPT-2 checkpoints) +- `datasets` for huggingface datasets <3 (if you want to download + preprocess OpenWebText) +- `tiktoken` for OpenAI's fast BPE code <3 +- `wandb` for optional logging <3 +- `tqdm` for progress bars <3 ## quick start