osmarks/nanogpt-experiments
1
0
Fork 0
mirror of https://github.com/osmarks/nanogpt-experiments.git synced 2024-12-18 14:10:28 +00:00
Code Issues Releases Wiki Activity

Merge pull request #20 from lantiga/wandb-optional-import

Browse Source 
Make wandb import conditioned to wandb_log=True
This commit is contained in:
Andrej 2023-01-08 10:19:40 -08:00 committed by GitHub
commit e7cd674ce7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@ -19,7 +19,6 @@ Dependencies:
- `pip install tiktoken` for OpenAI's fast BPE code <3
- `pip install wandb` for optional logging <3
- `pip install tqdm`
- `pip install networkx`
## usage

2
train.py
View File

@ -13,7 +13,6 @@ import os
import time
import math
import wandb
import numpy as np
import torch
from torch.nn.parallel import DistributedDataParallel as DDP
@ -180,6 +179,7 @@ def get_lr(iter):
# logging
if wandb_log and gpu_id == 0:
import wandb
wandb.init(project=wandb_project, name=wandb_run_name)
wandb.config = {
"batch_size": batch_size,