Skip to content

Add classical SGD + momentum to stock GPT-2 Small FineWeb TPU speedrun - #170

Merged
charlesmartin14 merged 7 commits into
mainfrom
chatgpt/stock-gpt2-sgd-momentum-20261015
Oct 15, 2026
Merged

charlesmartin14 merged 7 commits into
mainfrom
chatgpt/stock-gpt2-sgd-momentum-20261015

Document stock GPT-2 SGD momentum recipe and required validation sweep

8cfcadf
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error, 1 warning, and 1 notice
one-head-nanogpt
failed Oct 15, 2026 in 4m 15s