Pinned Loading

1. GPT-2 GPT-2 Public

   An implementation of the GPT 2 124 million params model

   Jupyter Notebook

2. transformer transformer Public

   An 11M-parameter GPT-style language model built from first principles in PyTorch, using causal self-attention to generate character-level fantasy text.

   Jupyter Notebook 1

3. GPT-tokenizer GPT-tokenizer Public

   A from-scratch implementation of a Generative Pre-trained Transformer (GPT) tokenizer.

   Jupyter Notebook

4. neural-probabilistic-language-model neural-probabilistic-language-model Public

   A character-level implementation of the MLP language model based on the paper 'A Neural Probabilistic Language Model' (Bengio et al., 2003)

   Jupyter Notebook 2 1