Pinned Loading

1. BioLlamaV2 BioLlamaV2 Public

   Repository accompanying the paper "BioLlama: Improving Language Models for Biomedicine by Retrieving from Millions of Tokens"

   Jupyter Notebook 1

2. GPT2 GPT2 Public

   Following along with Andrej Karpathy's "Let's reproduce GPT-2 (124M)" https://www.youtube.com/watch?v=l8pRSuU81PU

   Jupyter Notebook

3. pythia_trials pythia_trials Public

   An ongoing investigation into mechanistic interpretability of reasoning in open LLMs like Pythia and OLMo

   Jupyter Notebook

4. APT APT Public

   Arithmetic Pretrained Transformer is a MechInterp project into how transformers learn arithmetic.

   Jupyter Notebook