We use cookies to measure traffic and show relevant ads. By clicking Accept you agree to our use of analytics and advertising cookies.
Experiment shows why TinyStories suppresses Induction Heads in GPT-2. Analysis of SAE, metrics and comparison with Previous Token Heads. Study the impact of the dataset on ICL for your models.
