We use cookies to measure traffic and show relevant ads. By clicking Accept you agree to our use of analytics and advertising cookies.
Experiment ukazuje, proč TinyStories potlačuje Induction Heads v GPT-2. Analýza SAE, metrik a srovnání s Previous Token Heads. Prozkoumejte vliv datasetu na ICL pro vaše modely.