Toy Models for Mechanistic Analysis

Using small, controllable networks trained on synthetic tasks to develop interpretability techniques and validate hypotheses.