Diff Interpretation Tuning: Weight Diffs and Adapters This repository contains the weight diffs and DIT adapters used in the paper Learning to Interpret Weight Differences in Language Models (Goel et al. 2025). To play around with the weight diffs and DIT adapters from the paper, please check out our Google Colab demo notebook. This notebook shows how to load the weight diffs and adapters from this repo. The code used to train and evaluate our weight diffs and DIT adapters can be found at github.com/Aviously/diff interpretation tuning. Some of the large data files used for training can be found at hf.co/datasets/diff interpretation tuning/finetuning data. Repository structure All weight diffs and DIT adapters in the repository live under a specific / folder (e.g. hidden topic/qwen3 4b). Please consult the paper to understand what each experiment refers to. Under each / folder, there are three potential types of files: Weight Diff Index Files: These files are always named index.csv and are used to locate specific weight diffs. Example: hidden topic/qwen3 4b/index.csv. Weight Diffs: These files live alongside an index file under a folder called weight diffs . Each weight diff .pt fil…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy