EleutherAI/LDS-retrain-bank-adamw-N4k-bs256
Viewer • Updated • 2k • 643
Leave-1%-out retrain banks and datasets for training-data attribution: measured per-query loss changes, the ground truth for LDS.
Note Pre-tokenized WikiText-2 chunks for the Bae et al. 2024 SOURCE replication