deep-ignorance-lens-sft-ret2-rm100
Unlearned model using tuned lens unlearning (SFT, full-rank).
Base model: EleutherAI/deep-ignorance-unfiltered
Training hyperparameters
| Parameter | Value |
|---|---|
| Algorithm | Tuned Lens |
| Mode | SFT (full-rank) |
| retain_coef | 2 |
| remove_coef | 100 |
| Learning rate | 1e-4 |
Evaluation results
| Benchmark | Accuracy |
|---|---|
| WMDP Bio Robust | 0.3514 |
| MMLU | 0.4239 |
- Downloads last month
- 47
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for EleutherAI/deep-ignorance-lens-sft-ret2-rm100
Unable to build the model tree, the base model loops to the model itself. Learn more.