Skip to content

Commit fc845bd

Browse files
authored
Update README.md
1 parent 68e2b8c commit fc845bd

File tree

1 file changed

+12
-12
lines changed

1 file changed

+12
-12
lines changed

README.md

+12-12
Original file line numberDiff line numberDiff line change
@@ -23,33 +23,33 @@ We have gone beyond traditional fine-tuning methods by exploring the impact of s
2323
One of the following commands may be run to train the chosen pre-trained model followed by pruning.
2424

2525
**OMP**
26-
26+
```
2727
python -u main_imp.py --data ./data --dataset ${data} --arch ${arch} --prune_type rewind_lt --rewind_epoch 8 --save_dir ${save_dir} --rate ${rate} --pruning_times 2 --num_workers 8
28-
28+
```
2929
**IMP**
30-
30+
```
3131
python -u main_imp.py --data ./data --dataset ${data} --arch ${arch} --prune_type rewind_lt --rewind_epoch 8 --save_dir ${save_dir} --rate 0.2 --pruning_times ${pruning_times} --num_workers 8
32-
32+
```
3333
## 4. Unlearning
3434

3535
Following pruning one of these may be run to carry out unlearning.
3636

3737
**FT**
38-
38+
```
3939
python -u main_forget.py --save_dir ${save_dir} --mask ${mask_path} --unlearn FT --num_indexes_to_replace 4500 --unlearn_lr 0.01 --unlearn_epochs 10
40-
40+
```
4141
**GA**
42-
42+
```
4343
python -u main_forget.py --save_dir ${save_dir} --mask ${mask_path} --unlearn GA --num_indexes_to_replace 4500 --unlearn_lr 0.0001 --unlearn_epochs 5
44-
44+
```
4545
**FF**
46-
46+
```
4747
python -u main_forget.py --save_dir ${save_dir} --mask ${mask_path} --unlearn fisher_new --num_indexes_to_replace 4500 --alpha ${alpha}
48-
48+
```
4949
**IU**
50-
50+
```
5151
python -u main_forget.py --save_dir ${save_dir} --mask ${mask_path} --unlearn wfisher --num_indexes_to_replace 4500 --alpha ${alpha}
52-
52+
```
5353
## 5. Conclusion
5454

5555
We discovered that the introduction of sparsity can effectively enhance the accuracy of the unlearning algorithm. Moreover, the application of fine-tuning, combined with LoRA, not only substantiates this concept but also expedites the entire process.

0 commit comments

Comments
 (0)