This repo contains source code and pre-processed corpora for "Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!" (accepted to NAACL-HLT 2021)
- python3
- pytorch>=1.4
- transformers==3.0.2
- cuda 10.0
Please download data from here
git clone https://github.com/xlhex/extract_and_transfer.gitTASK=blog
SEED=1234
sh train_vic.sh $TASK $SEEDTASK=blog
SEED=1234
QUERY_FILE=review_sample.tsv
PRED_FILE=review_pred.tsv
DEFENSE=temp # temp or perturb
sh pred.sh $TASK $SEED $QUERY_FILE $PRED_FILE $DEFENSE
python construct_distilled_data.py data/$TASK/review_sample.tsv data/$TASK/review_pred.tsv data/$TASK/review_train.tsvTASK=blog
SEED=1234
sh train_extract.sh $TASK $SEEDPlease cite as:
@inproceedings{he2021model,
title={Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!},
author={He, Xuanli and Lyu, Lingjuan and Sun, Lichao and Xu, Qiongkai},
booktitle={Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies},
pages={2006--2012},
year={2021}
}