This is the repository for our 2020 paper "Tasty Burgers, Soggy Fries: Probing Aspect Robustness in Aspect-Based Sentiment Analysis".
We provide a Aspect Robustness Probing test set for SemEval 2014 Aspect-Based Sentiment Analysis (ABSA).
AspectSetmentioned in the paper Section 2.3 (Table 4) is provided in data/aspectset
We generate our new probing test set by three automatic strategies:
We probed nine ABSA models (as mentioned in our paper).
If you have a new ABSA dataset, you can run our code to generate you own aspect robustness probing test set.
python code/main.py -dataset_name laptop
If you have more questions, please feel free to submit a GitHub issue.