StanceAttack: Adversarial Attack for Stance Detection

摘要

Stance detection aims to ascertain whether an author’s text is in favor, against, or neutral toward specific targets like public policies or social issues. While pretrained language models (PLMs) have greatly enhanced stance detection, they remain vulnerable to adversarial attacks—manipulations that maintain textual semantics but lead to incorrect predictions. Such vulnerabilities remain underexplored for stance detection. In this study, we introduce StanceAttack, an innovative adversarial attack method leveraging ChatGPT to create adversarial examples that can mislead well-trained stance detection models. We conduct experiments to evaluate our attack model by attacking state-of-the-art PLMs on two benchmark datasets. Results demonstrate that StanceAttack outperforms traditional adversarial methods with higher success rates and fewer retries. Human evaluations confirm that our adversarial examples preserve the original semantic meanings and naturalness. We share our code and data in https://github.com/chenyez/StanceAttack.