Logo image
Focus-Shifting Attack: An Adversarial Attack That Retains Saliency Map Information and Manipulates Model Explanations
期刊文章   同儕審查

Focus-Shifting Attack: An Adversarial Attack That Retains Saliency Map Information and Manipulates Model Explanations

Qi-Xian Huang, Lin-Kuan Chiang, Min-Yi ChiuHung-Min Sun
IEEE Transactions on Reliability, 卷.73(2), 頁碼.808-819
06/2024

摘要

Adversarial attack;Artificial intelligence;Data models;Deep learning;deep learning (DL);explainable artificial intelligence (XAI);model explanations;Perturbation methods;Predictive models;saliency map;Sun;Training Safety Risk Reliability and Quality Electrical and Electronic Engineering

With the increased use of deep learning in many fields, a question has been raised: &null much should we trust the results generated by deep learning models?&null Thus, there has been much research into the interpretations of model results, in order to open the black box of deep learning. The focus is more on interpretation than prediction in some fields such as medicine. Adversarial attacks are the most direct threats to deep learning models. They can add undetectable perturbations to the data to make the models give incorrect results, and model explanations are also susceptible to attacks. This leads to a loss of trust in explanations provided by the models, limiting the application and commercial value of deep learning. This research proposes a targeted adversarial attack algorithm that manipulates the interpretation of the model. Unlike other adversarial attacks on model interpretation, focus-shifting attack (FS Attack) can preserve the numerical depth of the original saliency map without specifying a perturbation budget. Experiments have shown that the FS Attack has a higher degree of image similarity and misleading interpretation than other adversarial attacks, and the property of preserving the numerical depth of the original saliency map makes it more difficult to detect. This study uses several common explanation methods as experimental subjects to investigate how these explanations can be manipulated and evaluate the effectiveness of the attack under different conditions. Under a particular interpretation, the FS Attack has a highly successful attack rate of 94.6$&null, which is a critical adversarial attack.

相關連結

指標

1 檢視次數

詳細資料

Logo image