Logo image
Towards General Visual-Linguistic Face Forgery Detection
會議論文   開放取用(OA)

Towards General Visual-Linguistic Face Forgery Detection

Ke Sun, Shen Chen, Taiping Yao, Ziyin Zhou, Jiayi Ji, Xiaoshuai Sun, Chia-Wen Lin 和 Rongrong Ji
Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online), 頁碼.19576-19586
IEEE
10/06/2025

摘要

Accuracy Annotations face forgery detection Face recognition Faces Forgery Generators Large language models multi-modal large language model Pipelines Security Training
Face manipulation techniques have achieved significant advances, presenting serious challenges to security and social trust. Recent works demonstrate that leveraging multimodal models can enhance the generalization and interpretability of face forgery detection. However, existing annotation approaches, whether through human labeling or direct Multimodal Large Language Model (MLLM) generation, often suffer from hallucination issues, leading to inaccurate text descriptions, especially for high-quality forgeries. To address this, we propose Face Forgery Text Generator (FFTG), a novel annotation pipeline that generates accurate text descriptions by leveraging forgery masks for initial region and type identification, followed by a comprehensive prompting strategy to guide MLLMs in reducing hallucination. We validate our approach through fine-tuning both CLIP with a three-branch training framework combining unimodal and multimodal objectives, and MLLMs with our structured annotations. Experimental results demonstrate that our method not only achieves more accurate annotations with higher region identification accuracy, but also leads to improvements in model performance across various forgery detection benchmarks. Our Codes are available in https://github.com/skJack/VLFFD.git.

檔案與連結 (2)

pdf
Sun_Towards_General_Visual-Linguistic_Face_Forgery_Detection_CVPR_2025_paper2.59 MB下載檢視
開放存取(OA)
url
https://openaccess.thecvf.com/content/CVPR2025/html/Sun_Towards_General_Visual-Linguistic_Face_Forgery_Detection_CVPR_2025_paper.html檢視
已出版(紀錄版本)

相關連結

指標

1 檢視次數

詳細資料

Logo image