Vision Forgery Trace Enhanced VLMs for Generalized AIGC Video Detection

Read full text
Authors: Lihua Wang, Pengfei Pei, Yiran He, Zihuan Huang, Shuai Hu
Cited by: 0
References: 38

Abstract

Large vision language models (VLMs) show strong open-world generalization but degrade at domain-specific tasks, while traditional small forensic models perform well on in-distribution datasets yet lack cross-distribution generalization and language-based interpretability. To address this gap, the authors propose a vision forgery trace (VFT)-VLM framework, which incorporates forensic features into a VLM without sacrificing its general reasoning ability. Specifically, a lightweight VFT extraction module learns to encode texture anomalies, edge incoherence, pixel artifacts, and frequency-domain deviations. The traces are incorporated into the InternVL2-8B backbone via low rank adaptation fine-tuning, achieving alignment between visual evidence and textual explanations. Across 14 diverse artificial intelligence-generated content benchmark datasets, VFT-VLM outperforms VLM-based large-scale models and achieves comparable or superior performance to relevant traditional small-scale models. Ablation studies confirm both VFT extraction and low rank adaptation fine-tuning are critical to the performance gains.

Fields of Study & Subjects

Digital Media Forensic Detection Generative Adversarial Networks and Image Synthesis Advanced Steganography and Watermarking Techniques

Publication details

Journal / source
International Journal of Digital Crime and Forensics
Volume
18
Issue
1
Pages
1–23
Publication date
4 March 2026
Language
NG