FDS_2D: rethinking magnitude-phase features for DeepFake detection
Article
Yang, Gaoming, Wei, Anxing, Fang, Xianjin and Zhang, Ji. 2023. "FDS_2D: rethinking magnitude-phase features for DeepFake detection." Multimedia Systems. 29 (4), pp. 2399-2413. https://doi.org/10.1007/s00530-023-01118-6
Article Title | FDS_2D: rethinking magnitude-phase features for DeepFake detection |
---|---|
ERA Journal ID | 18082 |
Article Category | Article |
Authors | Yang, Gaoming, Wei, Anxing, Fang, Xianjin and Zhang, Ji |
Journal Title | Multimedia Systems |
Journal Citation | 29 (4), pp. 2399-2413 |
Number of Pages | 25 |
Year | 2023 |
Publisher | Springer |
Place of Publication | Germany |
ISSN | 0942-4962 |
1432-1882 | |
Digital Object Identifier (DOI) | https://doi.org/10.1007/s00530-023-01118-6 |
Web Address (URL) | https://link.springer.com/article/10.1007/s00530-023-01118-6 |
Abstract | To reduce the harm of forged information, more and more detection methods use frequency domain information. They mostly take spectra as clues to identify fake content. However, the current work tends to use only one of the magnitude and phase spectra for learning. In this paper, we notice that the magnitude and phase spectrum contain different image information. Only one spectrum is easily disturbed by noise, and the robustness of the method is difficult to guarantee. Therefore, we propose the Frequency Domain Separable DeepFake Detection (FDS_2D), which is a multi-branch network to obtain features in different frequency spectra. In FDS_2D, the spectral information is divided into three categories: the magnitude spectrum, the phase spectrum, and the relationship between the two spectra. According to their characteristics, we design independent modules for feature extraction from them. Moreover, to improve the utilization efficiency of multi-features, we propose a multi-input multi-output attention mechanism for information interaction between branches. The experimental results show that each part of FDS_2D effectively extracts and applies spectral information; The comprehensive performance of our model is verified on FaceForensic + + , Celeb-DF, and DFDC. It proves that the ability of FDS_2D to detect DeepFake is not inferior to existing models. |
Keywords | DeepFake detection; Frequency; Magnitude spectra; Phase spectra; Spectrum relationship |
ANZSRC Field of Research 2020 | 460306. Image processing |
Public Notes | Files associated with this item cannot be displayed due to copyright restrictions. |
Byline Affiliations | Anhui University of Science and Technology, China |
School of Mathematics, Physics and Computing |
Permalink -
https://research.usq.edu.au/item/z272w/fds-2d-rethinking-magnitude-phase-features-for-deepfake-detection
55
total views0
total downloads3
views this month0
downloads this month