Improving deepfake detectors against real-world perturbations with amplitude-phase switch augmentation

Yuhang Lu; Ruizhi Luo; Touradj Ebrahimi

doi:10.1117/12.2676400

4 October 2023 Improving deepfake detectors against real-world perturbations with amplitude-phase switch augmentation

Yuhang Lu, Ruizhi Luo, Touradj Ebrahimi

Proceedings Volume 12674, Applications of Digital Image Processing XLVI; 1267402 (2023) https://doi.org/10.1117/12.2676400
Event: SPIE Optical Engineering + Applications, 2023, San Diego, California, United States

Abstract

In recent years, the remarkable progress in facial manipulation techniques has raised social concerns due to their potential malicious usage and has received considerable attention from both industry and academia. While current deep learning-based face forgery detection methods have achieved promising results, their performance often degrades drastically when they are tested in non-trivial situations under realistic perturbations. This paper proposes to leverage the information in the frequency domain, particularly the phase spectrum, to better differentiate between deepfakes and authentic images. Specifically, a new augmentation method called degradation-based amplitude-phase switch (DAPS) is proposed, which disregards the sensitive amplitude spectrum of a forged facial image and enforces the detection network to focus on phase components during the training process. Extensive evaluation results from a realistic assessment framework show that the proposed augmentation method significantly improves the robustness of two deepfake detectors analyzed and consistently outperform other augmentation approaches under various perturbations.

Conference Presentation

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yuhang Lu, Ruizhi Luo, and Touradj Ebrahimi "Improving deepfake detectors against real-world perturbations with amplitude-phase switch augmentation", Proc. SPIE 12674, Applications of Digital Image Processing XLVI, 1267402 (4 October 2023); https://doi.org/10.1117/12.2676400

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available