A dual benchmarking study of facial forgery and facial forensics

Abstract In recent years, visual facial forgery has reached a level of sophistication that humans cannot identify fraud, which poses a significant threat to information security. A wide range of malicious applications have emerged, such as deepfake, fake news, defamation or blackmailing of celebriti...

Full description

Saved in:
Bibliographic Details
Main Authors: Minh Tam Pham, Thanh Trung Huynh, Thanh Tam Nguyen, Thanh Toan Nguyen, Thanh Thi Nguyen, Jun Jo, Hongzhi Yin, Quoc Viet Hung Nguyen
Format: Article
Language:English
Published: Wiley 2024-12-01
Series:CAAI Transactions on Intelligence Technology
Subjects:
Online Access:https://doi.org/10.1049/cit2.12362
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841543336884699136
author Minh Tam Pham
Thanh Trung Huynh
Thanh Tam Nguyen
Thanh Toan Nguyen
Thanh Thi Nguyen
Jun Jo
Hongzhi Yin
Quoc Viet Hung Nguyen
author_facet Minh Tam Pham
Thanh Trung Huynh
Thanh Tam Nguyen
Thanh Toan Nguyen
Thanh Thi Nguyen
Jun Jo
Hongzhi Yin
Quoc Viet Hung Nguyen
author_sort Minh Tam Pham
collection DOAJ
description Abstract In recent years, visual facial forgery has reached a level of sophistication that humans cannot identify fraud, which poses a significant threat to information security. A wide range of malicious applications have emerged, such as deepfake, fake news, defamation or blackmailing of celebrities, impersonation of politicians in political warfare, and the spreading of rumours to attract views. As a result, a rich body of visual forensic techniques has been proposed in an attempt to stop this dangerous trend. However, there is no comprehensive, fair, and unified performance evaluation to enlighten the community on best performing methods. The authors present a systematic benchmark beyond traditional surveys that provides in‐depth insights into facial forgery and facial forensics, grounding on robustness tests such as contrast, brightness, noise, resolution, missing information, and compression. The authors also provide a practical guideline of the benchmarking results, to determine the characteristics of the methods that serve as a comparative reference in this never‐ending war between measures and countermeasures. The authors’ source code is open to the public.
format Article
id doaj-art-c15b3723fcc446d2bd4942075d85ee0c
institution Kabale University
issn 2468-2322
language English
publishDate 2024-12-01
publisher Wiley
record_format Article
series CAAI Transactions on Intelligence Technology
spelling doaj-art-c15b3723fcc446d2bd4942075d85ee0c2025-01-13T14:05:51ZengWileyCAAI Transactions on Intelligence Technology2468-23222024-12-01961377139710.1049/cit2.12362A dual benchmarking study of facial forgery and facial forensicsMinh Tam Pham0Thanh Trung Huynh1Thanh Tam Nguyen2Thanh Toan Nguyen3Thanh Thi Nguyen4Jun Jo5Hongzhi Yin6Quoc Viet Hung Nguyen7Griffith University Gold Coast Campus Queensland AustraliaEcole Polytechnique Federale de Lausanne Vaud SwitzerlandGriffith University Gold Coast Campus Queensland AustraliaFaculty of Information Technology HUTECH University Ho Chi Minh City VietnamDeakin University Geelong Victoria AustraliaGriffith University Gold Coast Campus Queensland AustraliaThe University of Queensland St Lucia Queensland AustraliaGriffith University Gold Coast Campus Queensland AustraliaAbstract In recent years, visual facial forgery has reached a level of sophistication that humans cannot identify fraud, which poses a significant threat to information security. A wide range of malicious applications have emerged, such as deepfake, fake news, defamation or blackmailing of celebrities, impersonation of politicians in political warfare, and the spreading of rumours to attract views. As a result, a rich body of visual forensic techniques has been proposed in an attempt to stop this dangerous trend. However, there is no comprehensive, fair, and unified performance evaluation to enlighten the community on best performing methods. The authors present a systematic benchmark beyond traditional surveys that provides in‐depth insights into facial forgery and facial forensics, grounding on robustness tests such as contrast, brightness, noise, resolution, missing information, and compression. The authors also provide a practical guideline of the benchmarking results, to determine the characteristics of the methods that serve as a comparative reference in this never‐ending war between measures and countermeasures. The authors’ source code is open to the public.https://doi.org/10.1049/cit2.12362benchmarkdeepfakedigital forensicsvisual facial forgery
spellingShingle Minh Tam Pham
Thanh Trung Huynh
Thanh Tam Nguyen
Thanh Toan Nguyen
Thanh Thi Nguyen
Jun Jo
Hongzhi Yin
Quoc Viet Hung Nguyen
A dual benchmarking study of facial forgery and facial forensics
CAAI Transactions on Intelligence Technology
benchmark
deepfake
digital forensics
visual facial forgery
title A dual benchmarking study of facial forgery and facial forensics
title_full A dual benchmarking study of facial forgery and facial forensics
title_fullStr A dual benchmarking study of facial forgery and facial forensics
title_full_unstemmed A dual benchmarking study of facial forgery and facial forensics
title_short A dual benchmarking study of facial forgery and facial forensics
title_sort dual benchmarking study of facial forgery and facial forensics
topic benchmark
deepfake
digital forensics
visual facial forgery
url https://doi.org/10.1049/cit2.12362
work_keys_str_mv AT minhtampham adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhtrunghuynh adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhtamnguyen adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhtoannguyen adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhthinguyen adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT junjo adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT hongzhiyin adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT quocviethungnguyen adualbenchmarkingstudyoffacialforgeryandfacialforensics
AT minhtampham dualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhtrunghuynh dualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhtamnguyen dualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhtoannguyen dualbenchmarkingstudyoffacialforgeryandfacialforensics
AT thanhthinguyen dualbenchmarkingstudyoffacialforgeryandfacialforensics
AT junjo dualbenchmarkingstudyoffacialforgeryandfacialforensics
AT hongzhiyin dualbenchmarkingstudyoffacialforgeryandfacialforensics
AT quocviethungnguyen dualbenchmarkingstudyoffacialforgeryandfacialforensics