Forensic of video object removal tamper based on 3D dual-stream network

In order to solve the problems of inaccurate temporal detection and location of the object removal tampered video, a video tamper forensics method based on 3D dual-stream network was proposed.Firstly, the spatial rich model (SRM) layer was used to extract the high-frequency information from video fr...

Full description

Saved in:
Bibliographic Details
Main Authors: Lizhi XIONG, Mengqi CAO, Zhangjie FU
Format: Article
Language:zho
Published: Editorial Department of Journal on Communications 2021-12-01
Series:Tongxin xuebao
Subjects:
Online Access:http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021226/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841539243001774080
author Lizhi XIONG
Mengqi CAO
Zhangjie FU
author_facet Lizhi XIONG
Mengqi CAO
Zhangjie FU
author_sort Lizhi XIONG
collection DOAJ
description In order to solve the problems of inaccurate temporal detection and location of the object removal tampered video, a video tamper forensics method based on 3D dual-stream network was proposed.Firstly, the spatial rich model (SRM) layer was used to extract the high-frequency information from video frames.Secondly, the improved 3D convolution (C3D) network was used as the feature extractor of the dual-stream network to extract the high-frequency information and low-frequency information from the high-frequency frame and the original video frame respectively.Finally, through compact bilinear pooling (CBP) layer, two sets of different feature vectors were fused into one set of feature vectors for classification prediction.The experimental results demonstrate that the classification accuracy of the proposed method in all video frames has an advantage in SYSU-OBJFORG dataset, which makes the temporal detection and location of object removal tampered video more accurate.
format Article
id doaj-art-f5742fb47e514b3e8a6548b66daf57c7
institution Kabale University
issn 1000-436X
language zho
publishDate 2021-12-01
publisher Editorial Department of Journal on Communications
record_format Article
series Tongxin xuebao
spelling doaj-art-f5742fb47e514b3e8a6548b66daf57c72025-01-14T07:23:24ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2021-12-014220221159747010Forensic of video object removal tamper based on 3D dual-stream networkLizhi XIONGMengqi CAOZhangjie FUIn order to solve the problems of inaccurate temporal detection and location of the object removal tampered video, a video tamper forensics method based on 3D dual-stream network was proposed.Firstly, the spatial rich model (SRM) layer was used to extract the high-frequency information from video frames.Secondly, the improved 3D convolution (C3D) network was used as the feature extractor of the dual-stream network to extract the high-frequency information and low-frequency information from the high-frequency frame and the original video frame respectively.Finally, through compact bilinear pooling (CBP) layer, two sets of different feature vectors were fused into one set of feature vectors for classification prediction.The experimental results demonstrate that the classification accuracy of the proposed method in all video frames has an advantage in SYSU-OBJFORG dataset, which makes the temporal detection and location of object removal tampered video more accurate.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021226/object removal tamper detectionvideo passive forensics3D convolutiondual-stream networkcompact bi-linear pooling
spellingShingle Lizhi XIONG
Mengqi CAO
Zhangjie FU
Forensic of video object removal tamper based on 3D dual-stream network
Tongxin xuebao
object removal tamper detection
video passive forensics
3D convolution
dual-stream network
compact bi-linear pooling
title Forensic of video object removal tamper based on 3D dual-stream network
title_full Forensic of video object removal tamper based on 3D dual-stream network
title_fullStr Forensic of video object removal tamper based on 3D dual-stream network
title_full_unstemmed Forensic of video object removal tamper based on 3D dual-stream network
title_short Forensic of video object removal tamper based on 3D dual-stream network
title_sort forensic of video object removal tamper based on 3d dual stream network
topic object removal tamper detection
video passive forensics
3D convolution
dual-stream network
compact bi-linear pooling
url http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021226/
work_keys_str_mv AT lizhixiong forensicofvideoobjectremovaltamperbasedon3ddualstreamnetwork
AT mengqicao forensicofvideoobjectremovaltamperbasedon3ddualstreamnetwork
AT zhangjiefu forensicofvideoobjectremovaltamperbasedon3ddualstreamnetwork