Abstract
The amount of video data is growing exponentially on a daily basis. Easily available software or mobile applications offer simple tools to perform the forgery in the video. So, before sending these videos from one place to another, it is important to verify them. In this paper, a forgery detection system is proposed to detect the multiple forgeries in the video using the VGG-16 deep neural model and KPCA (Kernel Principal Component Analysis). The proposed system works in four stages. The preprocessing approach is initially employed to extract and resize video frames. Then, a pre-trained VGG-16 model is tuned to extract the visual features from each input frame. A feature selection methodology, such as KPCA, is applied to minimize the dimensions of extracted features. Finally, correlations distribution among the selected features is analyzed to expose the forgeries. The performance of the proposed system is tested on a forged video dataset. The simulation result reveals that it gives better performance in identifying forgeries in the video, with accuracy and precision of 97.24% and 96.86%, respectively. In addition, the significance of the proposed system is that it yields superior results in post-processing operations like noise addition and adjustments to brightness, contrast, and hue.
Similar content being viewed by others
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
References
Aghamaleki JA, Behrad A (2016) Inter-frame video forgery detection and localization using intrinsic effects of double compression on quantization errors of video coding. Signal Process: Image Commun 47:289–302
Aloraini M, Sharifzadeh M, Schonfeld D (2020) Sequential and patch analyses for object removal video forgery detection and localization. IEEE Trans Circuits Syst Video Technol 31(3):917–930
Bakas J, Naskar R, Dixit R (2019) Detection and localization of inter-frame video forgeries based on inconsistency in correlation distribution between haralick coded frames. Multimed Tools Appl 78(4):4905–4935
Clideo (2020) Software available online at: https://clideo.com/editor/adjust-video/
D’Avino D, Cozzolino D, Poggi G, et al. (2017) Autoencoder with recurrent neural networks for video forgery detection. Electron Imaging 2017(7):92–99
Fadl S, Han Q, Qiong L (2020) Exposing video inter-frame forgery via histogram of oriented gradients and motion energy image. Multidim Syst Sign Process 31(4):1365–1384
Feng C, Xu Z, Zhang W et al (2014) Automatic location of frame deletion point for digital video forensics. In: Proceedings of the 2nd ACM workshop on information hiding and multimedia security, pp 171–179
FFmpeg (2019) Software available online at: https://www.ffmpeg.org/
Kharat J, Chougule S (2020) A passive blind forgery detection technique to identify frame duplication attack. Multimed Tools Appl, 1–17
Kingra S, Aggarwal N, Singh RD (2017) Inter-frame forgery detection in h. 264 videos using motion and brightness gradients. Multimed Tools Applic 76(24):25,767–25,786
Lee JM, Yoo C, Choi SW, et al. (2004) Nonlinear process monitoring using kernel principal component analysis. Chem Eng Sci 59(1):223–234
Li Z, Zhang Z, Guo S et al (2016) Video inter-frame forgery identification based on the consistency of quotient of mssim. Sec and Commun Netw 9 (17):4548–4556. https://doi.org/10.1002/sec.1648
Liu Y, Huang T (2017) Exposing video inter-frame forgery by zernike opponent chromaticity moments and coarseness analysis. Multimed Syst 23(2):223–238
Long C, Smith E, Basharat A, et al. (2017) A c3d-based convolutional neural network for frame dropping detection in a single video shot. In: 2017 IEEE Conference on computer vision and pattern recognition workshops (CVPRW). IEEE, pp 1898–1906
Long C, Basharat A, Hoogs A et al (2019) A coarse-to-fine deep convolutional neural network framework for frame duplication detection and localization in forged videos. In: CVPR Workshops, pp 1–10
Pandey RC, Singh SK, Shukla K (2014) Passive copy-move forgery detection in videos. In: 2014 International conference on computer and communication technology ICCCT. IEEE, pp 301–306
Qadir G, Yahaya S, Ho ATS (2012) Surrey university library for forensic analysis (sulfa) of video content, pp 1–6. http://sulfa.cs.surrey.ac.uk/
REWIND (2013) Datset: [Online]. https://sites.google.com/site/rewindpolimi/downloads/datasets/video-copy-move-forgeries-datase Accessed 2 Nov 2020
Shelke NA, Kasana SS (2021) A comprehensive survey on passive techniques for digital video forgery detection. Multimed Tools Appl 80(4):6247–6310
Shelke NA, Kasana SS (2021) Multiple forgeries identification in digital video based on correlation consistency between entropy coded frames. Multimedia Systems, 1–14
Shelke NA, Kasana SS (2021) Multiple forgery detection and localization technique for digital video using pct and nbap. Multimed Tools Appl, 1–29
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:14091556
Su L, Li C, Lai Y, et al. (2018) A fast forgery detection algorithm based on exponential-fourier moments for video region duplication. IEEE Trans Multimed 20(4):825–840
VTD (Accessed 2 Jan 2021) Video tampering dataset: [Online]: https://www.youtube.com/channel/UCZuuu-iyZvPptbIUHT9tMrA
VTL (2020) Video trace library: [Online] http://trace.eas.asu.edu/
Wei W, Fan X, Song H, et al. (2019) Video tamper detection based on multi-scale mutual information. Multimed Tools Applic 78(19):27,109–27,126
Zheng L, Sun T, Shi YQ (2014) Inter-frame video forgery detection based on block-wise brightness variance descriptor. In: International workshop on digital watermarking. Springer, pp 18–30
Zheng Y, Bao J, Chen D et al (2021) Exploring temporal coherence for more general video face forgery detection. In: Proceedings of the IEEE/CVF International conference on computer vision, pp 15,044–15,054
Funding
The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
All authors contributed to the material preparation, data collection and analysis. Both authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article. Also, they have no financial interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Singara Singh Kasana contributed equally to this work.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Shelke, N.A., Kasana, S.S. Multiple forgery detection in digital video with VGG-16-based deep neural network and KPCA. Multimed Tools Appl 83, 5415–5435 (2024). https://doi.org/10.1007/s11042-023-15561-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-15561-0