Nothing Special   »   [go: up one dir, main page]

Skip to main content
Log in

Multiple forgery detection in digital video with VGG-16-based deep neural network and KPCA

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The amount of video data is growing exponentially on a daily basis. Easily available software or mobile applications offer simple tools to perform the forgery in the video. So, before sending these videos from one place to another, it is important to verify them. In this paper, a forgery detection system is proposed to detect the multiple forgeries in the video using the VGG-16 deep neural model and KPCA (Kernel Principal Component Analysis). The proposed system works in four stages. The preprocessing approach is initially employed to extract and resize video frames. Then, a pre-trained VGG-16 model is tuned to extract the visual features from each input frame. A feature selection methodology, such as KPCA, is applied to minimize the dimensions of extracted features. Finally, correlations distribution among the selected features is analyzed to expose the forgeries. The performance of the proposed system is tested on a forged video dataset. The simulation result reveals that it gives better performance in identifying forgeries in the video, with accuracy and precision of 97.24% and 96.86%, respectively. In addition, the significance of the proposed system is that it yields superior results in post-processing operations like noise addition and adjustments to brightness, contrast, and hue.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Algorithm 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

References

  1. Aghamaleki JA, Behrad A (2016) Inter-frame video forgery detection and localization using intrinsic effects of double compression on quantization errors of video coding. Signal Process: Image Commun 47:289–302

    Google Scholar 

  2. Aloraini M, Sharifzadeh M, Schonfeld D (2020) Sequential and patch analyses for object removal video forgery detection and localization. IEEE Trans Circuits Syst Video Technol 31(3):917–930

    Article  Google Scholar 

  3. Bakas J, Naskar R, Dixit R (2019) Detection and localization of inter-frame video forgeries based on inconsistency in correlation distribution between haralick coded frames. Multimed Tools Appl 78(4):4905–4935

    Article  Google Scholar 

  4. Clideo (2020) Software available online at: https://clideo.com/editor/adjust-video/

  5. D’Avino D, Cozzolino D, Poggi G, et al. (2017) Autoencoder with recurrent neural networks for video forgery detection. Electron Imaging 2017(7):92–99

    Article  Google Scholar 

  6. Fadl S, Han Q, Qiong L (2020) Exposing video inter-frame forgery via histogram of oriented gradients and motion energy image. Multidim Syst Sign Process 31(4):1365–1384

    Article  Google Scholar 

  7. Feng C, Xu Z, Zhang W et al (2014) Automatic location of frame deletion point for digital video forensics. In: Proceedings of the 2nd ACM workshop on information hiding and multimedia security, pp 171–179

  8. FFmpeg (2019) Software available online at: https://www.ffmpeg.org/

  9. Kharat J, Chougule S (2020) A passive blind forgery detection technique to identify frame duplication attack. Multimed Tools Appl, 1–17

  10. Kingra S, Aggarwal N, Singh RD (2017) Inter-frame forgery detection in h. 264 videos using motion and brightness gradients. Multimed Tools Applic 76(24):25,767–25,786

    Article  Google Scholar 

  11. Lee JM, Yoo C, Choi SW, et al. (2004) Nonlinear process monitoring using kernel principal component analysis. Chem Eng Sci 59(1):223–234

    Article  Google Scholar 

  12. Li Z, Zhang Z, Guo S et al (2016) Video inter-frame forgery identification based on the consistency of quotient of mssim. Sec and Commun Netw 9 (17):4548–4556. https://doi.org/10.1002/sec.1648

    Article  Google Scholar 

  13. Liu Y, Huang T (2017) Exposing video inter-frame forgery by zernike opponent chromaticity moments and coarseness analysis. Multimed Syst 23(2):223–238

    Article  MathSciNet  Google Scholar 

  14. Long C, Smith E, Basharat A, et al. (2017) A c3d-based convolutional neural network for frame dropping detection in a single video shot. In: 2017 IEEE Conference on computer vision and pattern recognition workshops (CVPRW). IEEE, pp 1898–1906

  15. Long C, Basharat A, Hoogs A et al (2019) A coarse-to-fine deep convolutional neural network framework for frame duplication detection and localization in forged videos. In: CVPR Workshops, pp 1–10

  16. Pandey RC, Singh SK, Shukla K (2014) Passive copy-move forgery detection in videos. In: 2014 International conference on computer and communication technology ICCCT. IEEE, pp 301–306

  17. Qadir G, Yahaya S, Ho ATS (2012) Surrey university library for forensic analysis (sulfa) of video content, pp 1–6. http://sulfa.cs.surrey.ac.uk/

  18. REWIND (2013) Datset: [Online]. https://sites.google.com/site/rewindpolimi/downloads/datasets/video-copy-move-forgeries-datase Accessed 2 Nov 2020

  19. Shelke NA, Kasana SS (2021) A comprehensive survey on passive techniques for digital video forgery detection. Multimed Tools Appl 80(4):6247–6310

    Article  Google Scholar 

  20. Shelke NA, Kasana SS (2021) Multiple forgeries identification in digital video based on correlation consistency between entropy coded frames. Multimedia Systems, 1–14

  21. Shelke NA, Kasana SS (2021) Multiple forgery detection and localization technique for digital video using pct and nbap. Multimed Tools Appl, 1–29

  22. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:14091556

  23. Su L, Li C, Lai Y, et al. (2018) A fast forgery detection algorithm based on exponential-fourier moments for video region duplication. IEEE Trans Multimed 20(4):825–840

    Article  Google Scholar 

  24. VTD (Accessed 2 Jan 2021) Video tampering dataset: [Online]: https://www.youtube.com/channel/UCZuuu-iyZvPptbIUHT9tMrA

  25. VTL (2020) Video trace library: [Online] http://trace.eas.asu.edu/

  26. Wei W, Fan X, Song H, et al. (2019) Video tamper detection based on multi-scale mutual information. Multimed Tools Applic 78(19):27,109–27,126

    Article  Google Scholar 

  27. Zheng L, Sun T, Shi YQ (2014) Inter-frame video forgery detection based on block-wise brightness variance descriptor. In: International workshop on digital watermarking. Springer, pp 18–30

  28. Zheng Y, Bao J, Chen D et al (2021) Exploring temporal coherence for more general video face forgery detection. In: Proceedings of the IEEE/CVF International conference on computer vision, pp 15,044–15,054

Download references

Funding

The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the material preparation, data collection and analysis. Both authors read and approved the final manuscript.

Corresponding author

Correspondence to Nitin Arvind Shelke.

Ethics declarations

Conflict of interest

The authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article. Also, they have no financial interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Singara Singh Kasana contributed equally to this work.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shelke, N.A., Kasana, S.S. Multiple forgery detection in digital video with VGG-16-based deep neural network and KPCA. Multimed Tools Appl 83, 5415–5435 (2024). https://doi.org/10.1007/s11042-023-15561-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15561-0

Keywords

Navigation