Multi-view Video Splicing System
Authors: 
Guoci Cai, Yong Du, Dupeng Ye, Haiqi Yu, Jie Pan, Yiliang Wu, Xujie ZhengAuthors Info & Claims
Pages 419 - 423
Abstract
In traditional video surveillance systems, supervisors need to watch multiple surveillance images at the same time. Surveillance video resources are scattered and huge, making it difficult to browse them all and extract useful information from them in a timely manner. The video splicing system can be used to merge multiple images and splice and fuse images from different perspectives to form a whole image, which is convenient for personnel supervision. This article introduces a multi-view video splicing system: it consists of several video cameras. Through the GStreamer framework, video streaming is performed in real time and the pictures are transmitted into the video fusion system. In the system, SURF feature points are extracted from several pictures to simulate After the radial transformation, real-time splicing is performed on them. After comparing the APAP algorithm, Multi Blend algorithm, Stitching algorithm, and the best fusion line algorithm, the best fusion line algorithm is selected for video fusion. At the same time, considering that the system requires a large amount of data operations, if the CPU is simply used to process too many videos, the effect of the algorithm and the delay of the video are often unsatisfactory. The system uses CUDA to combine the SURF algorithm and image simulation. The radial transformation is performed on the GPU, which greatly improves the fusion effect and speed of the video. Through experiments, the system can complete the splicing task better. At the same time, compared with not using CUDA for acceleration, the frame rate is increased from 3 frames per second to 25 frames, and the display can basically achieve real-time effects.
References
[1]
IETF. 1998. "RFC 2326 - Real Time Streaming Protocol (RTSP)." Internet Engineering Task Force. https://tools.ietf.org/html/rfc2326
[2]
Herbert Bay, Tinne Tuytelaars & Luc Van Gool. 2006. SURF: Speeded Up Robust Features. In European Conference on Computer Vision (pp. 404-417). Springer. https://link.springer.com/chapter/10.1007/11744023_32.
[3]
Dennis Jr, J. E., & Schnabel, R. B. 1983. Numerical methods for unconstrained optimization and nonlinear equations (Vol. 16). SIAM. https://epubs.siam.org/doi/book/10.1137/1.9781611971200.
[4]
Percival, D., & Walden, A. 2000. Wavelet Methods for Time Series Analysis (Cambridge Series in Statistical and Probabilistic Mathematics). Cambridge: Cambridge University Press.
[5]
Samuel, P. 1964. Some studies in machine learning using the game of checkers. IBM Journal of Research and Development, 3(3), 210-229.
[6]
Avidan, S., & Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Transactions on Graphics (TOG), 26(3), 10.
[7]
Wu, H., Xu, L., Duan, L., & Luo, X. 2014. A study on delay measurement for networked video surveillance systems. IEEE Transactions on Circuits and Systems for Video Technology, 24(3), 424-434.
[8]
Zhang, Y., & Liu, J. 2010. Image filtering based on square filter. In 2010 International Conference on Computer and Information Application (pp. 484-487). IEEE.
[9]
Perona, P., & Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(7), 629-639.
[10]
Viola, P., & Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001) (Vol. 1, pp. I-511). IEEE.
[11]
Liu, Y., Zhang, C., & Zhang, G. 2014. APAP: An adaptive parameterization algorithm for accurate polygonal approximation. Computer-Aided Design, 54, 85-94.
[12]
Peter J. Burt and Edward H. Adelson. 1983. A multiresolution spline with application to image mosaics. ACM Trans. Graph. 2, 4 (October 1983), 217–236. https://doi.org/10.1145/245.247
[13]
Li L, Yao J, Lu X, 2016. Optimal seamline detection for multiple image mosaicking via graph cuts. ISPRS Journal of Photogrammetry and Remote Sensing, 2016, 113(Mar.):1-16.
[14]
Ghosh D, Kaabouch N. 2016. A Survey on Image Mosaicing Techniques. Journal of Visual Communication and Image Representation, 2016, 34(Jan.):1-11.
Index Terms
- Multi-view Video Splicing System
Recommendations
Real-time multi-camera video analytics system on GPU
In this article, parallel implementation of a real-time intelligent video surveillance system on Graphics Processing Unit (GPU) is described. The system is based on background subtraction and composed of motion detection, camera sabotage detection (...
On multi-view video segmentation for object-based coding
A novel scheme for multi-view segmentation and tracking is proposed aiming to acquire perceptually consistent results for object-based coding. Firstly, a classic image segmentation technique is employed to perform initial segmentation to divide the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2023
1809 pages
ISBN:9798400708305
DOI:10.1145/3650400
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 April 2024
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
EITCE 2023
EITCE 2023: 2023 7th International Conference on Electronic Information Technology and Computer Engineering
October 20 - 22, 2023
Xiamen, China
Acceptance Rates
Overall Acceptance Rate 508 of 972 submissions, 52%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 15Total Downloads
- Downloads (Last 12 months)15
- Downloads (Last 6 weeks)2
Reflects downloads up to 12 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format