CN112135068A - Method and device for fusion processing of multiple input videos - Google Patents
Method and device for fusion processing of multiple input videos Download PDFInfo
- Publication number
- CN112135068A CN112135068A CN202011004552.1A CN202011004552A CN112135068A CN 112135068 A CN112135068 A CN 112135068A CN 202011004552 A CN202011004552 A CN 202011004552A CN 112135068 A CN112135068 A CN 112135068A
- Authority
- CN
- China
- Prior art keywords
- video
- image
- processing
- fusion
- post
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007499 fusion processing Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 title claims abstract description 13
- 230000004927 fusion Effects 0.000 claims abstract description 52
- 238000012805 post-processing Methods 0.000 claims abstract description 26
- 238000012545 processing Methods 0.000 claims abstract description 11
- 230000000007 visual effect Effects 0.000 claims abstract description 7
- 238000006243 chemical reaction Methods 0.000 claims abstract description 4
- 238000001914 filtration Methods 0.000 claims abstract description 4
- 238000013519 translation Methods 0.000 claims abstract description 4
- 238000007781 pre-processing Methods 0.000 claims description 15
- 230000003993 interaction Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 239000000872 buffer Substances 0.000 claims 1
- 230000003139 buffering effect Effects 0.000 claims 1
- 239000002699 waste material Substances 0.000 abstract description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 238000005094 computer simulation Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
- H04N5/213—Circuitry for suppressing or minimising impulsive noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Circuits (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a method and a device for multi-input video fusion processing, wherein the method comprises the following steps: step A: acquiring video information, and performing format conversion on the video; and B: performing rotation translation on the video images to enable a plurality of videos to be fused into an image with a wide visual field; and C: carrying out image filtering enhancement processing on the video; step D: carrying out scaling and frame rate lifting processing on the image data, and outputting a video; the invention has the beneficial effects that: the video image fusion unit generates an address and writes a fixed data packet in the address, the post-processing subsystem zooms image information and is also used for improving image frame frequency, and the problem that block scheduling and random reading and writing of memory resources easily cause waste of processor and memory resources due to the fact that a plurality of channels are fused and independently stored in the traditional multi-video fusion technology is solved.
Description
Technical Field
The invention relates to the field of video fusion processing, in particular to a method and a device for multi-input video fusion processing, and belongs to the technical field of video fusion processing.
Background
The video fusion technology is a branch of the virtual reality technology, and can also be said to be a development stage of the virtual reality, the video fusion technology is to fuse one or more image sequence videos which are collected by a video collecting device and related to a certain scene or model with a virtual scene related to the scene to generate a new virtual scene or model related to the scene, an information combination body which cannot be independently completed no matter the virtual scene or the video is obtained due to the addition of the video in the model, the video fusion aims to increase the interactivity of the virtual scene and the reality, reduce the uncertain factors of information in a computer model and increase the information carrying capacity of the virtual model, a bridge is erected between the reality and the virtual, the application field of the virtual reality technology is expanded, and the preprocessing technology is mainly used for carrying out geometric correction, noise elimination and noise elimination on the video images, Color; brightness adjustment, registration and the like, wherein video image registration refers to finding the maximum correlation between a video image and a three-dimensional virtual scene so as to eliminate information difference of the image in the directions of space, phase, resolution and the like and achieve the purposes of more real fusion and more accurate information, an information fusion layer is fusion of the video image, the video image fusion can be divided into pixel level, characteristic level, decision level fusion and the like from low to high according to intelligence, the pixel level fusion refers to splicing and fusion based on image pixels, two or more images are fused into a whole, and the characteristic level fusion carries out image splicing and fusion based on the obvious characteristics of the images, such as lines, buildings and the like.
The traditional multi-video fusion technology is generally the fusion of a plurality of channels, and the mode of a plurality of channels and independent storage easily causes the block scheduling and random reading and writing of memory resources, and causes the waste of processor and memory resources.
Disclosure of Invention
The invention aims to solve the problems that the block scheduling and random reading and writing of memory resources are easily caused and the waste of processor and memory resources is caused by the mode that a plurality of channels are fused and independently stored in the traditional multi-video fusion technology, so that a method and a device for multi-input video fusion processing are provided.
The purpose of the invention can be realized by the following technical scheme: a method for multi-input video fusion processing comprises the following steps:
step A: acquiring video information, and performing format conversion on the video;
and B: performing rotation translation on the video images to enable a plurality of videos to be fused into an image with a wide visual field;
and C: carrying out image filtering enhancement processing on the video;
step D: and carrying out scaling and frame rate lifting processing on the image data, and outputting a video.
The embodiment of the invention also provides a multi-input video fusion processing device, which comprises:
the preprocessing subsystem is used for acquiring video images and converting formats;
the video image fusion unit is used for rotating and translating the video images to fuse a plurality of video images into an image with a wide visual field;
the post-processing subsystem is used for scaling the image information and also used for improving the frame frequency of the image;
the OSD human-computer interaction control module is used for controlling the on-off of the video image fusion unit;
and the power supply unit is electrically connected with the preprocessing subsystem, the video image fusion unit and the post-processing subsystem and provides electric energy for the preprocessing subsystem, the video image fusion unit and the post-processing subsystem.
Further, the method comprises the following steps: the preprocessing subsystem comprises a camera, a single chip microcomputer and a video decoding board, and the camera is used for collecting image information.
Further, the method comprises the following steps: the post-processing subsystem comprises a fusion cutting module, a scaling module, a histogram statistical module and a frame frequency lifting module.
Further, the method comprises the following steps: all modules in the post-processing subsystem are ready to receive data and then set their respective status registers, read each status register, and write a ready signal into the register.
Further, the method comprises the following steps: the video image fusion unit comprises a register and a processor, the video image fusion unit is used for writing image size format information into the register, the processor in the video image fusion unit writes the image size data into all the registers after monitoring the data, and transmits the signals to the post-processing subsystem to start the scaling module to start working, the post-processing system caches the video image information for the image data signals sent by the video image fusion unit and performs column caching to complete the scaling operation of the video image, the scaling operation uses a bicubic processing algorithm for line pixels and a bilinear scaling algorithm for column pixels, the histogram statistic module and the frame frequency promotion module are used for frame frequency promotion and image quality improvement of the scaled image data, and the image data are unified into a standard time sequence format.
Compared with the prior art, the invention has the beneficial effects that:
the multi-channel convergence video image fusion unit is used for entering the video image fusion unit, the video image fusion unit generates an address and writes a fixed data packet in the address, the post-processing subsystem zooms image information and is also used for improving image frame frequency, and the problems that block scheduling and random reading and writing of memory resources are easily caused and processor and memory resources are wasted due to the fact that a plurality of channels are fused and independently stored in the traditional multi-video fusion technology are solved.
Drawings
In order to facilitate understanding for those skilled in the art, the present invention will be further described with reference to the accompanying drawings.
FIG. 1 is a system diagram of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the following embodiments, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a method for multi-input video fusion processing includes the following steps:
step A: acquiring video information, and performing format conversion on the video;
and B: performing rotation translation on the video images to enable a plurality of videos to be fused into an image with a wide visual field;
and C: carrying out image filtering enhancement processing on the video;
step D: carrying out scaling and frame rate lifting processing on the image data, and outputting a video;
the embodiment of the invention also provides a multi-input video fusion processing device, which comprises:
the preprocessing subsystem is used for acquiring video images and converting formats;
the video image fusion unit is used for rotating and translating the video images to fuse a plurality of video images into an image with a wide visual field;
the post-processing subsystem is used for scaling the image information and also used for improving the frame frequency of the image;
the OSD human-computer interaction control module is used for controlling the on-off of the video image fusion unit;
the power supply unit is electrically connected with the preprocessing subsystem, the video image fusion unit and the post-processing subsystem and used for supplying electric energy to the preprocessing subsystem, the video image fusion unit and the post-processing subsystem;
the preprocessing subsystem comprises a camera, a singlechip and a video decoding board, and the camera is used for acquiring image information; the post-processing subsystem comprises a fusion cutting module, a scaling module, a histogram statistical module and a frame frequency lifting module; all modules in the post-processing subsystem are ready to receive data and set respective state registers, read each state register and write a ready signal into the register; the video image fusion unit comprises a register and a processor, the video image fusion unit is used for writing image size format information into the register, the processor in the video image fusion unit writes the image size data into all the registers after monitoring the data, and transmits the signals to the post-processing subsystem to start the scaling module to start working, for the image data signals sent by the video image fusion unit, the post-processing system caches the video image information and performs column caching to complete the scaling operation of the video image, the scaling operation uses a bicubic processing algorithm for line pixels and a bilinear scaling algorithm for column pixels, the histogram statistic module and the frame frequency promotion module are used for frame frequency promotion and image quality improvement of the scaled image data, and the image data is unified into a standard time sequence format, and the post-processing subsystem caches the video image information and performs frame frequency promotion and image quality improvement on the line pixels
When the system is used, the power supply unit provides electric energy for the preprocessing subsystem, the video image fusion unit and the post-processing subsystem, the preprocessing subsystem collects and converts the video images, the video image fusion unit fuses a plurality of video images into an image with a wide view field, the image enters the video image fusion unit through multi-path convergence, the video image fusion unit generates an address and writes the address into a fixed data packet, and the post-processing subsystem zooms image information and is also used for improving the image frame frequency.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (6)
1. A method for multi-input video fusion processing is characterized by comprising the following steps:
step A: acquiring video information, and performing format conversion on the video;
and B: performing rotation translation on the video images to enable a plurality of videos to be fused into an image with a wide visual field;
and C: carrying out image filtering enhancement processing on the video;
step D: and carrying out scaling and frame rate lifting processing on the image data, and outputting a video.
2. A multi-input video fusion processing apparatus, comprising:
the preprocessing subsystem is used for acquiring video images and converting formats;
the video image fusion unit is used for rotating and translating the video images to fuse a plurality of video images into an image with a wide visual field;
the post-processing subsystem is used for scaling the image information and also used for improving the frame frequency of the image;
the OSD human-computer interaction control module is used for controlling the on-off of the video image fusion unit;
and the power supply unit is electrically connected with the preprocessing subsystem, the video image fusion unit and the post-processing subsystem and provides electric energy for the preprocessing subsystem, the video image fusion unit and the post-processing subsystem.
3. The multi-input video fusion processing device according to claim 2, wherein the preprocessing subsystem comprises a camera, a single chip microcomputer and a video decoding board, and the camera is used for collecting image information.
4. The multi-input video fusion processing device according to claim 2, wherein the post-processing subsystem comprises a fusion clipping module, a scaling module, a histogram statistics module, and a frame rate boosting module.
5. The apparatus according to claim 2, wherein all modules in the post-processing subsystem are ready to receive data and set their respective status registers, read each status register, and write a ready signal to the registers.
6. The multi-input video fusion processing device according to claim 2, wherein the video image fusion unit includes registers and a processor, the video image fusion unit is configured to write the format information of the image size into the registers, the processor in the video image fusion unit writes the data of the image size into all the registers after monitoring the data, and transmits the signal to the post-processing subsystem to start the scaling module to start operation, for the image data signal sent from the video image fusion unit, the post-processing system buffers the video image information, performs column buffering to complete scaling operation of the video image, the scaling operation uses a bicubic processing algorithm for the line pixels, and uses a bilinear scaling algorithm for the column pixels, the scaled image data is subjected to frame rate enhancement and image quality improvement by the histogram statistic module and the enhancement module, and unifying the image data into a standard time sequence format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011004552.1A CN112135068A (en) | 2020-09-22 | 2020-09-22 | Method and device for fusion processing of multiple input videos |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011004552.1A CN112135068A (en) | 2020-09-22 | 2020-09-22 | Method and device for fusion processing of multiple input videos |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112135068A true CN112135068A (en) | 2020-12-25 |
Family
ID=73842555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011004552.1A Pending CN112135068A (en) | 2020-09-22 | 2020-09-22 | Method and device for fusion processing of multiple input videos |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112135068A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130107072A1 (en) * | 2011-10-31 | 2013-05-02 | Ankit Kumar | Multi-resolution ip camera |
| CN104301677A (en) * | 2014-10-16 | 2015-01-21 | 北京十方慧通科技有限公司 | Panoramic video monitoring method and device orienting large-scale scenes |
| CN109040701A (en) * | 2018-09-10 | 2018-12-18 | 合肥巨清信息科技有限公司 | A kind of video-splicing method based on the more GPU modes of large scene |
| WO2019153651A1 (en) * | 2018-02-06 | 2019-08-15 | 江苏宇特光电科技股份有限公司 | Bilateral filter pyramid based three-light image intelligent fusion method |
| CN110225315A (en) * | 2019-07-12 | 2019-09-10 | 北京派克盛宏电子科技有限公司 | Electric system screen monitored picture fusion method |
| CN111383204A (en) * | 2019-12-19 | 2020-07-07 | 北京航天长征飞行器研究所 | Video image fusion method, fusion device, panoramic monitoring system and storage medium |
-
2020
- 2020-09-22 CN CN202011004552.1A patent/CN112135068A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130107072A1 (en) * | 2011-10-31 | 2013-05-02 | Ankit Kumar | Multi-resolution ip camera |
| CN104301677A (en) * | 2014-10-16 | 2015-01-21 | 北京十方慧通科技有限公司 | Panoramic video monitoring method and device orienting large-scale scenes |
| WO2019153651A1 (en) * | 2018-02-06 | 2019-08-15 | 江苏宇特光电科技股份有限公司 | Bilateral filter pyramid based three-light image intelligent fusion method |
| CN109040701A (en) * | 2018-09-10 | 2018-12-18 | 合肥巨清信息科技有限公司 | A kind of video-splicing method based on the more GPU modes of large scene |
| CN110225315A (en) * | 2019-07-12 | 2019-09-10 | 北京派克盛宏电子科技有限公司 | Electric system screen monitored picture fusion method |
| CN111383204A (en) * | 2019-12-19 | 2020-07-07 | 北京航天长征飞行器研究所 | Video image fusion method, fusion device, panoramic monitoring system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106851386B (en) | Method and device for realizing augmented reality in television terminal based on Android system | |
| US10621464B1 (en) | Block based non-maximum suppression | |
| CN112235525A (en) | ZYNQ-based GigE interface camera target identification method and system | |
| CN113487524B (en) | Image format conversion method, apparatus, device, storage medium, and program product | |
| CN103248797A (en) | Video resolution enhancing method and module based on FPGA (field programmable gate array) | |
| CN110225316B (en) | Software and hardware cooperative multi-channel video processing device and system | |
| CN110809101A (en) | Image zooming processing method and device, electronic equipment and storage medium | |
| CN109359556A (en) | A kind of method for detecting human face and system based on low-power-consumption embedded platform | |
| WO2023005678A1 (en) | Image signal processor, image signal processing apparatus and method, chip, and terminal device | |
| CN103402068A (en) | Uncompressed video play system and method | |
| US20230086519A1 (en) | Multimedia processing chip, electronic device, and method for dynamic-image processing | |
| CN115209145A (en) | Video compression method, system, device and readable storage medium | |
| CN104469265A (en) | Glass defect image acquiring and processing system | |
| WO2023010755A1 (en) | Hdr video conversion method and apparatus, and device and computer storage medium | |
| WO2021213017A1 (en) | Video superimposition method, apparatus and system | |
| CN114302087A (en) | MIPI data transmission mode conversion method and device and electronic equipment | |
| CN113873141B (en) | Electronic equipment | |
| CN112135068A (en) | Method and device for fusion processing of multiple input videos | |
| CN113627328A (en) | Electronic device, image recognition method thereof, system on chip, and medium | |
| CN103747191A (en) | Network interaction high-definition character superimposition system | |
| CN209881907U (en) | Image acquisition equipment based on FPGA | |
| CN114095700B (en) | Panoramic infrared vision ground vibration monitoring method | |
| CN204575844U (en) | A kind of New Type Radar information acquisition apparatus | |
| CN104092998B (en) | A kind of panoramic video processing method and its device | |
| CN115967784A (en) | Image transmission processing system and method based on MIPI CSI-PHY protocol |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201225 |