CN108769564B

CN108769564B - Image acquisition system and image data processing method

Info

Publication number: CN108769564B
Application number: CN201810658787.9A
Authority: CN
Inventors: 杜延坡; 刘力; 李鹏治; 杨清祥; 仝丽阳; 王栋博
Original assignee: Henan Thinker Track Traffic Technology Research Institute
Current assignee: Henan Thinker Track Traffic Technology Research Institute
Priority date: 2018-06-25
Filing date: 2018-06-25
Publication date: 2020-05-22
Anticipated expiration: 2038-06-25
Also published as: CN108769564A

Abstract

The invention relates to an image acquisition system and an image data processing method, and belongs to the technical field of image signals. The system comprises: the system comprises an image acquisition module, an image processing module and a network transmission module. The image acquisition module converts the received LVDS signals into digital signals which can be processed by the image processing module, so that the image processing module reads the LVDS signals from the image acquisition module, further compresses the read LVDS signals, and transmits the compressed LVDS signals to the network transmission module, so that the network transmission module transmits the compressed LVDS signals to peripheral equipment, and the technical problems that the LVDS signals are short in transmission distance, low in transmission speed and prone to causing image blocking are solved.

Description

Image acquisition system and image data processing method

Technical Field

The invention belongs to the technical field of image signals, and particularly relates to an image acquisition system and an image data processing method.

Background

The LVDS interface is a low-voltage differential signal technology interface, differential signal transmission is carried out by adopting low voltage, and the voltage swing of the differential signal is only about 350 mV. The interface can enable the transmission rate of signals on a differential line to reach hundreds of Mbps, and can greatly reduce signal noise and power consumption due to the adoption of a low-voltage and low-current driving mode. At present, the LVDS signal acquisition mainly comprises an acquisition card and an LVDS conversion module, and the realization mode comprises an FPGA + DSP, an FPGA + PCI bus, an FPGA + USB sending interface and the like. The main function is mainly to convert LVDS signals into VGA, HDMI and other signals and display the signals locally.

Researchers found in the research of the present application that the current LVDS signal acquisition has the following disadvantages: the LVDS signal transmission distance is short, and the overlong communication line can increase the loss in the transmission process, reduce the transmission rate and influence the integrity of the signal; the video capture card has the advantages of high cost, complex technology, single function, small application range and difficulty in expanding other functions, and an independent software driver needs to be designed.

Disclosure of Invention

In view of the above, the present invention provides an image capturing system and an image data processing method to effectively solve the above problems.

The embodiment of the invention is realized by the following steps:

an embodiment of the present invention provides an image acquisition system, including: the system comprises an image acquisition module, an image processing module and a network transmission module, wherein the image acquisition module is connected with the image processing module, and the image processing module is connected with the network transmission module; the image acquisition module is used for receiving an externally input LVDS signal and converting the received LVDS signal into a digital signal which can be processed by the image processing module; the image processing module is used for compressing the LVDS signals read from the image acquisition module and transmitting the compressed LVDS signals to the network transmission module; the network transmission module is used for transmitting the compressed LVDS signals to peripheral equipment.

In an optional embodiment of the present invention, further comprising: the image acquisition module is connected with the image cache module, and the image cache module is connected with the image acquisition module; the image acquisition module is further configured to store the converted LVDS signals to the first image cache module, and when it is determined that the first frame of image data is received, store the received second frame of image data to the second image cache module, so as to implement alternate caching of the image data.

In an optional embodiment of the present invention, the image acquisition module is further configured to send an interrupt request to the image processing module when it is determined that the first frame of image data is received, and place the current frame of image data stored in the first image cache module in a to-be-read area of the image processing module to wait for the image processing module to read the current frame of image data; and when the second frame of image data is determined to be received, sending an interrupt request to the image processing module, and placing the current frame of image data stored in the second image cache module in a self area to be read to wait for the image processing module to read.

In an optional embodiment of the present invention, the image processing module is further configured to obtain feature data from the read LVDS signals, and analyze and compare the feature data with target data to obtain an analysis result; and sending the analysis result to the network transmission module.

In an optional embodiment of the present invention, the image acquisition module includes an FPGA and a DDR, the image processing module includes an ARM, and the FPGA is connected to an FMC interface of the ARM.

In an optional embodiment of the present invention, the network transmission module includes: the image processing module is connected with an external network through the PHY chip and the network transformer in sequence.

The embodiment of the invention also provides an image data processing method, which is applied to an image acquisition system and comprises the following steps: the system comprises an image acquisition module, an image processing module and a network transmission module; the method comprises the following steps: the image acquisition module receives an externally input LVDS signal and converts the received LVDS signal into a digital signal which can be processed by the image processing module; the image processing module compresses the LVDS signals read from the image acquisition module and transmits the compressed LVDS signals to the network transmission module; and the network transmission module transmits the compressed LVDS signals to peripheral equipment.

In an alternative embodiment of the present invention, the image capturing system further comprises: a first image caching module and a second image caching module, the method further comprising: the image acquisition module stores the converted LVDS signals to the first image cache module, and stores the received second frame of image data to the second image cache module when the first frame of image data is determined to be received, so that the image data is alternately cached.

In an alternative embodiment of the invention, the method further comprises: when the image acquisition module determines that the first frame of image data is received, the image acquisition module sends an interrupt request to the image processing module, and places the current frame of image data stored in the first image cache module in a region to be read of the image acquisition module to wait for the image processing module to read the current frame of image data; and when the second frame of image data is determined to be received, sending an interrupt request to the image processing module, and placing the current frame of image data stored in the second image cache module in a self area to be read to wait for the image processing module to read.

In an alternative embodiment of the invention, the method further comprises: the image processing module acquires characteristic data from the read LVDS signals, and analyzes and compares the characteristic data with target data to obtain an analysis result; and sending the analysis result to the network transmission module.

The image acquisition system provided by the embodiment of the invention comprises: the system comprises an image acquisition module, an image processing module and a network transmission module. The image acquisition module converts the received LVDS signals into digital signals which can be processed by the image processing module, so that the image processing module reads the LVDS signals from the image acquisition module, further compresses the read LVDS signals, and transmits the compressed LVDS signals to the network transmission module, so that the network transmission module transmits the compressed LVDS signals to peripheral equipment, and the technical problems that the LVDS signals are short in transmission distance, low in transmission speed and prone to causing image blocking are solved.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts. The above and other objects, features and advantages of the present invention will become more apparent from the accompanying drawings. Like reference numerals refer to like parts throughout the drawings. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention.

Fig. 1 shows a schematic structural diagram of an image acquisition system according to an embodiment of the present invention.

Fig. 2 shows a schematic structural diagram of an image acquisition system according to yet another embodiment of the present invention.

Fig. 3 shows a flow chart of data processing provided by an embodiment of the invention.

Fig. 4 shows a flowchart of an image data processing method provided by an embodiment of the present invention.

Icon: 100-an image acquisition system; 110-an image acquisition module; 120-an image processing module; 130-network transmission module; 140-a first image caching module; 150-second image caching module.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.

Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.

In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "inner", "outer", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings or the orientations or positional relationships that the products of the present invention are usually placed in when used, and are only used for convenience of describing the present invention and simplifying the description, but do not indicate or imply that the devices or elements referred to must have specific orientations, be constructed in specific orientations, and be operated, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.

In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; or may be an electrical connection; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

An embodiment of the present invention provides an image acquisition system 100, as shown in fig. 1. The image acquisition system 100 includes: an image acquisition module 110, an image processing module 120 and a network transmission module 130; the image acquisition module 110 is connected to the image processing module 120, and the image processing module 120 is connected to the network transmission module 130.

The image acquisition module 110 is configured to receive an externally input LVDS signal and convert the received LVDS signal into a digital signal that can be processed by the image processing module 120. That is, the image acquisition module 110 is mainly responsible for acquiring the original LVDS signals, converting the acquired original signals into digital signals that can be read by the image processing module 120, and performing buffer processing. The image acquisition module 110 may be an LVDS image acquisition card, in this embodiment, preferably, the image acquisition module 110 includes an FPGA and a ddr (double data rate). The FPGA adopts an Xlinx-Artix 7 series processor, the LVDS interface adopts an Artix7 self-contained high-speed GTP transceiver, and the speed can reach 6.6 Gb/s. The FPGA converts the externally input LVDS signal into a digital signal that can be processed by the image processing module 120 through the GTP interface.

The image processing module 120 is configured to compress the LVDS signals read from the image acquisition module 110, and transmit the compressed LVDS signals to the network transmission module 130. Further, the image processing module 120 reads the converted LVDS signal from the image acquisition module 110, compresses the converted LVDS signal, and transmits the compressed converted LVDS signal to the network transmission module 130, so as to implement remote transmission of image data.

In addition, the image processing module 120 is further configured to obtain feature data from the read LVDS signals, and analyze and compare the feature data with target data to obtain an analysis result; and sending the analysis result to the network transmission module 130 to realize remote monitoring of the image. For example, data of a region to be focused is captured from the original image data and compared with the target data or the expected data, and whether the image data is correct or not is judged.

The image processing module 120 includes an integrated circuit chip, and has signal processing capability. The integrated circuit chip may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components. The general purpose processor may be a microprocessor or the integrated circuit chip may be any conventional processor or the like. In this embodiment, preferably, the image processing module 120 includes an ARM. Wherein, ARM adopts STM32H7 series chip. The ARM adopts the self FMC peripheral interface of STM32H7 series chips to be connected with the FPGA.

When compressing data, the image processing module 120 compresses the read data based on a lossless compression algorithm, for example, a MiniLZO or QuickLZ lossless compression algorithm is used. The algorithm occupies small memory and has high compression speed. The ARM performs lossless compression processing on the original data acquired by the FPGA, so that the transmission rate of a network can be improved, the network delay time can be reduced, and meanwhile, the integrity of the data can be ensured through lossless compression.

The network transmission module 130 is configured to transmit the compressed LVDS signal to a peripheral device, so as to implement remote transmission of image data. In addition, the network transmission module 130 is further configured to transmit a result obtained after the image processing module 120 compares and analyzes the read LVDS signal, so as to implement remote monitoring of the image.

The peripheral equipment can receive compressed collected data and then perform lossless decompression on the data by adopting the same decompression algorithm, then capture data of a region needing attention from the original image data and compare the data with target data or expected data to judge whether the image data is correct or not, and accordingly remote monitoring of the image is achieved.

The network transmission module 130 may transmit wirelessly or in a wired manner.

When the network transmission module 130 transmits data in a wire-based manner, as an alternative embodiment, the network transmission module 130 includes a PHY chip and a network transformer, and the image processing module 120 is connected to an external network through the PHY chip and the network transformer in sequence.

When the network transmission module 130 transmits data in a wireless-based manner, the network transmission module 130 may be a WiFi module, a ZigBee module, a 3G module, a 4G module, or other wireless transmission modules satisfying the condition. For example, the 3G modules may be SIM6320C, CEM631, CEM600, WIDEM8800, FWP103, K3G, WM9881, etc.

As an optional implementation, the image capturing system 100 further includes: a first image buffer module 140 and a second image buffer module 150, as shown in fig. 2. The first image caching module 140 and the second image caching module 150 are both connected to the image capturing module 110.

The image acquisition module 110 is further configured to store the converted LVDS signal in the first image buffer module 140, and when it is determined that the first frame of image data is received, store the received second frame of image data in the second image buffer module 150, so as to implement alternate buffer of image data. That is, two image buffer modules are used for ping-pong operation (alternate buffer) to prevent the loss of the LVDS signal. For example, the odd frame data is stored in the first image buffer module 140, and the even frame data is stored in the second image buffer module 150.

The image acquisition module 110 is further configured to send an interrupt request to the image processing module 120 when it is determined that the first frame of image data is received, and place the current frame of image data stored in the first image cache module 140 in a to-be-read area of the image processing module 120 to wait for reading by the image processing module 120. Meanwhile, the LVDS signals after the conversion are stored in the second image buffer module 150, that is, the acquired image data of the next frame is stored in the second image buffer module 150. That is to say, when the image acquisition module 110 acquires data, the data is firstly cached in the first image cache module 140, and when a complete frame of image is stored in the first image cache module 140, the FPGA sends an interrupt signal to the ARM, and places the frame of image data in its own region to be read (virtual SRAM) to wait for the ARM to read. Meanwhile, the collected next frame of image data is cached in the second image caching module 150, so that when it is determined that the second frame of image data is received, an interrupt request is sent to the image processing module 120, and the current frame of image data stored in the second image caching module 150 is placed in the region to be read of the current frame of image data to be read by the image processing module 120.

The first image buffer module 140 and the second image buffer module 150 may be the same or different. As an alternative embodiment, the first image buffer module 140 and the second image buffer module 150 may be an integrated circuit chip having a storage capability. The integrated circuit chip may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Read Only Memory (EPROM), an electrically Erasable Read Only Memory (EEPROM), a Flash Memory (Flash Memory), and the like. In this embodiment, preferably, the first image caching module 140 and the second image caching module 150 are both Double Data Rate (DDR) synchronous dynamic random access memories.

To facilitate understanding of the data processing flow described above, it can be understood in conjunction with the schematic diagram shown in fig. 3. Wherein figure 3 only shows a general process flow and not the entire flow.

In addition, it should be noted that the image acquisition system 100 further includes a power module, and the power module mainly converts an externally input high-voltage DC power supply into various low-voltage DC power supplies required by internal FPGA, ARM, and other chips through DC-DC conversion.

An embodiment of the present invention further provides an image data processing method applied to the image capturing system 100, as shown in fig. 4. This will be explained in connection with the steps shown in fig. 4.

Step S101: the image acquisition module receives an externally input LVDS signal and converts the received LVDS signal into a digital signal which can be processed by the image processing module.

Step S102: the image processing module compresses the LVDS signals read from the image acquisition module and transmits the compressed LVDS signals to the network transmission module.

Step S103: and the network transmission module transmits the compressed LVDS signals to peripheral equipment.

The image acquisition system further comprises: a first image caching module and a second image caching module, the method further comprising: the image acquisition module stores the converted LVDS signals to the first image cache module, and stores the received second frame of image data to the second image cache module when the first frame of image data is determined to be received, so that the image data is alternately cached.

Furthermore, the method further comprises: when the image acquisition module determines that the first frame of image data is received, the image acquisition module sends an interrupt request to the image processing module, and places the current frame of image data stored in the first image cache module in a region to be read of the image acquisition module to wait for the image processing module to read the current frame of image data; and when the second frame of image data is determined to be received, sending an interrupt request to the image processing module, and placing the current frame of image data stored in the second image cache module in a self area to be read to wait for the image processing module to read.

Furthermore, the method further comprises: the image processing module acquires characteristic data from the read LVDS signals, and analyzes and compares the characteristic data with target data to obtain an analysis result; and sending the analysis result to the network transmission module.

It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An image acquisition system, comprising: the image acquisition module is connected with the image processing module, the image processing module is connected with the network transmission module, and the first image cache module and the second image cache module are both connected with the image acquisition module;

the image acquisition module is used for receiving an externally input LVDS signal and converting the received LVDS signal into a digital signal which can be processed by the image processing module;

the image processing module is used for compressing the LVDS signals read from the image acquisition module and transmitting the compressed LVDS signals to the network transmission module; the image acquisition module is further configured to store the converted LVDS signals in the first image cache module, and when it is determined that the first frame of image data is received, store the received second frame of image data in the second image cache module to implement alternate caching of the image data, where the image acquisition module sends an interrupt request to the image processing module when it is determined that the first frame of image data is received, and places the current frame of image data stored in the first image cache module in a to-be-read area of the image acquisition module to wait for the image processing module to read the current frame of image data; when the second frame of image data is determined to be received, sending an interrupt request to the image processing module, and placing the current frame of image data stored in the second image cache module in a self area to be read to wait for the image processing module to read;

the network transmission module is used for transmitting the compressed LVDS signals to peripheral equipment.

2. The image acquisition system according to claim 1, wherein the image processing module is further configured to obtain feature data from the read LVDS signals, and compare the feature data with target data to obtain an analysis result; and sending the analysis result to the network transmission module.

3. The image capture system of claim 2, wherein the image capture module comprises an FPGA and a DDR, and wherein the image processing module comprises an ARM, and wherein the FPGA interfaces with an FMC of the ARM.

4. The image acquisition system of claim 2, wherein the network transmission module comprises: the image processing module is connected with an external network through the PHY chip and the network transformer in sequence.

5. An image data processing method is applied to an image acquisition system, and comprises the following steps: the system comprises an image acquisition module, an image processing module, a network transmission module, a first image cache module and a second image cache module; the method comprises the following steps:

the image acquisition module receives an externally input LVDS signal and converts the received LVDS signal into a digital signal which can be processed by the image processing module;

the image processing module compresses the LVDS signals read from the image acquisition module and transmits the compressed LVDS signals to the network transmission module;

the network transmission module transmits the compressed LVDS signals to a peripheral device, wherein the method further includes:

the image acquisition module stores the converted LVDS signals to the first image cache module, and stores the received second frame of image data to the second image cache module when the first frame of image data is determined to be received, so that the image data is alternately cached; when the image acquisition module determines that the first frame of image data is received, the image acquisition module sends an interrupt request to the image processing module, and places the current frame of image data stored in the first image cache module in a self area to be read to wait for the image processing module to read; and when the second frame of image data is determined to be received, sending an interrupt request to the image processing module, and placing the current frame of image data stored in the second image cache module in a self area to be read to wait for the image processing module to read.

6. The method of claim 5, further comprising:

the image processing module acquires characteristic data from the read LVDS signals, and analyzes and compares the characteristic data with target data to obtain an analysis result; and sending the analysis result to the network transmission module.