CN115174915A - Image processing system and method for reducing network bandwidth occupation - Google Patents
Image processing system and method for reducing network bandwidth occupation Download PDFInfo
- Publication number
- CN115174915A CN115174915A CN202210763600.8A CN202210763600A CN115174915A CN 115174915 A CN115174915 A CN 115174915A CN 202210763600 A CN202210763600 A CN 202210763600A CN 115174915 A CN115174915 A CN 115174915A
- Authority
- CN
- China
- Prior art keywords
- frame
- module
- image data
- data
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention relates to the technical field of computers, in particular to an image processing system and method for reducing network bandwidth occupation, wherein the system is additionally provided with a fixed frame rate frame dropping module, a control module, a self-adaptive frame dropping module and a capturing module on the basis of the conventional KVM system, wherein the self-adaptive frame dropping module consists of a sampling module, a cache area and a comparator module. According to the invention, the image data processing part is added on the path of transmitting DVI signal image data to the JPEG compression engine module in the BMC chip, so that the monitoring, classification and filtering of video image data are realized, the effective video image data is remotely transmitted through the Ethernet, the invalid video image data is lost and is not transmitted through the remote Ethernet, the data volume of remote transmission is reduced, the compressed data and time of the JPEG compression engine are reduced, the occupation of the Ethernet transmission network bandwidth is effectively reduced, the image blocking phenomenon is avoided, and the image fluency of the KVM system is improved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to an image processing system and method for reducing network bandwidth occupation.
Background
In a server system, a Baseboard Management Controller (BMC) is generally used to monitor and manage the operation status of a motherboard. Some important parameters of the mainboard core component such as voltage, temperature, power consumption, fan rotating speed and the like are monitored and recorded through the BMC. The BMC comprises a Video Graphics Array (VGA) display module, and can provide monitoring picture display in the normal operation process of the server. To facilitate the control of the server, the server needs to provide both local and remote display functions.
The VGA module in the BMC generates Digital Visual Interface (DVI) signals, the DVI signals are displayed locally, and the DVI signals are remotely transmitted to a remote terminal for decompression and display through the Ethernet after image data are compressed by a JPEG compression engine. The digital video interface is an international open high-definition digital video display interface standard and supports 24-bit data of single-pixel RGB.
Under the condition that the network bandwidth of a system is limited, image data of each frame of a video display image is remotely transmitted through the Ethernet, the transmission data volume is large, and the data has a delay phenomenon, so that the image blocking phenomenon is caused. Namely: in the server KVM system, DVI video image signals generated by the VGA module are compressed by the JPEG compression engine and then are remotely transmitted to the remote terminal through the Ethernet for decompression and display. Under the condition that the network bandwidth of a system is limited, image data of each frame of a video display image is compressed by a compression engine and remotely transmitted by Ethernet, the transmission data volume is large, and the data has a delay phenomenon, so that the picture blocking phenomenon is caused.
Disclosure of Invention
In view of the above situation, the present invention provides an image processing system and method for reducing network bandwidth occupation based on lorentz chaotic encryption, wherein an image data processing part is added on a path through which DVI signal image data is transmitted to a JPEG compression engine module in a BMC chip, so as to realize monitoring, classification and filtering of Video image data, effective Video image data is remotely transmitted through ethernet, ineffective Video image data is lost and is not transmitted through the remote ethernet, so that the data amount of remote transmission is reduced, and simultaneously, the compressed data and time of a JPEG (joint photographic experts group) compression engine are reduced, so that the bandwidth occupation of the ethernet transmission network is effectively reduced, the picture pause phenomenon is avoided, and the picture smoothness of a KVM (Keyboard Video Mouse) system is improved.
In order to achieve the above purpose, the embodiment of the present invention provides the following technical solutions:
in a first aspect, in an embodiment provided by the present invention, an image processing system for reducing network bandwidth occupation is provided, which includes a fixed frame rate frame dropping module connected to a KVM system, a control module, an adaptive frame dropping module, and a capture module;
the control module is connected with the fixed frame rate frame dropping module and the self-adaptive frame dropping module and is used for controlling signals of the fixed frame rate frame dropping module and the self-adaptive frame dropping module so as to ensure that the image processing system normally works under a set mode and parameters;
the fixed frame rate frame loss module is used for realizing frame loss at a fixed frame rate for DVI signal image data of the VGA module according to a frame rate control signal of the control module;
the self-adaptive frame loss module is used for automatically monitoring the image data of the DVI signal;
the capture module is used for capturing the processed DVI image data, the image data takes one frame of image as a unit, and the image data is transmitted to the JPEG compression engine.
As a further scheme of the invention, the fixed frame rate frame dropping module and the self-adaptive frame dropping module are connected with the VGA module, and the VGA module is used for converting video image data of a host into DVI signals according to the VSEA standard.
As a further scheme of the invention, the image data of DVI signals in the VGA module is displayed locally through a display screen, and the image data is compressed by a JPEG compression engine and transmitted to a remote terminal for display through Ethernet.
As a further proposal of the invention, when the fixed frame rate frame loss module realizes the frame loss of the fixed frame rate for the DVI signal image data of the VGA module, the maximum frame loss of the fixed frame rate frame loss module is one frame loss of each capture frame.
As a further scheme of the invention, the self-adaptive frame-dropping module consists of a sampling module, a buffer area and a comparator module, so as to realize the frame-dropping function of DVI image data, reduce the compressed data and time of a JPEG compression engine, reduce the data volume of remote transmission, reduce the occupation of the bandwidth of an Ethernet transmission network and avoid the phenomenon of picture blocking;
the sampling module is used for sampling one frame of image data to obtain sampling data;
the buffer area is used for temporarily storing the sampling data sampled by the sampling module;
the comparator module is used for comparing the current frame image sampling data with the previous frame image sampling data, and if the comparison result is greater than a preset similarity threshold, the current frame image sampling data is not transmitted to the JPEG compression engine for compression; otherwise, the current frame image data is transmitted to a JPEG compression engine for compression.
In a second aspect, in another embodiment provided by the present invention, an image processing method for reducing network bandwidth occupation is provided, where the method includes the following steps:
the VGA module outputs DVI signal image data according to the VSEA standard;
judging whether the output DVI signal image data is subjected to frame dropping operation, and if the frame dropping operation is carried out, remotely displaying each frame of video image data; if the frame loss operation is not carried out, the capturing module continuously captures each frame of DVI image data;
judging a frame loss mode, if the frame loss mode is a self-adaptive frame loss mode, sampling the image data of the current frame, proportionally sampling according to the resolution of the image data and the pixels of a row and a column, storing the sampled image data into a cache region for caching, and proportionally sampling the image data of the next frame;
comparing whether two frames of the sampled data and the buffer area data are similar or not, when the two frames of the sampled data and the buffer area data are similar, capturing the current sampled image data by a capture module, storing the sampled data into the buffer area, and carrying out equal-proportion sampling on the next frame of image data; when the image data is not similar to the image data, the current sampled image data loses frames, and the image data of the next frame is sampled in the same proportion.
As a further aspect of the present invention, the DVI signal image data is RGB data of 24bits, and the field blanking signal of each frame image is used as the start of one frame image data.
As a further scheme of the invention, if the frame dropping operation is set, the set frame dropping mode is read and judged.
As a further scheme of the invention, if the frame loss mode is a fixed frame rate frame loss mode, the fixed frame loss rate is read, n frames of image data are continuously captured, and the next frame of image data is lost to enter the reading of the fixed frame loss rate.
As a further scheme of the invention, when the frame loss mode is the self-adaptive frame loss mode, the sampling data of the current frame and the next frame are compared, wherein when the image RGB data of the image is 24bits, the pixel data in the threshold value range are judged to be approximately equal.
In a third aspect, in a further embodiment provided by the present invention, there is provided an image processing apparatus for reducing network bandwidth occupation, comprising a memory storing a computer program and a processor implementing the steps of the image processing method for reducing network bandwidth occupation when the computer program is loaded and executed.
In a fourth aspect, in a further embodiment provided by the present invention, a storage medium is provided, which stores a computer program, and the computer program is loaded by a processor and executed to implement the steps of the image processing method for reducing network bandwidth occupation.
The technical scheme provided by the invention has the following beneficial effects:
the image processing system and the method for reducing the network bandwidth occupation increase an image data processing part on a path of transmitting DVI signal image data to a JPEG compression engine module in a BMC chip, realize the monitoring, classification and filtering of video image data, remotely transmit effective video image data through Ethernet, lose frames of ineffective video image data and not transmit the ineffective video image data through the remote Ethernet, reduce the data volume of remote transmission, simultaneously reduce the compressed data and time of the JPEG compression engine, effectively reduce the Ethernet transmission network bandwidth occupation, avoid the picture pause phenomenon and improve the picture smoothness of the KVM system.
These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention. In the drawings:
fig. 1 is a block diagram of a video image transmission system for remote management of an image processing system with reduced network bandwidth occupation according to an embodiment of the present invention.
Fig. 2 is a flowchart of an image processing method for reducing network bandwidth occupation according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution order may be changed according to the actual situation.
It is to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
Under the condition that the network bandwidth of a system is limited, each frame of image data of a video display image needs to be remotely transmitted through the Ethernet, so that the transmission data volume is large, the data has a delay phenomenon, and the image blocking phenomenon is caused. Namely: in the server KVM system, DVI video image signals generated by the VGA module are compressed by the JPEG compression engine and then are remotely transmitted to the remote terminal through the Ethernet for decompression and display. Under the condition that the network bandwidth of a system is limited, image data of each frame of a video display image is compressed by a compression engine and remotely transmitted by Ethernet, the transmission data volume is large, and the data has a delay phenomenon, so that the picture blocking phenomenon is caused.
The invention provides an image processing system and method for reducing network bandwidth occupation, wherein an image data processing part is added on a path of transmitting DVI signal image data to a JPEG compression engine module in a BMC chip, so as to realize monitoring, classification and filtering of video image data, effective video image data is remotely transmitted through Ethernet, invalid video image data is lost and is not transmitted through the remote Ethernet, so that the data volume of remote transmission is reduced, the compressed data and time of the JPEG compression engine are reduced, the Ethernet transmission network bandwidth occupation is effectively reduced, the image blocking phenomenon is avoided, and the image fluency of a KVM system is improved.
Specifically, the embodiments of the present invention are further explained below with reference to the drawings.
Referring to fig. 1, fig. 1 is a block diagram illustrating a video image transmission system for remote management of an image processing system with reduced network bandwidth occupation according to the present invention.
One embodiment of the invention provides an image processing system for reducing network bandwidth occupation, which comprises a fixed frame rate frame dropping module, a control module, an adaptive frame dropping module and a capturing module, wherein the fixed frame rate frame dropping module, the control module, the adaptive frame dropping module and the capturing module are connected with a KVM system. The control module is connected with the fixed frame rate frame loss module and the self-adaptive frame loss module and is used for controlling signals of the fixed frame rate frame loss module and the self-adaptive frame loss module so as to enable the image processing system to normally work under a set mode and parameters.
The fixed frame rate frame loss module is used for realizing frame loss of a fixed frame rate for DVI signal image data of the VGA module according to the frame rate control signal of the control module. The fixed frame rate frame loss module and the self-adaptive frame loss module are connected with the VGA module, and the VGA module is used for converting video image data of a host into DVI signals according to VSEA standards.
The self-adaptive frame loss module is used for automatically monitoring the image data of DVI signals; the capture module is used for capturing the processed DVI image data, the image data takes one frame of image as a unit, the image data is transmitted to the JPEG compression engine, the image data of the DVI signal in the VGA module is locally displayed through the display screen, the image data is compressed through the JPEG compression engine and is transmitted to the remote terminal for display through the Ethernet.
When the fixed frame rate frame loss module realizes frame loss of a fixed frame rate for DVI signal image data of the VGA module, the fixed frame rate frame loss module realizes frame loss of the fixed frame rate for the DVI signal image data of the VGA module according to a frame rate control signal of the control module, and can realize that one frame is lost for each captured frame, one frame is lost for each captured two frames, one frame is lost for each captured three frames, and one frame is lost for each captured four frames.
In the embodiment of the invention, the self-adaptive frame loss module consists of a sampling module, a buffer area and a comparator module, so as to realize the frame loss function of DVI image data, reduce the compressed data and time of a JPEG compression engine, reduce the data volume of remote transmission, reduce the occupation of the bandwidth of an Ethernet transmission network and avoid the phenomenon of picture blocking.
The sampling module is used for sampling a frame of image data to obtain sampling data;
the buffer area is used for temporarily storing the sampling data sampled by the sampling module;
the comparator module is used for comparing the current frame image sampling data with the previous frame image sampling data, and if the comparison result is greater than a preset similarity threshold, the current frame image sampling data is not transmitted to the JPEG compression engine for compression; otherwise, the current frame image data is transmitted to a JPEG compression engine for compression.
The self-adaptive frame loss module of the invention realizes automatic monitoring of image data of DVI signals, and does not transmit the image data or reduces the transmitted image data within a certain time under the condition that the image picture does not change or slowly changes. Sampling image data of a frame, temporarily storing the sampled data in a buffer area, comparing the sampled data of the current frame with the sampled data of the previous frame, if the sampled data of the current frame is the same as the sampled data of the previous frame or has high similarity, not transmitting the current frame to a JPEG compression engine for compression, and if the sampled data of the current frame has low similarity with the sampled data of the previous frame, transmitting the image data of the current frame to the JPEG compression engine for compression.
The image processing system for reducing the network bandwidth occupation is additionally provided with a fixed frame rate frame dropping module, a control module, a self-adaptive frame dropping module and a DVI data capturing module on the basis of the conventional KVM system, wherein the self-adaptive frame dropping module consists of a sampling module, a cache region and a comparator module. The frame loss function of DVI image data is realized, the compressed data and time of a JPEG compression engine are reduced, the data volume of remote transmission is reduced, the occupation of the bandwidth of an Ethernet transmission network is reduced, and the picture blocking phenomenon is avoided.
Therefore, the invention adds an image data processing part on the path of transmitting DVI signal image data to a JPEG compression engine module in a BMC chip, realizes the monitoring, classification and filtering of video image data, the effective video image data is remotely transmitted through Ethernet, the ineffective video image data is lost and is not transmitted through the remote Ethernet, the data volume of remote transmission is reduced, the compressed data and time of the JPEG compression engine are reduced, the occupation of the Ethernet transmission network bandwidth is effectively reduced, the image pause phenomenon is avoided, and the image fluency of the KVM system is improved.
In an embodiment of the present invention, there is also provided an image processing method for reducing network bandwidth occupation, including the following steps:
the VGA module outputs DVI signal image data according to the VSEA standard;
judging whether the output DVI signal image data is subjected to frame dropping operation, and if the frame dropping operation is carried out, remotely displaying each frame of video image data; if the frame loss operation is not carried out, the capturing module continuously captures each frame of DVI image data;
judging a frame loss mode, if the frame loss mode is a self-adaptive frame loss mode, sampling the image data of the current frame, proportionally sampling according to the resolution of the image data and the pixels of a row and a column, storing the sampled image data in a buffer area for buffering, and proportionally sampling the image data of the next frame;
comparing whether two frames of the sampled data and the buffer area data are similar or not, when the two frames of the sampled data and the buffer area data are similar, capturing the current sampled image data by a capture module, storing the sampled data into the buffer area, and carrying out equal-proportion sampling on the next frame of image data; when the image data is not similar to the image data, the current sampled image data loses frames, and the image data of the next frame is sampled in the same proportion.
Referring to fig. 2, in the image processing method for reducing network bandwidth occupation, the work flow is as follows:
and (1) outputting DVI signal image data by the VGA module according to the VSEA standard. The DVI signal image data is RGB data of 24bits, and the field blank signal of each frame image is taken as the start of one frame image data.
And (2) judging whether to perform frame loss operation, and under the condition of abundant network bandwidth, selecting not to drop frames to realize remote display of each frame of video image data. If no frame is lost, the capture module continuously captures each frame of DVI image data.
And (3) if the frame loss operation is set, reading the set frame loss mode and judging.
And (4) reading the fixed frame loss rate if the frame loss mode is the fixed frame rate frame loss mode.
And (5) continuously capturing n frames of image data, and losing frames of the next frame of image data. And (5) entering the step (4).
And (6) if the frame loss mode is the self-adaptive frame loss mode, sampling the image data of the current frame, and proportionally sampling according to the resolution of the image data and the pixels of the rows and the columns.
And (7) storing the sampled image data in a buffer area for buffering.
And (8) carrying out equal-proportion sampling on the image data of the next frame.
And (9) comparing the sampling data of the current frame with the sampling data of the next frame, wherein the image RGB data of the image is 24bits, and the monochrome data has no difference in vision when the difference is small, so that the pixel data in the threshold range can be judged to be approximately equal, for example, the pixel data 00076CEE and the pixel data 00076CEF are judged to be approximately equal. If the number of sampled pixels equal to two frames of image data is greater than the set parameter value, the two frames of image data are judged to be similar, otherwise, the two frames of image data are not similar, for example, 640 × 480 resolution pictures, and if the number of sampled pixels is 160 × 120=19200 and the number of the sampled pixels equal to two frames of image data is greater than 9600, the two frames of image data are judged to be similar.
And (10) if the two frames of image data are judged to be dissimilar, transmitting the sampled image data to a capturing module, capturing the image data by the capturing module, outputting the image data to a JPEG compression engine, and storing the current sampled image data in a buffer area. Step (8) is entered.
And (11) if the two frames of image data are similar, performing frame loss on the currently sampled image data. Step (8) is entered.
By adopting the method of the embodiment of the invention, an image data processing part is added on a path for transmitting DVI signal image data to a JPEG compression engine module in a BMC chip, so that the monitoring, classification and filtering of video image data are realized, effective video image data is remotely transmitted through Ethernet, invalid video image data is lost and is not subjected to remote Ethernet transmission, the data volume of remote transmission is reduced, the compressed data and time of the JPEG compression engine are reduced, the occupation of the Ethernet transmission network bandwidth is effectively reduced, the phenomenon of picture pause is avoided, and the picture smoothness of a KVM system is improved.
It should be understood that although the above steps are described in a certain order, these steps are not necessarily performed in the order described. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, some steps of this embodiment may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a part of the steps or stages in other steps.
In an embodiment, there is further provided an image processing apparatus for reducing network bandwidth occupation in an embodiment of the present invention, including at least one processor, and a memory communicatively connected to the at least one processor, where the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to cause the at least one processor to perform the image processing method for reducing network bandwidth occupation, where the processor executes the instructions to implement the steps in the method embodiments:
the VGA module outputs DVI signal image data according to the VSEA standard;
judging whether the output DVI signal image data is subjected to frame dropping operation, and if the output DVI signal image data is subjected to the frame dropping operation, remotely displaying each frame of video image data; if the frame loss operation is not carried out, the capturing module continuously captures each frame of DVI image data;
judging a frame loss mode, if the frame loss mode is a self-adaptive frame loss mode, sampling the image data of the current frame, proportionally sampling according to the resolution of the image data and the pixels of a row and a column, storing the sampled image data in a buffer area for buffering, and proportionally sampling the image data of the next frame;
comparing whether two frames of the sampled data and the buffer area data are similar or not, when the two frames of the sampled data and the buffer area data are similar, capturing the current sampled image data by a capture module, storing the sampled data into the buffer area, and carrying out equal-proportion sampling on the next frame of image data; when the image data is not similar to the image data, the current sampled image data loses frames, and the image data of the next frame is sampled in the same proportion.
In the embodiment of the present invention, the DVI signal image data is RGB data of 24bits, and the field blanking signal of each frame image is used as the start of one frame image data.
In the embodiment of the invention, if the frame loss operation is set, the set frame loss mode is read and judged.
In the embodiment of the invention, if the frame loss mode is the fixed frame rate frame loss mode, the fixed frame loss rate is read, n frames of image data are continuously captured, and the next frame of image data is lost, and the fixed frame loss rate is read.
In the embodiment of the invention, when the frame loss mode is the self-adaptive frame loss mode, the sampling data of the current frame and the next frame are compared, wherein when the image RGB data of the image is 24bits, the pixel data in the threshold value range are judged to be approximately equal.
The image processing device for reducing network bandwidth occupation, also referred to as a "computer", may be an intelligent electronic device capable of executing predetermined processing procedures such as numerical calculation and/or logic calculation by running a predetermined program or instruction, and may include a processor and a memory, where the processor executes a pre-stored instruction stored in the memory to execute the predetermined processing procedure, or the processor executes the predetermined processing procedure by hardware such as ASIC, FPGA, DSP, or a combination thereof. Image processing devices that reduce network bandwidth usage include, but are not limited to, servers, personal computers, laptops, tablets, smart phones, and the like.
The image processing device for reducing the network bandwidth occupation comprises user equipment and network equipment. Wherein the user equipment includes but is not limited to computers, smart phones, PDAs, etc.; the network device includes, but is not limited to, a single network server, a server group consisting of a plurality of network servers, or a Cloud Computing (Cloud Computing) based Cloud consisting of a large number of computers or network servers, wherein the Cloud Computing is one of distributed Computing, a super virtual computer consisting of a collection of loosely coupled computers. The image processing device for reducing the network bandwidth occupation can be operated independently to realize the invention, and can also be accessed into the network and realize the invention through the interactive operation with other image processing devices for reducing the network bandwidth occupation in the network. The network where the image processing device for reducing network bandwidth occupation is located includes, but is not limited to, the internet, a wide area network, a metropolitan area network, a local area network, a VPN network, and the like.
In an embodiment of the present invention, there is further provided a storage medium having a computer program stored thereon, which when executed by a processor, performs the steps in the above-mentioned method embodiments:
the VGA module outputs DVI signal image data according to the VSEA standard;
judging whether the output DVI signal image data is subjected to frame dropping operation, and if the frame dropping operation is carried out, remotely displaying each frame of video image data; if the frame loss operation is not carried out, the capturing module continuously captures each frame of DVI image data;
judging a frame loss mode, if the frame loss mode is a self-adaptive frame loss mode, sampling the image data of the current frame, proportionally sampling according to the resolution of the image data and the pixels of a row and a column, storing the sampled image data in a buffer area for buffering, and proportionally sampling the image data of the next frame;
comparing whether two frames of the sampled data and the buffer area data are similar or not, when the two frames of the sampled data and the buffer area data are similar, capturing the current sampled image data by a capture module, storing the sampled data into the buffer area, and carrying out equal-proportion sampling on the next frame of image data; when the image data is not similar to the image data, the current sampled image data loses frames, and the image data of the next frame is sampled in the same proportion.
In the embodiment of the present invention, the DVI signal image data is RGB data of 24bits, and the field blanking signal of each frame image is used as the start of one frame image data.
In the embodiment of the invention, if the frame loss operation is set, the set frame loss mode is read and judged.
In the embodiment of the invention, if the frame loss mode is the fixed frame rate frame loss mode, the fixed frame loss rate is read, n frames of image data are continuously captured, and the next frame of image data is lost to enter the reading of the fixed frame loss rate.
In the embodiment of the invention, when the frame loss mode is the self-adaptive frame loss mode, the sampling data of the current frame and the next frame are compared, wherein when the image RGB data of the image is 24bits, the pixel data in the threshold value range are judged to be approximately equal.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items. The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. An image processing system for reducing network bandwidth occupation is characterized by comprising a fixed frame rate frame dropping module, a control module, a self-adaptive frame dropping module and a capturing module, wherein the fixed frame rate frame dropping module, the control module, the self-adaptive frame dropping module and the capturing module are connected with a KVM system;
the control module is connected with the fixed frame rate frame loss module and the self-adaptive frame loss module and is used for controlling signals of the fixed frame rate frame loss module and the self-adaptive frame loss module so as to ensure that the image processing system normally works under a set mode and parameters;
the fixed frame rate frame loss module is used for realizing frame loss at a fixed frame rate for DVI signal image data of the VGA module according to a frame rate control signal of the control module;
the self-adaptive frame loss module is used for automatically monitoring the image data of the DVI signal;
the capture module is used for capturing the processed DVI image data, and the image data is transmitted to the JPEG compression engine by taking one frame of image as a unit.
2. The image processing system for reducing network bandwidth occupation of claim 1, wherein the fixed frame rate frame dropping module and the adaptive frame dropping module are connected to a VGA module, and the VGA module is configured to convert video image data of the host into a DVI signal according to the VSEA standard.
3. The image processing system of claim 2, wherein the image data of the DVI signal in the VGA module is displayed locally through the display screen, and the image data is compressed by the JPEG compression engine and transmitted to the remote terminal through the ethernet network for display.
4. The image processing system of claim 3, wherein when the fixed frame rate frame loss module implements frame loss at a fixed frame rate for DVI signal image data of the VGA module, the maximum frame loss of the fixed frame rate frame loss module is one frame loss per captured frame.
5. The image processing system for reducing network bandwidth occupation of claim 2, wherein said adaptive frame loss module is comprised of a sampling module, a buffer and a comparator module;
the sampling module is used for sampling one frame of image data to obtain sampling data;
the buffer area is used for temporarily storing the sampling data sampled by the sampling module;
the comparator module is used for comparing the current frame image sampling data with the previous frame image sampling data, and if the comparison result is greater than a preset similarity threshold, the current frame image sampling data is not transmitted to the JPEG compression engine for compression; otherwise, the current frame image data is transmitted to a JPEG compression engine for compression.
6. An image processing method for reducing network bandwidth occupation, which is based on the image processing system for reducing network bandwidth occupation according to any one of claims 1 to 5, and comprises the following steps:
the VGA module outputs DVI signal image data according to the VSEA standard;
judging whether the output DVI signal image data is subjected to frame dropping operation, and if the frame dropping operation is carried out, remotely displaying each frame of video image data; if the frame loss operation is not carried out, the capturing module continuously captures each frame of DVI image data;
judging a frame loss mode, if the frame loss mode is a self-adaptive frame loss mode, sampling the image data of the current frame, proportionally sampling according to the resolution of the image data and the pixels of a row and a column, storing the sampled image data in a buffer area for buffering, and proportionally sampling the image data of the next frame;
comparing whether two frames of the sampled data and the buffer area data are similar or not, when the two frames of the sampled data and the buffer area data are similar, capturing the current sampled image data by a capture module, storing the sampled data into the buffer area, and carrying out equal-proportion sampling on the next frame of image data; when the image data is not similar to the image data, the current sampled image data loses frames, and the image data of the next frame is sampled in the same proportion.
7. The image processing method for reducing network bandwidth occupation of claim 6, wherein the DVI signal image data is 24-bit RGB data, and the field blanking signal of each frame of image is used as the beginning of one frame of image data.
8. The image processing method for reducing network bandwidth occupation according to claim 7, wherein if the frame dropping operation is set, the set frame dropping mode is read and judged.
9. The image processing method of claim 8, wherein if the frame loss mode is a fixed frame rate frame loss mode, reading the fixed frame loss rate, continuously capturing n frames of image data, and reading the fixed frame loss rate when the next frame of image data is lost.
10. The image processing method of claim 9, wherein when the frame loss mode is an adaptive frame loss mode, the sampled data of the current frame and the sampled data of the next frame are compared, and wherein when the image RGB data of the image is 24bits, the pixel data within the threshold range are determined to be approximately equal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210763600.8A CN115174915A (en) | 2022-06-30 | 2022-06-30 | Image processing system and method for reducing network bandwidth occupation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210763600.8A CN115174915A (en) | 2022-06-30 | 2022-06-30 | Image processing system and method for reducing network bandwidth occupation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115174915A true CN115174915A (en) | 2022-10-11 |
Family
ID=83488441
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210763600.8A Pending CN115174915A (en) | 2022-06-30 | 2022-06-30 | Image processing system and method for reducing network bandwidth occupation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115174915A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116996647A (en) * | 2023-09-22 | 2023-11-03 | 苏州元脑智能科技有限公司 | Video transmission method of BMC, BMC and system-level chip |
-
2022
- 2022-06-30 CN CN202210763600.8A patent/CN115174915A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116996647A (en) * | 2023-09-22 | 2023-11-03 | 苏州元脑智能科技有限公司 | Video transmission method of BMC, BMC and system-level chip |
| CN116996647B (en) * | 2023-09-22 | 2024-01-26 | 苏州元脑智能科技有限公司 | Video transmission method of BMC, BMC and system-level chip |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11631246B2 (en) | Method for outputting a signal from an event-based sensor, and event-based sensor using such method | |
| CN113377485B (en) | Refreshing display method of ink screen device, electronic device and storage medium | |
| US9110665B2 (en) | Techniques to control self refresh display functionality | |
| WO2022111198A1 (en) | Video processing method and apparatus, terminal device and storage medium | |
| KR102188613B1 (en) | Adaptive data path for computer―vision applications | |
| CN112866809B (en) | Video processing method, device, electronic equipment and readable storage medium | |
| US11006044B1 (en) | Power-efficient dynamic electronic image stabilization | |
| Sajjanar et al. | Implementation of real time moving object detection and tracking on FPGA for video surveillance applications | |
| CN115174915A (en) | Image processing system and method for reducing network bandwidth occupation | |
| TW202121220A (en) | Method and apparatus for generating a series of frames with aid of synthesizer | |
| CN115209145A (en) | Video compression method, system, device and readable storage medium | |
| US11862066B2 (en) | Frame replay for variable rate refresh display | |
| WO2007057053A1 (en) | Conditional updating of image data in a memory buffer | |
| US11295453B2 (en) | Image processing apparatus, transmission method, and storage medium | |
| CN115643408A (en) | Image compression method, device, equipment and storage medium | |
| US11196974B2 (en) | Display control apparatus and display control method | |
| US20100053326A1 (en) | Image sensor, the operating method and usage thereof | |
| CN115878379A (en) | Data backup method, main server, backup server and storage medium | |
| US10332489B2 (en) | Data processing system for display underrun recovery | |
| CN113711272A (en) | Method and system for non-spurious motion detection | |
| US20210358135A1 (en) | Feature detection, sorting, and tracking in images using a circular buffer | |
| CN114155151A (en) | Image drawing method, device, equipment and storage medium | |
| CN118214820B (en) | Image data processing method, product, equipment and medium | |
| CN118365554B (en) | Video noise reduction method, device, electronic equipment and computer readable storage medium | |
| CN112562024A (en) | Picture processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |