JP2003116139A - Video distribution server and video reception client system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video distribution server and video reception client system by which a user side can remarkably reduce a load imposed on selecting video data and which can properly transmit the required video data to the user side and minimize also the utilization quantity of a network channel. SOLUTION: An area division section 6a of a camera server 2 divides a video image photographed by an image pickup device 5 into small areas and a difference processing section 6b applies difference processing between an image and a one-preceding image of each small area. Then a segmentation processing section 6e segments a small area from which a difference with a preset threshold value or more is detected as a small area considered to have abnormity, distributes the segmented small area to a video reception client 3, an image processing section 3a of the video reception client 3 applies further analysis to the small area, and an abnormity detection processing section 3b finally raises warning on the basis of the result.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video distribution server and a video reception client system for receiving a video captured by an imaging device such as a video camera through a network line or the like and processing the video in a predetermined manner.

[0002]

2. Description of the Related Art In recent years, a video camera such as a surveillance camera is provided with a camera server for processing and distributing substantially continuous images picked up by the video camera, a monitor for displaying an image from the camera server in a predetermined manner, and the like. Various systems have been proposed and some have been put into practical use by connecting them to clients on a general-purpose network.

For example, in Japanese Patent Laid-Open No. 10-93949, when a video transmission request is transmitted by a user, the resolution of the video image captured by the camera is converted into the instructed resolution and an image having the instructed resolution is displayed. A system for generating and transmitting is disclosed.

[0004]

However, in the above-mentioned prior art, it is necessary for the user to change the resolution of the image by himself while watching the image, which imposes a heavy burden on the user and requires the user. There is a possibility that you may miss the video. In addition, since all the images are always captured by the network line, there is a problem that the data amount of the network line becomes large.

The present invention has been made in view of the above circumstances. The load on the user side for selecting video data can be greatly reduced, and necessary video data can be accurately transmitted to the user side. It is an object of the present invention to provide a video distribution server and a video reception client system that can minimize the usage amount of the video distribution server.

[0006]

In order to achieve the above object, a video distribution server and a video reception client system according to the present invention according to claim 1 process and distribute substantially continuous videos captured by an imaging device. A video distribution server and a video reception client system comprising a server and a video reception client for receiving a video distributed by the video distribution server and displaying the video on a display means. An abnormality detection unit that detects a change between frames of continuous images, and an image changing unit that changes the image to be transmitted to the image reception client in a predetermined manner when the abnormality detection unit detects an abnormality. I am trying.

That is, in the video distribution server and the video reception client system according to the first aspect, the video distribution server processes and distributes the substantially continuous video captured by the imaging device, and the video reception client distributes the video. The image to be displayed is received and displayed on the display means. On this occasion,
The video distribution server detects a change between frames of substantially continuous video captured by the imaging device by the abnormality detection means,
The image to be transmitted to the image receiving client is changed to a predetermined value when the image change means detects the abnormality. Therefore, the load of selecting video data on the user side can be significantly reduced, necessary video data can be accurately transmitted to the user side, and the amount of network line usage can be minimized. .

Further, the video distribution server and the video reception client system according to the present invention according to claim 2 are the video distribution server and the video reception client system according to claim 1, wherein when the anomaly is detected by the anomaly detection means, It is characterized in that a part of an image including a part where an abnormality has occurred is extracted from the whole image and transmitted to the video reception client. As described above, since a part of the image including the abnormal portion is extracted from the whole image and transmitted to the video receiving client, the usage amount of the network line can be minimized.

Further, the video distribution server and the video reception client system according to the present invention according to claim 3 are the video distribution server and the video reception client system according to claim 1 or 2, wherein the imaging of the video distribution server is performed. The device is a plurality of image pickup devices, and when the image change means of the image distribution server detects an abnormality by the abnormality detection means, the image change means changes the priority order of image distribution from the image pickup device which is photographing the abnormality to another. It is characterized in that the priority is set higher than the priority order of video distribution by the image pickup apparatus. In this way, by giving priority to the image from the imaging device that is shooting the anomaly,
The necessary information is transmitted to the user side accurately without increasing the usage of the network line.

According to a fourth aspect of the present invention, there is provided a video distribution server and a video reception client system in the video distribution server and the video reception client system according to any one of the first to third aspects. The reception client is characterized in that it is provided with an image processing means for performing image analysis on an image distributed by detecting an abnormality in the video distribution server. In this way, it becomes possible for the user side to further analyze the image distributed by detecting the abnormality in the video distribution server, and to reliably grasp the situation of the abnormality.

Further, the video distribution server and the video reception client system according to the present invention according to claim 5 are the video distribution server and the video reception client system according to any one of claims 1 to 4, The image pickup device of the distribution server has a CMOS type image pickup device, and the image changing means of the video distribution server changes driving of the image pickup device when an abnormality is detected by the abnormality detection means. The feature is that the resolution of the transmitted image is changed. In this way, by changing the driving of the CMOS type image pickup device and changing the resolution of the transmission image, the user side can surely catch the portion where the abnormality has occurred.

According to a sixth aspect of the present invention, there is provided a video distribution server and a video reception client system in the video distribution server and the video reception client system according to any one of the first to fifth aspects. The image changing means of the distribution server, when the abnormal change detecting means detects the abnormal change, the floor of at least one of the first area in which the abnormal change is detected and the second area in which the predetermined edge is recognized to exist. The feature is that gradation is assigned to the entire image based on the gradation. By changing the gradation of the entire image in this way, it is possible for the user to reliably capture the portion in which the abnormality has occurred.

Further, in the video distribution server and the video reception client system according to the present invention described in claim 7, in the video distribution server and the video reception client system according to claim 6, the image changing means is provided in the first area. It is characterized in that the weighting of the gradation and the gradation of the second area can be freely changed.

[0014]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. 1 to 6 show the first embodiment of the present invention.
FIG. 1 shows the overall configuration of the video distribution server and the video reception client system, FIG. 2 is a functional block diagram of the main parts of the video distribution server and the video reception client system, and FIG. FIG. 4 is an explanatory diagram of an example, FIG. 4 is an explanatory diagram of division of an imaging region, FIG. 5 is an explanatory diagram of divided regions to be transmitted to a user, and FIG. 6 is a flowchart of processing of a video distribution server and a video reception client system.

In FIG. 1, reference numeral 1 denotes a video distribution server and a video reception client system. The video distribution server and the video reception client system 1 are one video distribution server (hereinafter referred to as a camera server) 2 and one video. The receiving client 3 is connected and configured by a network line 4.

The camera server 2 is composed of an image pickup device 5 such as a wide-angle or high-resolution digital video camera and a server 6, and the video reception client 3 is
It is composed of an electronic terminal such as a personal computer 8 having a monitor 7.

In the video distribution server and the video reception client system 1, as shown in FIG. 2, the camera server 2 includes the image pickup device 5, the area dividing unit 6a, the memory 1 (6b), and the memory 2 (6c). , The difference processing unit 6d and the cutout processing unit 6e are mainly configured, and the video reception client 3 is mainly configured by an image processing unit 3a, an abnormality detection processing unit 3b, and an alarm control unit 3c.

The area dividing section 6a, as shown in FIG. 4, obtains a predetermined number (for example, 10 () of each frame of continuous images as shown in FIG. 3 captured by the image pickup device 5 as shown in FIG. (Vertical) × 20 (horizontal); in FIG. 4, for simplicity of explanation, 4 (vertical) × 4 (horizontal)) is divided into substantially rectangular small regions.

The memory 1 (6b) and the memory 2 (6
In c), when new image data is transmitted from the area dividing unit 6a to the memory 1 (6b), the memory 1 (6
The image data stored in b) is transferred to the memory 2 (6c) and stored therein. That is, the image data of this time is stored in the memory 1 (6b), and the image data of the previous time is stored in the memory 2 (6c).

In the difference processing section 6d, the memory 1
The difference between the image stored in (6b) and the image stored in the memory 2 (6c) is calculated, and a small area having a difference of a predetermined threshold value or more is detected as a small area in which an abnormality has occurred.
Specifically, the brightness of the image stored in the memory 1 is calculated, the brightness of the image stored in the memory 2 is calculated, and the brightness is subtracted to obtain a difference, and a preset threshold value is set. A small area having the above difference is detected as a small area having an abnormal change with a dynamic change. Then, the signal regarding the small area having the abnormality is output to the cutout processing unit 6e and the image processing unit 3a of the video reception client 3. That is, the difference processing unit 6d has a function as an abnormality detection unit.

The cut-out processing unit 6e cuts out a small area group in which there is a change from the entire image based on the change information from the difference processing unit 6d, and delivers it to the image processing unit 3a of the video reception client 3. To do. For example, as shown in FIG. 5, when abnormalities occur in the lower left six small areas in the entire image, the hatched small area groups in which the abnormalities have not occurred are deleted and distributed to the video reception client 3. That is, the cutout processing unit 6e is provided as an image changing unit.

The image processing unit 3a of the video receiving client 3 receives a signal regarding a small area having a change from the difference processing unit 6d of the camera server 2, and also has a change from the cutout processing unit 6e. The image signal of the small area group is input, high-level image processing such as particle analysis is performed on the image of the small area group in which an abnormality has occurred, and the analysis result is output to the abnormality detection processing unit 3b together with the image signal. That is, the image processing unit 3a is provided as an image processing unit.

Based on the image signal from the image processing unit 3a of the video reception client 3 and the analysis result, the abnormality detection processing unit 3b gives an alarm or the like by the alarm control unit 3c when an abnormality occurs. Generate an alarm.

Next, an example of processing in the video distribution server and the video reception client system having the above configurations will be described with reference to the flowchart shown in FIG. First, in step (hereinafter abbreviated as “S”) 101, when image pickup is performed by the image pickup device 5,
In step S102, the difference processing unit 6d compares the previous image, that is, the image of one field before (memory 1).
(Comparison processing between the image of (6b) and the image of the memory 2 (6c)) is performed, and the difference is calculated for each of the divided small areas.

Then, in S103, as a result of the comparison in S102, it is judged whether or not a difference equal to or larger than a preset threshold value is detected for each of the divided small areas, and in any of the divided small areas. Also, if no difference equal to or greater than the preset threshold value is detected, the processing from S101 is repeated.

On the other hand, in S103, when a difference equal to or greater than the preset threshold is detected in any one or more of the divided small areas, the process proceeds to S104, and the cut-out processing unit 6e.
Cuts out the small area causing the anomaly from the entire image.

After that, the process proceeds to S105, and the small areas in which the abnormalities have been cut out in S104 are transferred to the image processing unit 3a of the video receiving client 3.

In the video reception client 3, S106
Then, the image processing unit 3a performs high-level image processing such as particle analysis on each small region in which each abnormality has occurred, and outputs the analysis result together with the image signal to the abnormality detection processing unit 3b.

For example, the type of a moving object is judged by matching the connection of particles detected by particle analysis with a template such as a person or vehicle body prepared in advance, and the judgment result (desired object (Whether it is an object or not) is output as an analysis result together with the image signal to the subsequent abnormality detection processing unit 3b.

Then, in S107, the abnormality detection processing unit 3b determines that an abnormality has been detected based on the image signal from the image processing unit 3a of the video reception client 3 and the analysis result (result of S106 above). For example, when the analysis result indicating that the object is a desired object is input, S10
Proceed to step 8 to generate an alarm, and exit the program. On the other hand, if no abnormality is detected in S107, the process from S101 is repeated.

As described above, according to the first embodiment of the present invention, only a small area group which is considered to have an abnormality is cut out from the image picked up by the image pickup device 5 and delivered to the image receiving client 3. The image receiving client 3 further analyzes and issues an alarm when it can be reliably determined that an abnormality has occurred. Therefore, the amount of data distributed from the camera server 2 to the video receiving client 3 can be minimized, and the amount of network line usage can be minimized.

Further, the image analysis in the video receiving client 3 may be performed only for the small area group distributed from the camera server 2 which is determined to have an abnormality, so that the load of analyzing the video data is greatly reduced. be able to.

Further, since the image receiving client 3 further analyzes the area determined to have an abnormality by the camera server 2, it is possible to reliably detect the abnormality.

The video distribution server and the video reception client system 1 according to the first embodiment can be used not only as a monitoring system but also as an automatic monitoring system for occurrence of an intrusion abnormality such as a security system.

Next, FIGS. 7 and 8 show a second embodiment of the present invention.
FIG. 7 is a functional block diagram of main parts of the video distribution server and the video reception client system, and FIG. 8 is a flowchart of processing of the video distribution server and the video reception client system. The second mode is different from the first mode in that an alarm is issued only when a small area having an abnormality is detected, and normal image display / recording is performed when no abnormality is detected. , The other configuration is the first
The same configurations as those in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and description thereof will be omitted.

As shown in FIG. 7, in the video distribution server and the video reception client system according to the second embodiment, the camera server 2 includes the image pickup device 5 and the area dividing unit 6.
a, a memory 1 (6b), a memory 2 (6c), a cutout processing unit 6e, and a difference processing unit 11, and the video reception client 3 includes the image processing unit 3a, an alarm control unit 3c, and an abnormality detection. Processing unit 12 and display / recording unit 1
It is mainly composed of 3.

The difference processing section 11 has substantially the same function as the difference processing section 6d of the first embodiment, and stores the image stored in the memory 1 (6b) and the memory 2 (6c). The difference between the image and the image is calculated, and a small area having a difference equal to or larger than a predetermined threshold is detected as a small area in which an abnormality has occurred. Then, for a small area having an abnormality, the D
The flag is set to 1 and given, and for a small area having no change, the D flag is set to 0 and given, and the signal by this flag is output to the cutout processing unit 6e and the image processing unit 3a of the video reception client 3. It That is, the difference processing unit 11 has a function as an abnormality detection unit.

The anomaly detection processing section 12 receives the D flag information from the difference processing section 11 and finally reproduces an image including a small area having an abnormal change as a result of the processing from the image processing section 3a. An alarm is generated by the alarm controller 3c, and the alarm is generated. The abnormality detection processing unit 12 displays the monitor 7 / hard disk or the like in both the case of reproducing an image without any change and the case of reproducing an image with a change (an image including a small area with a change). Thirteen
Press to continue display / recording.

In the flowchart shown in FIG. 8, first, in S201, when the image pickup device 5 picks up an image, S202
Then, in the difference processing unit 11, the last time, that is, 1
A comparison process with the image before the field (comparison process between the image of the memory 1 (6b) and the image of the memory 2 (6c)) is performed, and the difference is calculated for each divided small area.

Then, in S203, as a result of the comparison in S202, it is determined whether or not a difference equal to or larger than a preset threshold value is detected for each of the divided small areas, and one or more of the divided areas are detected. If a difference equal to or larger than the preset threshold value is detected in the small area of, the process proceeds to S204, and the D flag is set to 1. On the other hand, if no difference equal to or larger than the preset threshold is detected in any of the divided small areas, the process proceeds to S205, and the D flag is set to 0.

After the setting of the D flag is completed in S204 or S205, the process proceeds to S206 and the cutout processing unit 6
In e, only a small area where an abnormality has occurred is cut out from the entire image. When the process reaches S206 from S205 in which the D flag is set to 0, there is no small area in which an abnormality has occurred, and therefore only the small area in which abnormality has occurred is not cut out.

After that, the process proceeds to S207, and the small areas in which the abnormalities are generated and the other images that are not extracted in S206 are transferred to the image processing unit 3a of the video reception client 3 including the information of the D flag. To be done.

In the video reception client 3, it is determined in S208 whether the D flag is 1 or 0. If the D flag is 0, that is, if the image is unchanged, the process proceeds to S212 and normal image display / recording is performed. . On the other hand, if the D flag is 1 in S208, that is, if there is an abnormal image, S
In step 209, the image processing unit 3a performs advanced image processing such as particle analysis on the small areas in which each abnormality has occurred, and outputs the analysis result together with the image signal to the abnormality detection processing unit 12.

Then, in S210, the abnormality detection processing unit 12 determines that an abnormality has been detected based on the image signal from the image processing unit 3a of the video reception client 3 and the analysis result (result of S209 above). , S211 generates an alarm such as an alarm, advances to S212, displays / records an image of the area in which the abnormality is detected, and exits the program. On the other hand, if no abnormality is detected in S210, the process proceeds to S212, the image is displayed / recorded as it is, and the program exits.

As described above, according to the second embodiment, similar to the first embodiment, only a small area group which is considered to have an abnormal change is cut out when an abnormal change occurs, and image reception is performed. When the image is delivered to the client 3 and the video receiving client 3 performs further analysis, and it can be surely determined that an abnormality has occurred, an alarm is issued. Therefore, the amount of data distributed from the camera server 2 to the video receiving client 3 can be minimized, and the amount of network line usage can be minimized.

Further, since the image analysis in the video receiving client 3 may be performed only for the small area group distributed from the camera server 2 which is determined to have an abnormality, the load of analyzing the video data is significantly reduced. be able to.

Further, since the image receiving client 3 further analyzes the area determined to have an abnormality by the camera server 2, it is possible to reliably detect the abnormality and give an alarm.

In the difference processing section 11, when there is no small area in which an abnormality has occurred, the resolution is lowered or the frame rate is lowered so as not to impose a heavy load on the network and the normal operation. Display of/
You may record.

Next, FIGS. 9 to 11 show a third embodiment of the present invention, and FIG. 9 is a functional block diagram of main parts of a video distribution server and a video reception client system, and FIG.
Reference numeral 0 is an explanatory diagram showing an example of a specific configuration of the solid-state image sensor of the image pickup apparatus, and FIG. 11 is a flowchart of processing of the video distribution server and the video reception client system. In the third embodiment, the image pickup apparatus has a CMOS type image pickup element, and when the camera server detects an abnormality, the camera server changes the drive of the image pickup element to change the resolution of the transmission image. The same components as those in the first embodiment are designated by the same reference numerals and the description thereof will be omitted.

In the third embodiment, the solid-state image pickup device of the image pickup device 5 is, for example, as shown in FIG. 10, randomly accessible photoelectric conversion devices G1 to G1 arranged two-dimensionally.
Have six. The photoelectric conversion elements G1 to G16 photoelectrically convert incident light. The photoelectric conversion elements G1 to G16 are selected by activating the scanning line H by the vertical shift register 16 and activating the data line V by the horizontal shift register 17, and output photoelectric conversion outputs to the output line Out. The line memory 18 holds one line of output from the photoelectric conversion elements G1 to G16,
Output in time series. Incidentally, the number of pixels of the solid-state image sensor is generally set to tens of thousands to millions of pixels.
In FIG. 0, the case of 4 × 4 pixels is shown in order to simplify the drawing.

Then, in the third embodiment, the resolution or frame rate of the small region in which the abnormality has occurred is changed by changing the driving method such as thinning-out of the solid-state image pickup device configured as described above.

In the video distribution server and the video reception client system, as shown in FIG.
Is an image pickup device 5, an area dividing unit 6a, a memory 1 (6b),
The memory 2 (6c), the difference processing unit 19, and the resolution changing unit 20 are mainly configured, and the video receiving client 3 is
The display / recording unit 21 is mainly provided.

The difference processing section 19 has substantially the same function as the difference processing section 6d of the first embodiment, and stores the image stored in the memory 1 (6b) and the memory 2 (6c). The difference between the image and the image is taken, the small area with a difference equal to or greater than a predetermined threshold is detected as a small area in which an abnormality has occurred,
The detection result is output to the resolution changing unit 20. That is, the difference processing unit 19 has a function as an abnormality detection unit.

Based on the signal from the difference processing section 19, the resolution changing section 20 changes the driving of the solid-state image pickup device of the image pickup device 5 from a normal value for an image of a small area where an abnormality has occurred. It is provided as an image changing unit that changes the resolution of the transmitted image (by changing it to the high resolution or the high frame rate side), transfers it to the display / recording unit 21 of the video reception client 3, and displays / records it.

Next, in the flowchart shown in FIG. 11, first, the default value of the resolution or the frame rate is set in S301, and the image pickup device 5 picks up the image in S302. Then, the process proceeds to S303, in which the difference processing section 19 The previous time, that is, the comparison process with the image one field before (the comparison process between the image of the memory 1 (6b) and the image of the memory 2 (6c)) is performed, and the difference is obtained for each of the divided small areas. Is calculated.

Then, in S304, as a result of the comparison in S303, it is determined whether or not a difference equal to or larger than a preset threshold value is detected for each of the divided small areas, and one or more of the divided areas are detected. If a difference equal to or larger than the preset threshold value is detected in the small area, the process proceeds to S305, and the resolution changing unit 20 sets the small area in which the difference is detected to have a high resolution or a high frame rate. The drive of the solid-state image sensor is changed.

In step S304, if no difference equal to or larger than the preset threshold value is detected in any of the divided small areas, or after the resolution or frame rate is changed in step S305, step S306 is performed. Then, the camera server 2 transfers these images to the video reception client 3.

Then, in S307, the video reception client 3 displays / records an image in the display / recording unit 21 according to the resolution or frame rate set in the camera server 2, and exits the program.

As described above, according to the third embodiment, similarly to the first embodiment, the resolution or frame rate is set only for the small area group which is considered to have an abnormality when an abnormality occurs. Since it is changed and delivered to the video receiving client 3 and displayed / recorded, the abnormal portion is easy to see and the load on the user side is reduced, and the camera server 2 delivers it to the video receiving client 3. The amount of data required is minimal, and the amount of network line usage can also be minimized.

Next, FIGS. 12 to 16 show a fourth embodiment of the present invention, and FIG. 12 is a functional block diagram of main parts of a video distribution server and a video reception client system,
FIG. 13 is an explanatory diagram showing an example of a histogram of luminance and frequency obtained from a 10-bit original image, FIG. 14 is an explanatory diagram of a concept of equalizing a 10-bit histogram, and FIG. 15 is a gradation of a partial image and an entire image. And FIG. 16 is an explanatory view showing a weighted average of two gradation conversion curves.
The fourth embodiment of the present invention is different from the second embodiment of the above-mentioned embodiment.
When an abnormal change is detected, the gradation is assigned to the entire image with reference to the gradation of the first region where the abnormal change is detected and the second region where it is recognized that a predetermined edge is present. The same components as those in the two embodiments are designated by the same reference numerals, and the description thereof will be omitted.

That is, as shown in FIG. 12, in the video distribution server and the video reception client system according to the fourth embodiment, the camera server 2 includes the image pickup device 5, the area dividing unit 6a, the memory 1 (6b), and the memory 2. (6c), the difference processing unit 11 and the gradation change processing unit 25 are mainly configured, and the video reception client 3 includes the image processing unit 3a,
The alarm control section 3c, the abnormality detection processing section 12, and the display / recording section 13 are mainly configured.

The gradation change processing unit 25 is the difference processing unit 1
When a signal indicating that the image in a specific small area is abnormal (that is, a signal in which the D flag is 1) is input from 1, the gradation of the corresponding image (the gradation of the first area), The gradation of the second area in which the predetermined edge exists is processed by the set weighted average, and the gradation of the entire image is assigned by this gradation conversion curve to It is output to the image processing unit 3a. That is, the gradation change processing unit 25 is provided as an image changing unit.

Here, a specific example of gradation conversion will be described using a histogram flattening process. It should be noted that from the image shown in FIG. 3, a histogram of brightness and frequency obtained from a 10-bit original image is given by a histogram as shown in FIG. (I = 1 to 102 in the figure
4). The horizontal axis represents luminance (i) and the vertical axis represents frequency (fi).

As shown in FIG. 14, a process for evenly allocating this to 8 bits (256 gradations) is performed. First,
Divide the frequency of each luminance by the total number of pixels. Therefore, since the distribution is uniform, the frequency gi of each gradation is 1/256. Next, when the sum of frequencies becomes closer to 1/256 by sequentially adding from the lowest density value of the original image, those densities are assigned to 8-bit level 1. Assuming that the maximum density of the original image at this time is p, the frequencies are sequentially added from the level p of the original image, and when the total is close to 1/256, the next level 2 is assigned. By repeating such calculation, the histogram can be flattened.

In the above histogram conversion, the integrated value Fi = Σfk (k = 1 to i) of the frequency of each level is obtained, and FIG.
This is the same as obtaining a conversion curve as shown in FIG. At this time, Hi (= 256 · F) obtained by multiplying Fi by 256
i) is a level of uniform histogram conversion with respect to the original level I.

As shown in FIG. 13, the histogram of the image of the small area in which the abnormality is detected is different from that of the entire image because the image of the small area (broken line) is only a part of the entire image (solid line). ing. Therefore, the conversion curve from 10 bits to 8 bits is also different between the conversion curve of the entire image (solid line) and the conversion curve of the image of the small area in which an abnormality is detected (broken line), as shown in FIG. Image conversion curve (solid line)
If is applied to an image of a small area in which an abnormality has been detected, there is a problem that the gradation is not easily visible in the small area. For this reason, when the abnormal change is detected, the gradation change processing unit 25 sets the gradation of the entire image based on the conversion curve of the image of the small area in which the abnormal change is detected, so that the abnormal change is detected. It makes it easier to see the small areas that are present.

At this time, not only the small area where the anomaly is detected but also the area (for example, the passage edge) where a predetermined edge exists is applied by the weighted average to obtain the whole area. It will make it easier to understand the changes inside. For example, as shown in FIG. 16, a moving body side area in which an anomaly is detected is a first area, and a structure side area where a predetermined edge exists is a second area, and a weighted average of conversion curves of these areas is set. Is calculated, and the final conversion curve for the entire image is calculated.

As described above, according to the fourth embodiment,
When an abnormality is detected, the gradation of the small area in which the abnormality is detected is converted as the gradation of the entire image, so that the portion in which the abnormality is detected can be easily analyzed in detail. In addition, a region where an anomaly is detected is defined as a first region, and a region where a predetermined edge exists is defined as a second region, and a weighted average of the conversion curves of these regions is calculated to make a final conversion for the entire image. Since it is a curve, it is easy to understand the situation of the change in the whole. Needless to say, the method of calculating the conversion curve can be performed by a method other than the above-described uniformization processing.

Next, FIG. 17 is an overall configuration diagram of a video distribution server and a video reception client system according to the fifth embodiment of the present invention. The fifth embodiment of the present invention is an example of the case where the imaging device 5 is composed of a plurality of devices.
The same components as those of the embodiment are denoted by the same reference numerals and the description thereof will be omitted.

That is, as shown in FIG. 17, the video distribution server and the video reception client system 30 are constructed by connecting one camera server 31 and one video reception client 3 via the network line 4.

The camera server 31 is constructed, for example, by connecting a plurality of image pickup devices 32 such as digital video cameras and a server 33 via a switching unit 34.

Then, the server 33 divides the region into the images input from the plurality of image pickup devices 32 to detect an abnormality, and gives priority to image distribution to the image pickup devices 32 that have detected the abnormality. The rank is set high and the result is output to the switching unit 34.

In the switching unit 34, the image pickup device 32 having a higher rank is based on the priority rank from the server 33.
And preferentially transmits image data from the server 33 to the server 33. That is, the server 33 and the switching unit 34 have a function as an image changing unit.

Therefore, according to the fifth embodiment, when the abnormality is detected, the priority order of the video distribution from the image pickup apparatus which is photographing the abnormality is higher than the priority order of the video distribution by the other image pickup apparatus. Since the setting is made high, it is possible to preferentially and smoothly display the image from the image pickup apparatus that is shooting the abnormality on the monitor 7, and to accurately notify the user of the abnormal state. Further, since it can be realized by simply changing the priority order without increasing the information from the image pickup device, the amount of data does not generally increase, and the amount of network line usage can be minimized. is there.

In each of the above-described embodiments, an image having an abnormality is cut out in the first and second forms, the resolution is changed in the third form, and the gradation is changed in the fourth form. This is changed, and in the fifth embodiment, the order of priority of the image pickup apparatuses is changed, but it goes without saying that these can be combined and performed. For example, it is possible to cut out an image in which an abnormality has occurred to change the resolution and further change the gradation.

[0076]

As described above, according to the present invention, the load of selecting video data on the user side can be significantly reduced, and necessary video data can be accurately transmitted to the user side. It is possible to minimize the usage amount of.

[Brief description of drawings]

FIG. 1 is an overall configuration diagram of a video distribution server and a video reception client system according to a first embodiment of the present invention.

FIG. 2 is a functional block diagram of main parts of the video distribution server and the video reception client system.

FIG. 3 is an explanatory diagram of an example of an entire image captured by the image capturing device.

FIG. 4 is an explanatory diagram of the division of the imaging area.

FIG. 5 is an explanatory diagram of divided areas to be transmitted to the user.

FIG. 6 is a flowchart of the processing of the video distribution server and the video reception client system.

FIG. 7 is a functional block diagram of main parts of a video distribution server and a video reception client system according to the second embodiment of the present invention.

FIG. 8 is a flowchart of the processing of the video distribution server and the video reception client system.

FIG. 9 is a functional block diagram of main parts of a video distribution server and a video reception client system according to the third embodiment of the present invention.

FIG. 10 is an explanatory diagram showing an example of a specific configuration of a solid-state image sensor of the image pickup apparatus.

FIG. 11 is a flowchart of the processing of the video distribution server and the video reception client system of the above.

FIG. 12 is a functional block diagram of main parts of a video distribution server and a video reception client system according to a fourth embodiment of the present invention.

FIG. 13 is an explanatory diagram showing an example of a histogram of luminance and frequency obtained from an original 10-bit image.

FIG. 14 is an explanatory diagram of a concept of making a 10-bit histogram uniform in the same as above.

FIG. 15 is an explanatory diagram showing a difference in gradation between the partial image and the entire image.

FIG. 16 is an explanatory diagram showing a weighted average of two gradation conversion curves.

FIG. 17 is an overall configuration diagram of a video distribution server and a video reception client system according to a fifth embodiment of the present invention.

[Explanation of symbols]

1 video distribution server and video reception client system 2 camera server (video distribution server) 3 video reception client 3a image processing unit (image processing means) 3b abnormality detection processing unit 3c alarm control unit 4 network line 5 imaging device 6 server 6a area division Section 6b Memory 1 6c Memory 2 6d Difference processing section (abnormality detection means) 6e Cutout processing section (image changing means) 7 Monitor 8 Personal computer

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 5C022 AB31 AB32                 5C053 FA11 KA04 LA01 LA14                 5C054 AA01 AA05 CA04 CH01 EA01                       EA05 ED06 ED08 ED13 FC03                       FC12 FC13 GB01 GD01 GD05                       HA18                 5C059 KK22 KK34 MA05 PP04 RA01                       SS06                 5C064 BA01 BB05 BB10 BC16 BD08

Claims (7)

[Claims] 1. A video comprising a video distribution server that processes and distributes substantially continuous video captured by an imaging device, and a video reception client that receives the video distributed by the video distribution server and displays it on a display means. In the distribution server and the video reception client system, the video distribution server detects the change between the frames of the substantially continuous video captured by the imaging device, and the change detection unit detects the change when the change is detected. An image distribution server and an image reception client system, comprising: an image changing unit that changes an image to be transmitted to an image reception client in a predetermined manner. 2. The image changing means extracts, when the abnormality is detected by the abnormality detecting means, a part of an image including an abnormal portion from an entire image and transmits it to the video receiving client. The video distribution server and the video reception client system according to claim 1. 3. The image pickup device of the video distribution server is a plurality of image pickup devices, and the image change means of the video distribution server takes an image of an abnormality when the abnormality detection means detects the abnormality. The video distribution server and the video reception client system according to claim 1 or 2, wherein the priority order of the video distribution from the image pickup apparatus is set higher than the priority order of the video distribution by another image pickup apparatus. 4. The image receiving client according to claim 1, further comprising image processing means for detecting an abnormality in the image distribution server and performing image analysis on an image distributed. A video distribution server and a video reception client system according to any one of the above. 5. The image pickup device of the video distribution server is a CMO.
An image pickup device having an S-type image pickup device, wherein the image changing means of the video distribution server changes the drive of the image pickup device to change the resolution of a transmission image when the abnormality is detected by the abnormality detecting means. The video delivery server and the video reception client system according to any one of claims 1 to 4. 6. The image changing means of the video distribution server, when the abnormality detecting means detects an abnormality, a first area in which the abnormality is detected and a second area in which a predetermined edge is recognized to exist. The video distribution server and the video reception client system according to any one of claims 1 to 5, wherein the gradation is assigned to the entire image based on the gradation of at least one of the areas. 7. The video distribution server and video according to claim 6, wherein the image changing means is capable of changing the weighting of the gradation of the first area and the gradation of the second area. Receiving client system.