JP5693147B2 - Photographic interference detection method, interference detection device, and surveillance camera system - Google Patents

Description

  The present invention relates to a technique for detecting shooting disturbance to a surveillance camera.

  Surveillance camera systems are increasingly equipped with detection functions such as intrusion, leaving, and taking away using image analysis processing. Also, there are mischievous actions and shooting disturbing actions such as changing the direction, covering with a cloth, and applying spray or gum to the camera. As a method for detecting these, in addition to a method using a proximity sensor or an infrared sensor, a method using image processing has been proposed.

  For example, there is a technique for detecting shooting interference using the fact that the encoded size of image data is smaller than a preset threshold of data amount (Patent Document 1). In addition, detection of interference by detecting that a predetermined area of an image having a predetermined luminance value or more in the field of view exceeds a predetermined number or that a predetermined area of an image having a luminance value of a predetermined value or less has exceeded a predetermined number. There is a method of performing (Patent Document 2). In addition, there is a technique for detecting the attachment of a translucent light-shielding object to a lens surface using a change in a high frequency component of a video signal (Patent Document 3).

  Furthermore, there is a method in which normalized edge strengths are compared between a plurality of reference images having different average brightness values and the current image, and shooting interference is detected when the degree of coincidence is low (Patent Document 4). Then, there is a method of measuring the similarity between the reference edge image and the current edge image, and detecting whether or not the photographing is disturbed from the continuity of the similarity (Patent Document 5).

JP 09-075453 A JP 2000-222646 A JP 2001-238204 A JP 2005-252479 A JP 2008-167429 A

  The above-described conventional method pays attention to changes in image feature amounts such as pixel luminance values, edge components, and high-frequency components. In some cases, attention is paid to the temporal continuity of the feature amount described above, and an abnormality is detected when a state different from the normal state continues for a predetermined time or more.

  However, since it is difficult to determine whether the change in the feature amount is caused by a plurality of normal objects or shooting disturbance, a scene in which a plurality of people are moving due to, for example, a crowd is considered shooting disturbance. There is a possibility of false detection.

  For example, when a camera is installed in a dome and the dome is covered with a patterned cloth, the cloth may be focused. In this case, there is a possibility that the encoding amount does not decrease or the distribution with respect to the high frequency component is maintained. In addition, when there are a plurality of objects in the screen, a predetermined area that is greater than or equal to the luminance value is generated, and this may be erroneously detected as shooting disturbance. Furthermore, in comparison with the reference image, it cannot be distinguished from the case where a plurality of objects continue to exist for a considerable time. The same can be said for edge images.

The present invention provides a possible apparatus and method prevent the erroneous detection of the shadow disturbance or mischief Taking.

The present invention is a shooting disturbance detection method executed by a disturbance detection device for detecting shooting disturbance,
A detecting step in which the detecting means detects an object from the video taken by the surveillance camera;
Judging means, the accounting object detection area detected by the detecting means at a rate equal to or greater than the first predetermined value, and whether or not the object of the second predetermined value or more size is detected by the detection means A determination step of determining
Detecting means, said detected by the detection means the object occupies the detection area at a rate of the first predetermined value or more, and, the object of the second predetermined value or more size is detected by the detection means wherein when it is determined by the determination means, a detection step of detecting the object, as an object to interfere with imaging and,
It is characterized by having.

According to the present invention, it is possible to prevent erroneous detection of the shadow disturbance or mischief Taking.

The figure which shows the structure of the surveillance camera system in this embodiment. 1 is a diagram illustrating a schematic configuration of a network camera 100. FIG. The figure for demonstrating an example of imaging | photography disturbance detection. The flowchart which shows a photography disturbance detection process. The flowchart which shows an object detection process. The flowchart which shows an event detection process.

  Hereinafter, embodiments for carrying out the invention will be described in detail with reference to the drawings. In addition, the structure shown as the following embodiment is only an example, and this invention is not limited to this structure.

  As this embodiment, shooting disturbance detection processing for detecting shooting disturbance from the state of an object detected in an image will be described with reference to FIG. 1 showing the configuration of a typical surveillance camera system. The example shown in FIG. 1 is a surveillance camera system in which a network camera 100, a display device (viewer) 200, and a recording server 300 are connected via a network 10.

  The network camera 100 has a function of detecting an object, which will be described in detail later, and a function of a disturbance detection device that determines the state of the detected subject. With this function, it is possible to detect abnormal conditions such as shooting disturbance and mischief. The abnormality detection process may be executed by the recording server 300 or the display device 200 without being performed on the network camera 100 side. Video 101 and metadata 102 are distributed from the network camera 100. This metadata 102 includes subject information and abnormality information. Information exchanged between the devices is a combination of the video 101 and the metadata 102.

  The display device 200 receives the video 101 and the metadata 102, and displays the subject information superimposed on the video. The recording server 300 stores the video 101 and the metadata 102. Note that the metadata 102 may be attached to the video 101 or may be distributed in a stream different from the video 101.

  Next, a schematic configuration of the network camera 100 functioning as a disturbance detection device will be described with reference to FIG. The network camera 100 generally includes an optical system and an image sensor. The network camera 100 includes an imaging system 110 that captures an image, a pan / tilt head driving system 120 having a pan / tilt function, and a control system 130 that controls the network camera 100 as a whole. It is configured.

  The control system 130 includes an image acquisition unit 131 that acquires a captured image captured by the image sensor, an encoding unit 132 that encodes the captured image, and a video that distributes the encoded video to the display device 200 and the recording server 300. A distribution control unit 133 is included. Examples of the encoding method for encoding a captured image into video include motion JPEG, MPEG-4, H.264, and H.264. Although there are schemes such as H.264, the present invention does not depend on a specific coding scheme.

  The control system 130 includes an object detection processing unit 134, an event detection processing unit 135, and an event distribution control unit 136. As an object detection method, there are a method based on background difference and a method for directly detecting a human body. Detection detection of the object detection processing unit 134 is set by the setting control unit 139. The event detection processing unit 135 determines the state of the object detected by the object detection processing unit 134 and detects events such as intrusion, leaving, taking away, and mischief. The event distribution control unit 136 determines whether or not the detection result of the event detection processing unit 135 is distributed to the display device 200 or the recording server 300, and generates event information in the case of distribution.

  Further, the control system 130 includes an imaging system control unit 137, a pan head control unit 138, a setting control unit 139, and a communication unit 140. The imaging system control unit 137 controls zooming and focusing in the imaging system 110. The pan / tilt head control unit 138 performs control to change the orientation of the imaging system 110 in the horizontal and vertical directions according to the pan / tilt setting of the setting control unit 139. The setting control unit 139 notifies the imaging system control unit 137, the pan head control unit 138, and the object detection processing unit 134 of setting information.

  The communication unit 140 transmits the event information such as the video of the video distribution control unit 133 and the disturbance detection of the event distribution control unit 136 to the display device 200 and the recording server 300 via the network 10. On the other hand, the communication unit 140 receives setting information from the display device 200 and transmits the setting information to the setting control unit 139.

  Next, an example of typical shooting disturbance detection assumed in this embodiment will be described with reference to FIG. FIG. 3A shows an example in which the lens surface of the image sensor is covered with a cloth. If the dome is covered or the cloth is thin, a pattern may appear as shown in the figure. Next, (B) shown in FIG. 3 is a case where a sticker or the like is attached, and there is a portion that is not hidden. Further, (C) shown in FIG. 3 is a case where spray is applied. Finally, (D) shown in FIG. 3 is an example of a normal scene that does not correspond to shooting disturbance, and is a scene in which a plurality of persons are moving at the time of congestion. Note that the “detection area coverage ratio”, “maximum object size”, and “object stationary ratio” given in the drawing will be described in detail together with a shooting disturbance detection process described later.

  Next, shooting disturbance detection processing according to the present embodiment will be described. The shooting disturbance detection process first detects an object, and then determines whether or not the state of the detected object satisfies the shooting disturbance condition. Here, the object detection uses a method based on background difference. For the background difference, a difference amount between a reference image feature captured in a state where no object exists and the current image feature is calculated, and a region having a large difference is detected as an object region.

  The reference image feature holds feature amounts corresponding to a plurality of background states. The feature amount includes luminance, color components in pixel units, frequency components in block units, and the like. In addition, by maintaining a plurality of states, a constantly changing background can be modeled.

  When an elapsed time after the appearance of a certain state is equal to or greater than a predetermined (predetermined) value, the state can be regarded as a background. Conversely, when the elapsed time is less than the predetermined value, the state is the foreground. The object area is an area obtained by combining the foreground areas. The average of the elapsed times of partial areas belonging to a certain object area is defined as the existence time of the object.

  In addition, by recording, for each background state, the time when the input feature value from the most recent image matches the feature value already held in the elapsed time for each background state. Can be used to measure the total time actually observed. The ratio between the total time and the elapsed time can be defined as the appearance rate of this state. As a result, it is possible to determine whether or not the object is stationary for a long time by taking the average value of the appearance rate in the partial region belonging to the object. This is called “object stationary rate”.

  As a result of the above processing, the area, size, existence time, and object stationary rate of each object can be obtained. Further, a ratio of an object to a predetermined area arranged on the screen is defined as “detection area coverage”. The detection area normally designates the entire screen, but any part may be designated. The size of the object can also be handled as a ratio to the detection area area.

  Here, the state determination process calculates the object size, the existence time, the object stationary rate, the number of matched objects in addition to the detection area coverage, and determines whether or not a predetermined condition (discrimination rule) is satisfied. It is. This process can detect various shooting disturbances by changing the conditions. This shooting disturbance condition is defined as setting the area over the entire screen, the detection area coverage being a predetermined value or more, the object size being a predetermined value or more, and the object stationary ratio being a predetermined value or more. By judging such a plurality of conditions, it is possible to discriminate between a case where a plurality of objects are moving (normal scene) and a case where the front surface of the lens is covered with a cloth (shooting disturbing scene).

  By this state determination process, it is confirmed whether or not the scenes (A) to (D) shown in FIG. (A) shown in FIG. 3 is a scene in which the front surface of the lens is covered with a cloth, and the detection area coverage rate, the maximum object size, and the object stationary rate are all high. This is because the cloth was left in the state covered. Therefore, it is determined that the shooting is disturbed. The same applies to (B) shown in FIG.

  On the other hand, (C) shown in FIG. 3 cannot be distinguished from (D) shown in FIG. 3 by the detection area coverage and the maximum object size. However, since the area once sprayed does not change, it can be determined that the object stationary rate is high and that the shooting is disturbed. Finally, (D) shown in FIG. 3 can be determined as a normal scene because the object stationary rate is low because of the traffic of a plurality of persons.

  As described above, as an example, by setting the detection area coverage ratio to 60%, the maximum object size to 33, the object stationary ratio to 70%, etc., it is possible to discriminate between shooting disturbance and a normal scene. .

  Here, the shooting disturbance detection process will be described with reference to the flowcharts shown in FIGS. FIG. 4 is a flowchart showing the shooting disturbance detection process. First, in step S <b> 401, the object detection processing unit 134 performs object detection processing for detecting an object based on a background difference from the image acquired by the image acquisition unit 131. Details of the object detection process will be described later with reference to FIG. Note that the shooting disturbance detection process may be executed by the recording server 300 or the display device 200 without being performed on the network camera 100 side.

  Next, in S402, the event detection processing unit 135 performs event detection processing by determining the state of the object. This event detection process is performed by applying each discrimination rule to all detected objects. Details of the event detection process will be described later with reference to FIG.

  Next, in S403, it is determined whether or not all event detection processes have been completed. The process in S402 is repeated until all event detection processes are completed, and when all event detection processes have been completed, the process proceeds to S404. In step S404, it is determined whether an event has been detected. If it is detected as a result of the determination, the process proceeds to S405, the detection result is transmitted to the display device 200 as a detection message, and the process ends. It is assumed that at least one of the event detections in S402 is set as a shooting disturbance detection rule.

  Here, the object detection process in S401 will be described with reference to FIG. In this embodiment, a background difference method is used in which a plurality of feature amounts obtained from DCT (discrete cosine transform) coefficients in each block of JPEG are used as a background model. Examples of the feature amount include a sum of absolute values of DCT counts and a sum of differences of corresponding components between adjacent frames. As another background model, a method having a density distribution in units of pixels (for example, Japanese Patent Laid-Open No. 10-255036) can be used.

  First, in S501, DCT coefficients are generated from the original image to extract image features. Here, the low frequency components of the Y, U, and V portions are used as image features. In step S502, it is compared whether or not the plurality of feature amounts generated in step S501 match an existing background model. In order to respond to changes in the background, the background model has multiple states. This is called a mode. In each mode, the above-described feature amount is held as background information, and comparison is performed by calculating a difference from the feature amount obtained from the current image.

  Next, in S503, it is determined whether or not a similar mode exists. If a similar mode exists, the process proceeds to S504, and the feature amount of the corresponding mode is updated. Here, the existing state is updated by mixing the new feature quantity and the existing feature quantity at a constant ratio.

  In S503, if a similar mode does not exist, the process proceeds to S505 to determine whether it is a shadow. This can be distinguished from the fact that there is no change in the feature amount component caused by the color compared to the existing background. As a result of the determination, if it is determined as a shadow, the process proceeds to S506 and is not updated. On the other hand, if it is determined not to be a shadow, the process proceeds to S507, and a new background mode is generated as a new state. The new background mode automatically becomes the foreground.

  Next, in S508, it is determined whether or not the processing has been completed for all blocks. If the processing has not been completed, the processing returns to S501 and the above-described processing is repeated. On the other hand, if the processing is completed for all the blocks, the process proceeds to S509 to perform object region extraction processing. Here, in each block, a plurality of background model modes are separated into an actual background and a foreground such as an object.

  Next, in S510, a region integration process is performed by connecting adjacent foreground blocks. Next, in S511, the small area is removed as noise. In step S512, the object information of all objects is extracted, the object tracking process is performed, and the process ends. According to the object detection process described above, it is possible to stably extract object information while sequentially updating the background model.

  Next, the event detection process in S402 will be described in detail with reference to FIG. The event detection process is a process for detecting an event such as the presence of a moving object, leaving, taking away, shooting disturbance, etc. by determining the state of the object. Specifically, it is determined whether or not the detection area coverage rate, the object size, the existence time, and the object stationary rate are within a predetermined range for the object detected by the object detection processing unit 134.

  First, in S701, it is determined whether or not the detection area coverage is within a predetermined range. This is a process for determining a ratio in which the sum of overlapping portions of each object and the detection region is a numerator and the area of the detection region is a denominator. If the detection area coverage is not within the predetermined range, the process is terminated. If it is within the predetermined range, the process proceeds to S702, and the determination is started from rule number 1.

  Next, in S704 to S706, it is determined whether or not the state of each object is within a predetermined range of the determination rule. That is, it is determined whether or not the object size is within a predetermined range in S704, the existence time in S705, and the object stationary rate in S706. In step S707, it is determined whether or not the processing has been completed for all the objects. If the processing has not been completed, the processing returns to step S704 and the above-described determination processing is repeated.

  If the process is completed in S707, the process proceeds to S708, where it is determined whether or not the number of objects that match the determination rule is within a predetermined range. As a result of the determination, if it is within the predetermined range, the process proceeds to S709, where “ON” is set as the detection result of the event corresponding to the rule number. On the other hand, if the number of objects is not in the predetermined range in S708, the process proceeds to S710, where “OFF” is set as the detection result of the event corresponding to the rule number.

  Next, in S711, it is determined whether or not all events have been detected. If not, the process proceeds to S712, the rule number is updated for the next determination rule, the process returns to S704, and the above processing is performed. repeat. Thereafter, when all events have been detected in S711, this process ends.

  In this process, various detections are possible by setting the detection area coverage, the object size, the existence time, and the object stationary rate. In the shooting disturbance detection, a lower limit of the detection area coverage, a lower limit of the object size, and a lower limit of the object stationary rate are set with respect to a predetermined rule setting value. The lower limit of the number of objects is a specified value of 1.

  According to the present embodiment, shooting disturbance can be detected by applying state determination processing to an object detected in an image. In addition, by appropriately adjusting the setting value of the discrimination rule, it is possible to discriminate between a normal scene where a plurality of objects exist and a scene where a cloth or the like is placed on the lens front surface. As a result, it is possible to realize shooting interference detection with few false detections.

[Other Embodiments]
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

Claims (11)

A shooting tampering detection method executed by a tampering detection device for detecting shooting tampering,
A detecting step in which the detecting means detects an object from the video taken by the surveillance camera;
Judging means, the accounting object detection area detected by the detecting means at a rate equal to or greater than the first predetermined value, and whether or not the object of the second predetermined value or more size is detected by the detection means A determination step of determining
Detecting means, said detected by the detection means the object occupies the detection area at a rate of the first predetermined value or more, and, the object of the second predetermined value or more size is detected by the detection means wherein when it is determined by the determination means, a detection step of detecting the object, as an object to interfere with imaging and,
A method of detecting a shooting disturbance characterized by comprising: A shooting tampering detection method executed by a tampering detection device for detecting shooting tampering,
A detecting step in which the detecting means detects an object from the video taken by the surveillance camera;
Judging means, the accounting object detection area detected by the detecting means at a rate equal to or greater than the first predetermined value and the proportion of area to the detection region is a second predetermined value or more objects by said detecting means A determination step of determining whether it has been detected ;
Sensing means, the accounting object detected by the detecting means to the detection region at a rate of more than the first predetermined value, and said ratio of the area with respect to the detection region is the second predetermined value or more objects the If it is determined by said determining means and detected by the detecting means, a detection step of detecting the object, as an object to interfere with imaging,
A method of detecting a shooting disturbance characterized by comprising: The determination means further determines whether or not the time during which the object detected by the detection means exists is equal to or greater than a predetermined value;
Said detecting means further if the time that the detected object by the detecting means there is determined the that a predetermined value or more, to detect the object, as an object to interfere with shooting The method of detecting a photographing disturbance according to claim 1 or 2. The determination unit further determines whether or not a stationary rate at which the object detected by the detection unit is stationary is equal to or greater than a predetermined value;
Said detecting means further detects, when the stationary rate detected object by said detecting means is stationary is determined to the be the predetermined value or more, the object, as an object that interferes with the photographing The imaging disturbance detection method according to claim 1, wherein the imaging disturbance detection method is performed.   5. The photographing disturbance detection method according to claim 1, further comprising a transmission step of transmitting the detected detection result to a display device. 6. The shooting disturbance detection method according to claim 1, wherein the detection area is the entire screen. A tampering detection device for detecting shooting tampering,
Detection means for detecting an object from the captured video;
The accounting object detection area detected by the detecting means at a rate equal to or greater than the first predetermined value, and determining means for determining the object of the second predetermined value or more size is detected by the detection means ,
The determination means that the object detected by the detection means occupies the detection area at a ratio equal to or larger than the first predetermined value and an object having a size equal to or larger than a second predetermined value is detected by the detection means. when it is determined, a detection means for detecting the object, as an object to interfere with imaging,
A tamper detection device characterized by comprising: A tampering detection device for detecting shooting tampering,
Detection means for detecting an object from the captured image;
The occupied detected object the detection area by the detection means at a rate equal to or greater than the first predetermined value and whether the ratio of the area with respect to the detection region is a second predetermined value or more objects detected by said detecting means Determining means for determining whether or not;
Before SL occupy object the detection area detected by the detecting means at a rate of the first predetermined value or more, and the predetermined value or more objects proportion said second area relative to the detection area by said detecting means If it is determined by the detected and the determination means, detection means for detecting the object, as an object to interfere with imaging,
A tamper detection device characterized by comprising: The determination unit further determines whether or not a stationary rate at which the object detected by the detection unit is stationary is equal to or greater than a predetermined value;
Said detecting means further detects, when the stationary rate detected object by said detecting means is stationary is determined to the be the predetermined value or more, the object, as an object that interferes with the photographing The tampering detection apparatus according to claim 7 or 8 , characterized in that: A surveillance camera system having a surveillance camera, a display device that displays video captured by the surveillance camera, and a recording server that records video captured by the surveillance camera,
Detection means for detecting an object from the captured video;
The accounting object detection area detected by the detecting means at a rate equal to or greater than the first predetermined value, and the object of the second predetermined value or more sizes or the proportion of area to the detection area is the second predetermined A determination means for determining whether an object having a value equal to or greater than a value is detected by the detection means;
The detected object by detecting means is determined by said determining means and occupy the detection region in a first ratio of a predetermined value or more, and, the object of the second predetermined value or more sizes, or, before Symbol detection area detection means the ratio of the area when the second predetermined value or more objects determined by the determining means and detected by said detecting means, for detecting the object, as an object that interferes with shooting for,
A surveillance camera system comprising: The program for functioning a computer as each means of the disturbance detection apparatus of any one of Claims 7 thru | or 9 .