JP2011229044A - Image monitoring and recording device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image monitoring and recording device which enhances use efficiency of a recording medium even for a place where a person, a moving body, etc., are always imaged.SOLUTION: The image monitoring and recording device includes an image recognition processing unit 7 as an extraction unit which extracts a person image or an object image from input image data, an image recording unit 6 as a recording unit which records the extracted person image or object image, the image recognition processing unit 7 as a determination unit which determines whether the extracted person image or object image is identical to a registered person image or a registered object image by comparing the extracted person image or object image with the registered person image or the registered object image having been registered in advance, and a main control unit 9 as a control unit which controls recording settings of the image recording unit 6 based upon the determination made by the image recognition processing unit 7.

Description

  The present invention relates to an image monitoring and recording apparatus, and more particularly to an image monitoring and recording apparatus that detects the state of an image capturing a monitoring area and records an intruder or facility abnormality.

  A conventional image monitoring and recording apparatus records data obtained by compressing a monitoring image at a preset compression rate regardless of the content of the image being monitored. To increase the recording time, for example, Patent Literature As shown in FIG. 1, an alarm recording technique is used that records only when motion detection is not in a steady state. In the image monitoring and recording apparatus of Patent Document 1, since image recording is started only when there is movement in the monitoring area, the use efficiency of the recording medium can be improved, and if there is any change in the monitoring area, recording is performed. I can do it.

  Further, as shown in Patent Document 2, for example, a conventional image monitoring and recording apparatus uses a technique for detecting a human face from a captured image.

JP 2007-124526 A JP 2006-318364 A

  However, in the method of Patent Document 1, when there is a place where a person is always reflected or a place where a moving object is placed in the monitoring area, alarm recording is always performed even if there is no abnormality. The meaning of is lost. That is, in such a case, there is a problem that the utilization efficiency of the recording medium cannot be increased.

  The present invention has been made to solve the above-described problems, and is an image monitoring and recording apparatus capable of improving the utilization efficiency of a recording medium even in a place where people, moving objects, etc. are always reflected. For the purpose of provision.

  An image monitoring and recording apparatus according to the present invention includes an extraction unit that extracts a person image or an object image from input image data, a recording unit that records the extracted person image or the object image, and the extracted person The image or the object image is compared with the registered person image or the registered object image registered in advance, and it is determined whether the extracted person image or the object image is the same as the registered person image or the registered object image. And a control unit for controlling the recording setting in the recording unit based on the determination in the determining unit.

  According to the image monitoring and recording apparatus of the present invention, an extraction unit that extracts a person image or an object image from the input image data, a recording unit that records the extracted person image or the object image, and an extraction are extracted. The person image or the object image is compared with the registered person image or the registered object image registered in advance, and whether the extracted person image or the object image is the same as the registered person image or the registered object image And a control unit for controlling the recording setting in the recording unit based on the determination in the determining unit, it is possible to reduce useless recording data and perform recording for a long time. .

1 is a configuration diagram of an image monitoring recording apparatus according to a first embodiment; 3 is a flowchart showing an operation of the image monitoring recording apparatus according to the first embodiment. 2 is a part of a flow showing an operation of the image monitoring recording apparatus according to the first embodiment; 3 is a flowchart showing an operation of the image monitoring recording apparatus according to the first embodiment. FIG. 2 is a conceptual diagram illustrating a structure of a memory and a recording unit of the image monitoring recording apparatus according to the first embodiment.

<A. Embodiment 1>
<A-1. Configuration>
Hereinafter, the image monitoring recording apparatus according to the first embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing the configuration of an image monitoring and recording apparatus according to the present invention. As shown in the figure, the image monitoring and recording apparatus 1 compresses the image data output from the camera image processing unit 4 and the camera image processing unit 4 to which the image data recorded in the imaging unit 3 including the lens 2 is input. An image compression unit 5 that performs image processing, an image recognition processing unit 7 that receives image data output from the camera image processing unit 4, and an image that records image data output from the image compression unit 5 in a plurality of recording areas. An image memory 8 connected to the recording unit 6 and the image recognition processing unit 7 for authenticating a person or an object and registering the template image and dividing it into registration areas, and the image memory 8 and the image recording unit 6 are mutually connected. The main control unit 9 that performs condition setting, processing command transmission, response processing and the like for each processing unit of the image monitoring and recording apparatus 1 by the CPU, and based on the control of the main control unit 9, It includes an image processing setting control unit 10 for setting the number of image quality and frame to be recorded on the recording unit 6, and a monitor 11 which is interconnected with the image memory 8 and the main control unit 9. The output from the image recognition processing unit 7 is also input to the image compression unit 5, and the image recognition processing unit 7 and the main control unit 9 are connected to each other.

  The image recognition processing unit 7 serving as an extraction unit extracts a person image (person's face) or an object image from the image data generated by the camera image processing unit 4, and the image recording unit 6 serves as a recording unit. In addition, as a determination unit, it is determined whether or not these images coincide with template images (registered person image and registered object image) registered in advance in the image memory 8.

<A-2. Operation>
FIG. 2 is a flowchart showing the operation of the image monitoring recording apparatus 1. FIG. 3 is a flowchart from image data acquisition (step S200 in FIG. 2) to image data storage (steps S203 and 206 in FIG. 2). FIG. 4 is a flowchart for registering a template image in the image memory 8. is there.

<A-2-1. Image recording operation>
First, with reference to FIG. 3, a classification process of a moving object detected in the monitoring area and a recording process of the image data will be described. First, the image data input from the imaging unit 3 is acquired by the camera image processing unit 4 (step S200). Next, the image recognition processing unit 7 extracts a moving object from the image data (step S201). Then, it is determined whether the moving body is a person or not (step S202).

  In order to determine whether the moving body is a person, it is determined whether there is a face image using pattern matching or the like (step S202). If a face image is detected, it is determined that the person is a person, and image data of only the face image portion is stored in the first area of the image recording unit 6 (step S203). When a face image is not detected and it is determined that the moving body is not a person, the image data of the object is stored in the second area of the image recording unit 6 (step S206), and the process ends. Here, the image recording unit 6 has a structure as shown in FIG. 5B, and the image data of the extracted portion can be stored in different storage areas depending on whether or not it is determined as a person. Control of the recording setting in the image recording unit 6 as such a recording unit is performed by the main control unit 9.

<A-2-2. Image registration operation>
FIG. 4 is a flowchart regarding person information registration and object information registration. First, the person information registration process will be described. First, the operator determines whether or not to register person information (person image) for the person image in the image recording unit 6 (step S30). If it is determined that person information (person image) is registered, the face image stored in the first area of the image recording unit 6 is displayed on the monitor 11 and selected as a registered person image to be registered (step S31). . Further, the operator determines whether or not the displayed face image is a suspicious person (step S32).

  If it can be determined as a suspicious person, it is registered as a suspicious person (step S33). From the registered face image, feature points such as eyes, nose and mouth are extracted to obtain a normalized face image in which the face orientation, size, etc. are corrected. In the first area of the image memory 8, This face image is stored as a template image of the suspicious person (step S33). It is also possible to register additional information such as time information and management information related to the registered image. A known method can be used as a normalization method.

  If it can be determined that it is not a suspicious person, it is registered as not being a suspicious person (step S34), a normalized face image is acquired in the same manner as when it is determined to be a suspicious person, and a person who is not a suspicious person in the second area of the image memory 8 The face image is stored as the template image (step S34). It is also possible to register additional information such as time information and management information related to the registered image.

  The above-described step S32 is sequentially performed on the face image stored in the first area of the image recording unit 6.

  Next, the object information registration process will be described. If the operator does not register the person information (step S30) and determines that the object information (object image) is registered (step S35), the object image stored in the second area of the image recording unit 6 on the monitor 11 And is selected as a registered object image to be registered (step S36). Further, the operator determines whether or not the displayed object is a suspicious object (step S37).

  If it can be determined as a suspicious object, it is registered as a suspicious object (step S38). From the registered suspicious object, a normalized image of the moving body whose size is corrected is acquired, and the image is stored as a template image of the suspicious object in the third area of the image memory 8 (step S38). It is also possible to register additional information such as time information and management information related to the registered image. A known method can be used as a normalization method.

  If it can be determined that the object is not a suspicious object, it is registered as not being a suspicious object (step S39), and a normalized image of the moving object is acquired in the same manner as when it is determined that the object is a suspicious object. The object image is stored as a non-template image (step S39). It is also possible to register additional information such as time information and management information related to the registered image.

  The above step S37 is sequentially performed on the object image stored in the second area of the image recording unit 6. Here, the image memory 8 has a structure as shown in FIG. 5A. Depending on whether the image memory 8 is a suspicious person or a suspicious object, the image of the extracted portion is set in different registration areas. Data can be registered.

<A-2-3. Image verification operation>
Next, the image matching process will be described with reference to FIG. First, the camera image processing unit 4 acquires the image data input from the imaging unit 3 (step S200). Next, the image recognition processing unit 7 extracts a moving object from the image data (step S201).

  When a face image is detected from the moving object extracted by the image recognition processing unit 7 (step S202), the image data of the face image is stored in the first area of the image recording unit 6 (step S203). If no face image is detected from the moving object extracted by the image recognition processing unit 7 (step S202), the image data of the object image is stored in the second area of the image recording unit 6 (step S206).

  When a face image is detected from the moving body extracted by the image recognition processing unit 7, the template matching is sequentially performed with the template image of the suspicious person registered in the first area of the image memory 8 (step S204).

  When the extracted face image matches the registered template image of the suspicious person (step S204), the image data of the face image is stored in the third area of the image recording unit 6 (step S209), and the image recognition processing unit 7 informs the main control unit 9 of the coincidence, and the main control unit 9 as the control unit instructs the image processing setting control unit 10 to increase the number of frames for subsequent recording and to improve the image quality as control of the recording setting ( Command to change image processing settings) (step S213).

  If the extracted face image does not match the template image of the suspicious person (step S204), template matching is performed sequentially with the template image that is not a suspicious person registered in the second area of the image memory 8 (step S205). . If the extracted face image matches the registered template image that is not a suspicious person (step S205), the image data of the face image is stored in the fourth area of the image recording unit 6 (step S210), and image recognition processing is performed. The control unit 9 informs the main control unit 9 of the coincidence, and the main control unit 9 as the control unit instructs the image processing setting control unit 10 to reduce the number of frames for subsequent recording and to lower the image quality as control of recording settings. (Image processing setting change command) is issued (step S213). If the extracted face image does not match the registered template image that is not a suspicious person, the process ends.

  If no face image is detected from the moving body (step S202), the image data of the object is stored in the second area of the image recording unit 6 (step S206), and the suspicious object registered in the third area of the image memory 8 Template matching with the template images is sequentially performed (step S207).

  When the extracted object image matches the registered template image of the suspicious object (step S207), the image data of the object is stored in the fifth area of the image recording unit 6 (step S212), and the image recognition processing unit 7 notifies the main control unit 9 of the coincidence, and the main control unit 9 as the control unit increases the number of frames for subsequent recording to the image processing setting control unit 10 to increase the image quality (command for changing the image processing setting). (Step S213).

  If the extracted image of the object and the registered template image of the suspicious object do not match (step S207), the template matching with the template image that is not a suspicious person registered in the fourth area of the image memory 8 is sequentially performed. (Step S208). If the extracted image of the object matches the registered template image that is not a suspicious object (step S208), the image data of the object is stored in the sixth area of the image recording unit 6 (step S211), and image recognition processing is performed. The control unit 9 informs the main control unit 9 of the coincidence, and the main control unit 9 as the control unit instructs the image processing setting control unit 10 to reduce the number of frames for the subsequent recording and to reduce the image quality (command to change the image processing setting). (Step S213). If the extracted image of the object does not match the template image that is not a registered suspicious object, the process ends.

  When there is a command for changing the image processing setting, the compression rate in the image compression unit 5 is controlled via the image processing setting control unit 10.

<A-3. Effect>
According to the first embodiment of the present invention, in the image monitoring and recording apparatus, the image recognition processing unit 7 as an extraction unit that extracts a person image or an object image from input image data, and the extracted person image or The image recording unit 6 serving as a recording unit for recording the object image, the extracted person image or object image and the registered person image or registered object image registered in advance are compared, and the extracted person image or object image is registered. An image recognition processing unit 7 as a determination unit that determines whether or not a person image or a registered object image is the same, and a control unit that controls recording settings in the image recording unit 6 based on the determination in the image recognition processing unit 7 By providing the main control unit 9, if it is determined that the person is a registered suspicious person, the number of frames and the image quality are increased and recorded. If it is determined that the person is not a registered suspicious person, For recording by lowering the arm speed and image quality, and reduce the unnecessary record data, it is possible to long-time recording.

  Further, according to the first embodiment of the present invention, in the image monitoring and recording apparatus, the image recognition processing unit 7 as the extracting unit extracts a face image from the moving body image in the input image data. Depending on whether or not the person image or the object image is distinguished and extracted, the recording setting can be controlled depending on whether the moving body is a person or an object.

  Further, according to the first embodiment of the present invention, in the image monitoring and recording apparatus, the main control unit 9 as the control unit controls the recording setting in a different recording area in the image recording unit 6 as the recording unit. By controlling the person image and the object image to be recorded, it is possible to distinguish and record each type of recording, thereby shortening the image search time.

  Further, according to the first embodiment of the present invention, in the image monitoring and recording apparatus, the image compression unit 5 as the compression unit that compresses the person image or the object image recorded in the image recording unit 6 as the recording unit. Further, the main control unit 9 as a control unit efficiently controls the recording setting by controlling the compression rate in the image compression unit 5 based on whether or not it matches the registered person image or the registered object image. Recording becomes possible.

  Further, according to the first embodiment of the present invention, the image monitoring and recording apparatus further includes the image memory 8 as a registration unit for registering the registered person image and the registered object image, and the image memory 8 includes the extracted person. Is registered as a suspicious person, and the image is registered based on whether the extracted object is designated as a suspicious object. It can be used to compare an object with a person or object extracted in the subsequent recording, and efficient recording becomes possible.

  Further, according to the first embodiment of the present invention, in the image monitoring and recording apparatus, the image memory 8 as the registration unit can easily manage by registering the registered person image and the registered object image as template images. Thus, the recording area can be used efficiently.

  Further, according to the first embodiment of the present invention, in the image monitoring and recording apparatus, the image memory 8 as the registration unit further registers the incidental information of the registered person image and the registered object image, thereby performing image search and the like. It is effective when performing.

  Further, according to the first embodiment of the present invention, in the image monitoring recording apparatus, the image memory 8 as the registration unit is registered differently depending on whether or not it is a suspicious person or a suspicious object. By registering the registered person image and the registered object image in the region, it is possible to register the registered person image and the registered object image separately for each type of recording, thereby shortening the image search time.

  DESCRIPTION OF SYMBOLS 1 Image monitoring recording device, 2 Lens, 3 Imaging part, 4 Camera image process part, 5 Image compression part, 6 Image recording part, 7 Image recognition process part, 8 Image memory, 9 Main control part, 10 Image processing setting control part 11 Monitor.

Claims (8)

An extraction unit for extracting a person image or an object image from the input image data;
A recording unit for recording the extracted person image or the object image;
The extracted person image or object image is compared with a registered person image or registered object image registered in advance, and the extracted person image or object image is the same as the registered person image or registered object image A determination unit for determining whether or not,
A control unit that controls recording settings in the recording unit based on the determination in the determination unit;
Image monitoring and recording device. The extraction unit distinguishes and extracts a human image or an object image depending on whether or not a face image is extracted from a moving body image in the input image data.
The image monitoring recording apparatus according to claim 1. The control unit controls the recording unit to record the person image and the object image in different recording areas in the recording unit,
The image monitoring recording apparatus according to claim 1 or 2. A compression unit that compresses the person image or the object image recorded in the recording unit;
The control unit controls a compression rate in the compression unit as the recording setting control.
The image monitoring recording apparatus according to claim 1. A registration unit for registering the registered person image and the registered object image;
The registration unit registers the image based on whether or not the extracted person is designated as a suspicious person, and whether or not the extracted object is designated as a suspicious object;
The image monitoring recording apparatus according to claim 1. The registration unit registers the registered person image and the registered object image as template images, respectively.
The image monitoring recording apparatus according to claim 5. The registration unit further registers incidental information of the registered person image and the registered object image;
The image monitoring recording apparatus according to claim 5 or 6. The registration unit registers the registered person image and the registered object image in different registration areas by determining whether the person is the suspicious person or the suspicious object,
The image monitoring recording apparatus according to claim 5.

Images