KR102078265B1 - Aapparatus of processing image and method of providing image thereof - Google Patents

Abstract

The present embodiment includes the steps of acquiring a first image of photographing a monitoring area from a camera; Acquiring sensing data including whether each device is executed, an execution time point, and an executed operation from one or more devices located around the communication unit; Identifying an object appearing in the first image by using the result of analyzing the first image or the sensing data; And determining whether the inactive condition is satisfied using the identification information of the object, and if the identification information of the object satisfies the inactive condition, deactivating a transmission function of the communication unit. Disclosed is a method of providing an image of an image processing apparatus that discriminates and processes an image differentially according to an object.

Description

An image processing apparatus for processing an image differentially according to an object by identifying an appearance object and a method for providing an image thereof {Aapparatus of processing image and method of providing image

The present embodiments are directed to an image processing apparatus and an image providing method thereof for identifying an appearance object and processing an image differentially according to the object.

Recently, with the increase in the number of services on the web, security issues have emerged, and these security issues have raised security camera privacy problems and fears of hacking.

Korean Unexamined Patent Publication No. 2013-0003886

Embodiments of the present invention are to provide a security system that can be satisfactorily both without privacy bias and security.

According to embodiments of the present invention, an image providing method includes: acquiring a first image of a monitoring area from a camera; Obtaining sensed data from a device located at a periphery from the communication unit; Identifying an object appearing in the first image by using the result of analyzing the first image and the sensed data; And deactivating a transmission function of the communication unit based on the identification information of the object.

The image providing method according to embodiments of the present invention may further include editing an appearance area of the first object based on the identification information of the object.

The identifying of the object may include obtaining an object area included in the corresponding area by analyzing a specific area of the first image, analyzing feature values of the first object included in the object area, and identifying identification information of the first object. It may be characterized by the decision point.

The identifying of the object may further include inferring movement information of the appearance object by combining the sensing data, and identifying the object based on the first image and the movement information of the appearance object. can do.

The identifying of the object may further include recognizing the biometric information by analyzing the first image, and may identify the object based on the biometric information and the movement information.

The identifying of the object may include pairing the biometric information and the movement information when a plurality of objects are recognized or detected from the first image, and identifying each object based on the paired biometric information and the movement information. It can be characterized.

An image processing apparatus according to embodiments of the present invention may include an image analyzer configured to acquire and analyze a first image of a monitoring area from a camera; A peripheral information analyzer configured to acquire sensing data from a device located around the communication unit and to analyze the sensing data; An object identification unit for identifying an object appearing in the first image by using the result of analyzing the first image and the sensed data; And an image processor to deactivate a transmission function of the communication unit based on the identification information of the object.

The image processor may be configured to edit an appearance area of the first object based on the identification information of the object.

The object identification unit analyzes a specific area of the first image to obtain an object area included in the corresponding area, and determines characteristic information of the first object by analyzing feature values of the first object included in the object area. It may be characterized by.

The object identifying unit may combine the sensing data to infer movement information of an appearance object and identify an object based on the first image and movement information of the appearance object.

The object identification unit may recognize the biometric information by analyzing the first image, and identify the object based on the biometric information and the movement information.

When the plurality of objects are recognized or detected from the first image, the object identification unit pairs the biometric information and the movement information and identifies each object based on the paired biometric information and the movement information. Can be.

It may be stored in a medium for executing any one of the image processing method according to an embodiment of the present invention using a computer.

In addition, there is further provided a computer readable recording medium for recording another method for implementing the present invention, another system, and a computer program for executing the method.

Other aspects, features, and advantages other than those described above will become apparent from the following drawings, claims, and detailed description of the invention.

An image processing apparatus, an image processing method, and a computer program according to embodiments of the present disclosure may identify an object included in an image based on sensing data received from a peripheral device and an image received from a camera.

In addition, the image processing apparatus, the image processing method, and the computer program according to the embodiments of the present invention may process an image in which the registration object appears according to a setting set by the registration object.

1 is a view schematically showing a security system according to an embodiment of the present invention.
2 is a block diagram schematically illustrating a configuration of an image processing apparatus according to an embodiment of the present invention.
3 to 5 are flowcharts of an image processing method according to embodiments of the present invention.
6A and 6B illustrate embodiments in which an effect is added to an appearance area of an object.
7A and 7B are diagrams for describing a face recognition function provided by an image processing apparatus.
8 is a diagram for describing a region setting function provided by an image processing apparatus.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. In the following description of the present invention, if it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

In the following embodiments, terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from another.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the following examples, terms such as "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more It is to be understood that it does not exclude in advance the possibility of the presence or addition of other features or numbers, steps, operations, components, components or combinations thereof.

Embodiments of the present invention can be represented by functional block configurations and various processing steps. Such functional blocks may be implemented in various numbers of hardware or / and software configurations that perform particular functions. For example, embodiments of the invention may be implemented directly, such as memory, processing, logic, look-up table, etc., capable of executing various functions by the control of one or more microprocessors or other control devices. Circuit configurations can be employed. Similar to the components of an embodiment of the present invention may be implemented in software programming or software elements, embodiments of the present invention include various algorithms implemented in combinations of data structures, processes, routines or other programming constructs. It may be implemented in a programming or scripting language such as C, C ++, Java, assembler, or the like. Functional aspects may be implemented in algorithms running on one or more processors. In addition, embodiments of the present invention may employ the prior art for electronic configuration, signal processing, and / or data processing. Terms such as mechanism, element, means, configuration can be used broadly and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in conjunction with a processor or the like.

1 is a view schematically showing a security system according to an embodiment of the present invention.

Referring to FIG. 1, the security system 1 may include a camera group 10, a device group 30, a terminal group 50, and an image processing apparatus 70. One or more components of the camera group 10, the device group 30, the terminal group 50, and the image processing apparatus 70 of the security system may be provided in one device and electrically connected to each other. For example, the camera group 10 and the image processing device 70 may be provided as one device or in separate devices connected through a communication network. In addition, the image processing apparatus 70 and the device group 30 may be provided as one device or in separate devices connected to a communication network. The camera group 10, the device group 30, and the image processing apparatus 70 may be provided as one device or in separate devices connected through a communication network.

The camera group 10 may include at least one camera CAM1 to CAMn. The at least one camera CAM1 to CAMn may be a PTZ camera which is disposed at a fixed position at a specific place and has a pan / tilt / zoom function. The at least one camera CAM1 to CAMn may acquire various images while panning and / or tilting rotation by the driving device, or adjusting the zoom magnification by zooming in or zooming out the zoom lens. At least one camera (CAM1 to CAMn) is installed in the office, house, hospital, as well as the inside of the bank or public buildings requiring security, or outdoors such as parks. It may have a form.

At least one camera CAM1 to CAMn may detect an object while monitoring an area allocated to it. At least one camera CAM1 to CAMn may be given an ID as unique identification information. The at least one camera CAM1 to CAMn may output an image obtained by photographing a predetermined region to at least one terminal UE1 to UEn of the image processing apparatus 70 and / or the terminal group 50.

The device group 30 may include at least one device DE1 to DEn. At least one device DE1 to DEn may be a plurality of heterogeneous sensors that acquire different sense data. The at least one device DE1 to DEn may include an audio sensor, a motion sensor, a fingerprint sensor, an iris sensor, and the like. The at least one device DE1 to DEn may be installed in pairs with the at least one camera CAM1 to CAMn. However, when at least one camera CAM1 to CAMn has a motion recognition and tracking function, at least one device DE1 to DEn may be installed independently.

The terminal group 50 may include at least one user terminal UE1 to UEn. At least one user terminal UE1 to UEn may be assigned an ID as unique identification information. The ID may be mapped to biometric information that authenticates an individual such as a face, voice, fingerprint, iris, or the like. The at least one user terminal UE1 to UEn may receive an input from each user, transmit the input to the image processing apparatus 70, and display data received from the image processing apparatus 70 on the screen.

The at least one user terminal UE1-UEn can be a laptop terminal, a handheld device, a smartphone, a mobile terminal such as a tab, a desktop computer, or any suitable device using or directly or indirectly connected to such a device. .

The image processing apparatus 70 may receive the image and the sensing data input to the camera group 10 and / or the device DE1 to DEn group 30. The image processing apparatus 70 may perform a privacy function according to embodiments of the present invention. The image processing apparatus 70 may analyze the received image and the sensed data and perform blind processing on part or all of the image. The image processing apparatus 70 may analyze the received image and the sensed data and determine a method of processing the image. The image processing apparatus 70 may store the received original image and / or blind image. The image processing apparatus 70 may prevent the original image from being provided to the at least one user terminal UE1 through UEn according to the security level set for the user. The image processing apparatus 70 may analyze the received image and / or sensing data and detect an event. The image processing apparatus 70 may provide an alarm to at least one terminal UE1 to UEn when an event is detected.

The image processing apparatus 70 receives at least one of a phone number, a terminal unique ID, ID / password, biometric information, and a pattern from at least one user terminal UE1 through UEn, and stores the previously stored ID / password, biometric information, and pattern. User can be authenticated as compared to

The image processing apparatus 70 may receive biometric information input from at least one camera CAM1 to CAMn and / or at least one device DE1 to DEn, and identify a user.

In one embodiment, the image processing apparatus 70 may be implemented as a microchip embedded in at least one camera CAM1 to CAMn, or a circuit board including the microchip.

In another embodiment, the image processing apparatus 70 may be configured to communicate with at least one camera CAM1 through CAMn, at least one device DE1 through DEn, and at least one user terminal UE1 through UEn in a communication network, for example, Can be connected via LAN, TCP / IP. Communication networks include wired networks and wireless Internet such as 3G, 4G (LTE), 5G, Wi-Fi, Wibro, Wimax, Bluetooth, Radio Frequency Identification (RFID), Infrared Communication (IrDA) and a wireless network including near field communication such as an infrared data association (UWB), ultra wideband (UWB), ZigBee, and the like. The image processing device 70 may be a wireless access device, a relay device such as a gateway, a digital video recorder (DVR), or a network video recorder (NVR) that supports a Wi-Fi communication method and / or an LTE communication method. a recording device such as a network video recorder) or a cloud computing device providing a storage function on the Internet.

At least some of the components constituting the image processing apparatus 70 may be implemented by software or circuits including at least one or more of an operating system, an application module, and other program modules.

2 is a block diagram schematically illustrating a configuration of an image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 2, the image processing apparatus 70 may include a communication unit 701, an image analyzer 702, a peripheral information analyzer 703, an object identifier 704, a storage unit 705, and an image processor 706. ), And a data manager 707.

The communication unit 701 may be a device including hardware and software necessary for transmitting and receiving a signal such as a control signal or a data signal through a wired or wireless connection with an external device, but the scope of the present invention is not limited thereto. The communication unit 701 may include a first communication module that transmits and receives data to and from the camera group 10 and the device groups DE1 to DEn 30, and a second communication module that transmits and receives data to and from the terminal group 50. .

The first communication module may receive an image from the camera group 10 and receive sensing data from the device group 30. The sensing data may include power related information of the device, operation of the device, and state information. The first communication module may transmit a camera control signal including a PTZ value from the camera module 10.

The second communication module may receive user authentication information from at least one user terminal UE1 to UEn and transmit a real time image or a stored image in response to an image request signal from an authenticated user. The second communication module may provide a privacy function setting menu and receive setting data in response to a function execution request from at least one user terminal UE1 to UEn. The second communication module may prevent the image from leaking to the outside. That is, even if the image request signal is received, the second communication module is controlled such that the image is not transmitted to the outside while the registration object appears in the image. Even when the image request signal is received, the second communication module may be deactivated while the registration object appears in the image. Alternatively, the second communication module may determine whether to transmit the image based on the transmission flag set in the image without being deactivated.

The image analyzer 702 may analyze the image acquired through the camera and recognize biometric information included in the image. The image analyzer 702 may identify the appearance object of the image by using the recognized biometric information. The biometric information may include at least one of face, voice, support, and iris. The registered object refers to an object registered in various ways, and may be a person who has a predetermined authority such as an owner, a responsible person, or an administrator with respect to the monitoring area. In addition, the registered object may be a user who owns and uses the terminal of the terminal group 50. When the biometric information is detected in a part of the captured image, the image analyzer 702 may adjust the biometric information to a resolution capable of recognizing, identifying, and detecting the biometric information. When the image analyzer 702 detects a part of the body such as a fingerprint or an iris, the image analyzer 702 may adjust a photographing area, a resolution, a magnification, and the like to detect biometric information. When the biometric information is detected in a part of the captured image, the image analyzer 702 may detect the biometric information of the user through the captured image by recognizing, identifying, and adjusting the captured region, resolution, and magnification. have. The image analyzer 702 may identify an object appearing in the image and determine whether to photograph the image, whether to transmit the captured image externally, whether to store the captured image, whether to process a mosaic of the captured image, and the like. In this case, the security level or the access authority of the object appearing in the image may be considered. That is, in consideration of the security level or the access authority of the object, it is possible to determine whether to take the picture, whether to transmit the picture outside, whether to save the picture, whether to process the mosaic of the picture.

The image analyzer 702 may analyze the image acquired by the camera to recognize the movement information, and identify the object by comparing the recognized movement information with the existing movement information. For example, when the movement path of the first user is set in the order of the toilet, the kitchen and the main room, it may be determined that the object moving in the order of the toilet, the kitchen and the main room is the same as the first user. The image analyzer 702 may identify the object through the moving path of the object included in the image. The image analyzer 702 may identify the registered object and the unregistered object through the moving path of the object included in the image. The movement information may include movement of the object and change of position. The movement information may include a point (eg, a front door, a kitchen, a bathroom, etc.) corresponding to the location of the object. In this case, the image analyzer 702 may further consider not only the movement information but also the information on the impression of the user. For example, when a plurality of objects moving in the order of toilets, kitchens, and homes are set, a plurality of objects, such as height, body size, and body shape, which are impression information of each object, may be additionally registered to identify each object.

The image analyzer 702 may analyze the image and generate an event when the event occurrence condition is satisfied. Here, the event refers to the appearance of an unregistered object, the appearance of a face that cannot be recognized by a face, an unregistered voice, an abnormal sound source (for example, a glass cracking sound, an alarm sound, a collision sound, a shout, a scream, a cry, etc.), a threshold value. It may include an event set by a user, such as voice generation.

The image analyzer 702 may generate metadata representing the analysis result of the image data and process the metadata together with the image data. The image analyzer 702 may additionally store metadata for processing image data. For example, the image photographing the first object may not be transmitted or shared to an unapproved object registered by the first object. Among the images photographing the first object, an image that satisfies a specific condition (a shower scene, a sleeping scene, etc.) may not be stored or may be mosaiced so that an area including the first object is not represented. The metadata may include text based metadata or image based metadata. The metadata may include image information and event information. The image information may include image acquisition time and object information detected in the image. The event information may include an event type, an event occurrence area, an event occurrence time, and the like. The embodiments of the present invention convert the event information into metadata and process the data to be stored together with the video data. If the video that should not be shared for privacy needs to be disclosed for security reasons, the original video is stored as it is. Can be shared with other objects. At this time, by encrypting with identification information of the appearance object, it is possible to process only the appearance object to decrypt the image. The peripheral information analyzer 703 analyzes the sensed data received from a device that is adjacent to the peripheral, has a communication function, and functions as an electronic product. The peripheral information analyzer 703 detects the appearance of the object and the detected object when the image capturing is impossible or when the image capturing is restricted. Etc.) can be obtained. If there is no illumination and an object is not identifiably photographed, the peripheral information analyzer 703 detects the received information from one or more devices without a photographed image in the case of a user's artificial reorientation of the photographing device or removal of power of the photographing device. You can use the data to identify the object. The sense data may include a time when the device is powered on, current status information of the device, and a time when the device is powered down. The peripheral information analyzer 703 may infer the movement information of the object by listing and combining the sensing data received from the at least one device in chronological order. For example, if the first device is powered on at the first time and the second device is detected to be powered on at the second time, the position of the appearance object moves from the vicinity of the first device to the neighborhood of the second device. It becomes one. The movement information of the appearance object may be moved from a first point corresponding to the first device to a second point corresponding to the second device. The movement information of the appearance object may be patterned and used for identification of the object. An object's behavior or movement can be identified using the object's movement information on the basis of being formalized for each object.

The object identifier 704 may identify an object included in the image based on the information obtained through the image analyzer 702 and the surrounding information analyzer 703. The object identifier 704 may identify the object based on the biometric information and the movement information. The object identifier 704 may identify the object through comparison with previously stored biometric information or previously stored movement information.

The object identifying unit 704 may extract feature values included in the object appearance area of the image, and identify an object that appears based on the feature values.

When a plurality of objects are recognized or detected, the object identifier 704 may pair the obtained biometric information and the movement information, and identify each object through the paired biometric information and the movement information.

The storage unit 705 may store the acquired image. In this case, the storage unit 705 may encrypt the obtained image by using information related to the appearance object. The storage unit 705 may store the image as it is when the unregistered object is included in the image. When the registration object is included in the image, the storage unit 705 may store the image, and edit and store a separate image.

The image processor 706 may process an image according to an object appearing in the image. The image processor 706 may search for the security level of each object based on the identification information of the object appearing in the image, and process the image photographing the object in consideration of the security level of the object. The security level of the object may be determined by whether the object is registered in relation to the monitoring area. For example, for 'our house', my family, mom, dad, and children, can be set to a high security level as a registered object. Unregistered objects can be set to the lowest security level, such as 0 or -1. In addition, even in the registered object, the security level of each object may be set differently according to the role in the monitoring area. For example, for the 'company', the security level may be set lower in the order of positions within the company, that is, in the order of the president, the managing director, the manager, the deputy manager, and the manager. The image of the object may be processed differently according to the security level of the object.

An image in which an object whose security level is set to '5' appears may be processed so as not to be shared with an object having a security level lower than '5'. An image in which an object whose security level is set to the highest value appears may be shared only with a manager terminal registered in association with the object. Optionally, when it is determined that an event such as a dangerous situation occurs, regardless of the security level of the appearance object, the image processing unit 706 may process all the object images to be shared with the registered object.

In another embodiment, the image processor 706 may process an image to be transmitted according to a signal received in real time.

In addition to the security level of the object, the image processor 706 determines whether the captured image satisfies the inactive condition based on the image and the sensed data, and when the inactive condition is satisfied, it is difficult to identify a partial region of the image, The function of some components such as the communication unit can be deactivated. In this case, the inactive condition may be set to a space, an action, a time interval, etc., other than the security level of the object. For example, an area corresponding to the 'bed of bed' may be registered as inactive during sleep time, and an area corresponding to the 'bed of the bed' may be difficult to identify some areas during sleep time, The transmission to the network may be deactivated.

The image processor 706 determines whether the appearance object satisfies the inactive condition based on the security level of the object, the object appearing in the image, and identifies a partial region of the image when the appearance object satisfies the inactive condition. Difficult to process and deliver images. The image processor 706 may control the transmission of the image to be blocked or inactivated according to the appearance of the registration object. Even if the transmission is blocked, the captured image may be stored in the storage unit. Afterwards, the original video can be publicly shared and shared with specific approval.

When the appearance of the registered object is detected or satisfies an inactive condition, or when the security level of the object is greater than or equal to a preset threshold level, the image processor 706 may mask a visual effect (graphic interface, etc.) on the first appearance area included in the image. Can be. Masking adds an effect over the image, where other values may be masked to corresponding pixel values. When the appearance of a registered object is detected or satisfies an inactive condition, or when the security level of the object is equal to or greater than a preset threshold level, the image processing unit 706 may not transmit an image in response to a request from the terminal. An image may be transmitted in response to a request from a terminal having a higher security level. If the appearance of the registered object is detected or satisfies an inactive condition, or the security level of the object is greater than or equal to a preset threshold level, the image processor 706 may not store the image itself. The captured image may be processed according to an instruction previously input by the registration object.

When there are a plurality of objects appearing in the image, the image processor 706 may process the appearance area of each object differently. For example, while objects with different security levels are detected, or both the presence of a registered object and an unregistered object are detected, the image processor 706 may perform a second operation on a registered object (an object whose security level is higher than a threshold level) included in the image. Detecting an appearance area, masking a visual effect on the second appearance area, or detecting a third appearance area of an unregistered object (an object having a security level lower than a threshold level), except for the third appearance area. You can mask visual effects on the area.

When an appearance of a registered object is detected or an inactive condition is detected, or while an appearance of an object having a security level of more than a critical level is detected, the image processor 706 may register a registered object (an object having a security level higher than the critical level) included in the image. It is a principle to include a visual effect in the appearance area of, but when an event such as a dangerous situation that requires exceptional shooting is detected, the original image from which the visual effect is removed may be stored as it is.

When an event is detected, the image processor 706 may transmit a risk message to the manager terminal registered for each appearance object in response to the detection of the event. The image may be controlled to be transmitted to the manager terminal for a predetermined time interval from the time when the event is detected.

The image processor 706 may stop shooting according to the determined stop shooting signal. The image processor 706 may stop shooting according to the voice of the object, the behavior of the object, or a specific text input.

The data manager 707 may manage images of past viewpoints. The data manager 707 may transmit the image photographed in the first time interval to the terminal in response to the signal requesting the image. In this case, transmission may be determined according to a security level granted to the terminal. In this case, the transmitted image may be different according to the security level granted to the terminal. When the security level is lower than the security level of the appearance object, an image processed by the image processor 706 may be received so that identification is difficult. If the security level is higher than that of the appearance object, the original image may be received.

The appearance area of the object may vary depending on the posture of the object. The appearance area of the object is different between when the object is standing and when the object is sitting.

In another embodiment, the image processing apparatus may detect and identify the user by detecting features of the user such as motion, gesture, voice, and face. The image processing apparatus may automatically limit the transmission of an image when the corresponding user appears in an area (bedroom, bathroom, etc.) designated by the identified user.

If the user gazes at the camera for a predetermined time in the monitoring area, the image processing apparatus may identify the user through comparison with the stored face. The image processing apparatus may process the image or limit the transmission of the image as set by the identified user.

The image processing apparatus according to the embodiments of the present invention dynamically detects a change in an appearance object, a change in a situation, and the like generated in the monitoring area, and processes a photographed image according to the detected result, thereby requiring low disclosure or sharing. Or infringing an individual's privacy can be prevented from being released. 3 to 5 are flowcharts of an image processing method according to embodiments of the present invention.

Referring to FIG. 3, the image processing method may include obtaining an image and sensing data (S110), analyzing a first image (S120), analyzing a sensing data (S130), and identifying a first object. In operation S140, the method may include processing a first image in operation S150.

In S110, the image processing apparatus obtains a first image of photographing a monitoring area from a camera. The image processing apparatus obtains sensing data from at least one device located in the vicinity.

In operation S120, the image processing apparatus analyzes the first image.

The image processing apparatus may recognize the biometric information by analyzing the image. The image processing apparatus may identify the object appearing in the image by using the recognized biometric information. The image processing apparatus may recognize the moving information by analyzing the image and identify the object by comparing the recognized moving information with the existing moving information. The image processing apparatus analyzes the image to detect events such as the appearance of an unregistered object, the appearance of a face that cannot be recognized, an unregistered voice, a glass cracking sound, an alarm sound, a collision sound, a shout, a scream, a crying sound, or a voice over a threshold An event can be generated when the occurrence condition is satisfied. The image processing apparatus may generate metadata representing the analysis result of the image data.

In operation S130, the image processing apparatus may analyze sensing data received from at least one device that is adjacent to the periphery, has a communication function, and functions as an electronic product. When image capturing is impossible, the image processing apparatus may request and acquire sensing data related to the use of an electronic product in order to identify the appearance of the object and the emerged object when the image capturing is limited. The image processing apparatus may infer movement information of the object by combining the sensing data received from the at least one device.

In operation S140, the image processing apparatus may identify the first object by using the result of analyzing the first image or the sensing data. The image processing apparatus may pair the obtained biometric information and the movement information, and identify each object through the paired biometric information and the movement information. For example, when the movement information of the object corresponding to the obtained first biometric information leads to a bathroom, a kitchen, or a living room, an object corresponding to the movement information is searched for, and whether the retrieved object matches the first biometric information. By calculating, the image processing apparatus may identify the object.

In operation S150, the image processing apparatus may include a visual effect in a predetermined area of the first image or delete the first image by using the identified result.

The image processing apparatus may search for the security level of each object based on the identification information of the object appearing in the image and process the image photographing the object in consideration of the security level of the object. The security level of the object may be determined by whether the object is registered in relation to the monitoring area.

The image processing apparatus may make it difficult to identify a partial region of the image based on a security level of an object appearing in the image and whether an inactive condition occurs in the image. When the appearance of the registered object is detected or satisfies an inactive condition or the security level of the object is equal to or greater than a preset threshold level, the image processing apparatus may mask a visual effect on the first appearance area included in the image.

In addition, the image processing apparatus may determine the storage area of the first image by using the identified result. The image in which the registration object appears may be stored in the storage unit 705 electrically connected.

The image processing apparatus may set a transmission flag of the first image by using the identified result. The image processing apparatus may determine whether to transmit the image based on the transmission flag of the image.

Referring to FIG. 4, the image processing method includes receiving an image request signal from a terminal (S210), determining whether the terminal has access authority (220), and transmitting an image to the terminal (S230). do.

In S210, the image processing apparatus may receive an image request signal from the first terminal. In operation S220, the image processing apparatus determines whether there is an access right granted to the first terminal. If there is an access right granted to the first terminal, the image processing apparatus may transmit the image designated by the image request signal to the first terminal. Access rights may be set absolutely, but may be set relatively according to rules set by the registration object. That is, the registration object may relatively set an access right so that the registered object is limitedly transmitted to the image in which the registered object appears. A terminal of a user having access authority may not receive an image according to an object appearing in the image.

In another embodiment, even when there is no access right granted to the first terminal, the image processing apparatus determines not only the access right granted to the first terminal, but also a match between the first terminal and an object appearing in the image. When it is determined that the matching degree between the first terminal and the appeared object is equal to or greater than the preset matching degree, an image may be provided to the first terminal. The object appearing in the image may be a registered object or an unregistered object. The access right may be determined based on the security level of the object. For example, if the security level of the user is above the threshold level or higher than the security level of the appearance object, it may be determined that the user has access.

The image processing apparatus does not transmit an image in response to the image request signal when an image request signal is received from a terminal without access authority.

Referring to FIG. 5, the image processing method may include receiving an image request signal from a second terminal (S310), determining whether a registration object exists in the image (S320), transferring the image as it is (S321), Determining whether the image has an unregistered object (S330), Processing and transmitting the image according to the access authority of the second terminal (S331), Determining whether the image satisfies an event occurrence condition (S340) The method may include transmitting the image as it is (S341).

In operation S310, the image processing apparatus receives an image request signal from the second terminal. In this case, the image request signal may include designation information about a past photographed image, not an image captured in real time. In operation S320, the image processing apparatus determines whether a registration object is included in an image corresponding to the image request signal. The image processing apparatus may determine whether there is a registered object among the objects appearing in the image by analyzing metadata associated with the corresponding image. In operation S321, if the registration object is not included in the image, the image processing apparatus may transfer the image as it is in response to the image request signal. While the registered object is present, the image processing apparatus may capture a captured image.

In operation S330, the image processing apparatus determines whether an unregistered object is included in the image. The image processing apparatus may determine whether there is an unregistered object among the objects appearing in the image by analyzing metadata associated with the corresponding image. In operation S331, the image processing apparatus may process and transmit an image according to an access right of the terminal. When the image processing apparatus includes both the registered object and the unregistered object, the image processing apparatus may edit the appearance area of the registered object and the appearance area of the unregistered object differently, and process the edited image in the same manner as the processing method of the unregistered object. The appearance area of the unregistered object is edited to be clearly visible, and the appearance area of the registered object can be added, blurred or mosaic other images. The unregistered object may be viewed as an object to be monitored, and when an unregistered object appears, the unregistered object may be processed to enhance the shooting of the monitoring area.

In S340, the image processing apparatus may determine that the image is an event occurrence condition (appearance of an unregistered object, appearance of a face that cannot be recognized by a face, abnormal sound source, glass cracking sound, alarm sound, collision sound, shouting, screaming, crying, etc., voice over a threshold value. Occurrence). The image processing apparatus may determine whether the image satisfies an event occurrence condition by analyzing metadata associated with the corresponding image. If the image satisfies the event occurrence condition, the image processing apparatus may deliver the image as it is even if the image includes a registration object. Images including dangerous situations can be controlled to be delivered as they are.

6A and 6B illustrate embodiments in which an effect is added to an appearance area of an object.

The image processing apparatus according to the embodiment of the present invention may edit the appearance area of the registration object in a manner set by the registration object. In this case, it may be expressed as a preset image 601 so that the appearance area of the registration object is not clearly revealed. The set image 601 may be configured to include basic information about the registration object.

The image processing apparatus may change the shape of the appearance area of the registration object according to the posture of the registration object. The image processing apparatus may be represented by various figures 602 including an appearance area of a registration object.

7A and 7B are diagrams for describing a face recognition function provided by an image processing apparatus.

An image processing apparatus according to an embodiment of the present invention may provide a face recognition function to a terminal group. The registration object may perform a procedure of registering its own face in advance. As shown in FIG. 7A, a function of photographing a registration object through a terminal is provided. The face of the registration object may be obtained through a camera included in the terminal, and may be provided through the preview area 701. An icon for saving (702) or canceling (703) for the captured image is provided.

8 is a diagram for describing a region setting function provided by an image processing apparatus.

The image processing apparatus according to the embodiments of the present invention may set a specific area of the monitoring area as a privacy area. The area set as the privacy area may be implemented to always provide an effect.

The zone setting function is executed only by the registration object, and the registration object may set the first zone 801 and the second zone 802 as privacy zones so that specific operations are not exposed. The image processing apparatus may unambiguously express the first zone 801 and the second zone 802 such as blurring, mosaicing, and adding effects while the registered object is present according to the setting. While the unregistered object or another registered object is present, the image processing apparatus does not perform any processing on the first zone 801 and the second zone 802. Each registration object may register in advance a privacy area in which its appearance is not disclosed. In the privacy area set by the first registration object, the appearance of the first registration object may be processed and expressed in various ways. However, when an event meeting the event occurrence condition is detected, the image processing apparatus may remove the processing for the privacy area set by the registration object in order to enhance the monitoring function.

(Written mainly on the correlation between meta data and image data)

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments are, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable gate arrays (FPGAs). May be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of explanation, one processing device may be described as being used, but one of ordinary skill in the art will appreciate that the processing device includes a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as parallel processors.

The software may include a computer program, code, instructions, or a combination of one or more of the above, and may configure the processing device to operate as desired, or process independently or collectively. You can command the device. Software and / or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device in order to be interpreted by or to provide instructions or data to the processing device. Or may be permanently or temporarily embodied in a signal wave to be transmitted. The software may be distributed over networked computer systems so that they may be stored or executed in a distributed manner. Software and data may be stored on one or more computer readable recording media.

The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the media may be those specially designed and constructed for the purposes of the embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or, even if replaced or substituted by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the claims that follow.

10: camera group 30: device group
50: terminal group 70: image processing apparatus
701: communication unit 702: image analysis unit
703: peripheral information analysis unit 704: object identification unit
705: storage unit 706: image processing unit
707: data management unit

Claims (5)

Acquiring a first image of the monitoring area from the camera;
Acquiring, from the communication unit, sensing data, including whether each device is executed, an execution time, and an executed operation, from one or more devices located around the communication unit; Includes time down;
By using the result of analyzing the first image or the sensing data, the sensing data is listed and combined in chronological order to recognize movement information of an object appearing in the first image.
Identifying the object that has appeared through comparison of the recognized movement information and the existing movement information, and identifying the object as one of registered objects or unregistered objects through movement information of the object included in the first image, wherein the movement information is an object Including a point corresponding to the position of the object, the movement of the object, and the position of the object; And
When the security level of the object is searched based on the identification information of the object and the security level of the object is equal to or greater than a preset threshold level, the object is a registered object, or the first image satisfies an inactive condition, Deactivating a transmission function of the communication unit; including,
Deactivating the
When an event of a dangerous situation is detected while the first image is captured, a risk message is transmitted to a manager terminal registered for each object that appears, and the manager terminal displays an image for a predetermined time interval from when the event is detected. The image providing method of the image processing apparatus further comprising the step of transmitting, to identify the emergent object and process the image differentially according to the object.
The method of claim 1,
After the deactivation step,
Editing the appearance area of the first object to add a visual effect differently from the remaining areas based on the identification information of the object; identifying the appearance object and processing an image differentially according to the object An image providing method of an image processing apparatus.
delete delete A computer program stored in a computer readable storage medium for executing the method of any one of claims 1 to 2 using a computer.

Images