WO2021082006A1

WO2021082006A1 - Monitoring device and control method

Info

Publication number: WO2021082006A1
Application number: PCT/CN2019/115138
Authority: WO
Inventors: 舒邦懿
Original assignee: 华为技术有限公司
Priority date: 2019-11-01
Filing date: 2019-11-01
Publication date: 2021-05-06

Abstract

A monitoring device (110) and a control method. The monitoring device (110) comprises a photographing module (210), a controller (220), and a processor (230), wherein the photographing module (210) is used for obtaining an image to be processed; the controller (220) is used for sending a sample image to the processor (230); and the processor (230) is used for performing image feature comparison on the image to be processed and the sample image so as to obtain a comparison result. Therefore, processing and analysis of the image to be processed can be performed in the monitoring device (110), thereby avoiding the problem of long delay when the image to be processed is transmitted to a background server (120) for processing, and the processing efficiency of the image to be processed can be improved.

Description

Monitoring device and control method

Technical field

This application relates to the field of computer image recognition, and in particular to a monitoring device and a control method.

Background technique

Image recognition technology is one of the classic problems in computer vision. Pedestrian recognition technology can be a technology that recognizes the identity of a specific pedestrian in an image or video sequence by using computer vision technology. For example, a face image is obtained and compared with a face image in an image database, and the identity of the pedestrian corresponding to the face image can be identified through image recognition technology and the behavior trajectory of the pedestrian can be generated. Therefore, recognition technology can be widely used in fields such as smart video surveillance and smart security.

With the continuous development of science and technology and the increasing importance of security monitoring, more and more functions are integrated in the monitoring device. Currently, a camera module deployed in a monitoring device usually captures images and transmits the acquired images to a back-end server for identification and analysis through the network. However, due to the influence of factors such as the transmission environment, the transmission delay of the image is relatively large, resulting in low image processing efficiency. Therefore, how to improve image processing efficiency has become an urgent problem to be solved.

Summary of the invention

The present application provides a monitoring device and a control method, so that after the monitoring device acquires an image, the image processing and analysis can be performed in the monitoring device, so that the processing efficiency of the image can be improved.

In a first aspect, a monitoring device is provided, including a camera module, a controller, and a processor, wherein the camera module is used to obtain images to be processed; the controller is used to send sample images to the processor; The processor is configured to perform image feature comparison between the to-be-processed image and the sample image to obtain a comparison result.

Wherein, the above-mentioned image to be processed may include a target object.

In a possible implementation manner, the above-mentioned target object may refer to a human figure; or, it may refer to the face of a human figure; or, it may also refer to a vehicle (for example, a vehicle that has obvious characteristics and cannot recognize a license plate number); for example, , The appearance of vehicles with obvious recesses, protrusions, or scratches.

Exemplarily, the above-mentioned sample image may be an image in a database; for example, the sample image may be a blacklisted face image obtained through a security system, or the sample image may be an image of a suspicious vehicle obtained, and this application does not do anything about it. limited.

In the embodiment of the present application, the processor deployed in the monitoring device can perform image feature comparison on the acquired image to be processed and the sample image, so as to obtain the comparison result of the image to be processed; it is realized that the image to be processed is completed in the monitoring device During the process of acquiring, processing and analyzing the acquired images to be processed, there is no need to transmit the acquired images to be processed to a server deployed in the background for processing and analysis, thereby avoiding the delay problem introduced by the communication network and improving the processing efficiency of the images to be processed.

In a possible implementation manner, in the case where the foregoing processor is a central processing unit (CPU), the processor and the controller may refer to the same device.

In a possible implementation manner, the foregoing processor may be a neural network processor.

In the embodiment of the present application, a neural network processor can be deployed in the monitoring device, and the acquired image to be processed can be compared with the sample image through the neural network processor. Since the neural network processor includes a computing unit, The calculation time of image feature comparison can be reduced, and the calculation efficiency of image feature comparison can be improved.

In a possible implementation manner, the above-mentioned controller and processor may be deployed in an integrated chip, and the integrated chip may be called a system on a chip (system on a chip, SOC), or a part of the system on a chip.

In another possible implementation manner, the above-mentioned controller and processor may be deployed in two physically independent chips.

For example, the controller can be deployed in the main control chip to execute logic programs; the processor can refer to a neural network processor, and the neural network processor can be deployed in an artificial intelligence (AI) chip to execute images. Processing operation.

With reference to the first aspect, in some implementations of the first aspect, the processor is further configured to send the comparison result to the controller; the controller is configured to control the camera module according to the comparison result Whether the camera module of the dome camera in the monitor tracks and monitors the target object in the image to be processed.

In the embodiment of the present application, the processor can be used to send the comparison result to the controller, so that the controller can be used to determine whether to control the dome camera module in the camera module according to the comparison result to the target object in the image to be processed Continuous tracking is realized, thereby avoiding the problem that real-time monitoring of the target object cannot be achieved when the target object is far away from the monitoring range of the camera module, and improving the safety performance of the monitoring device.

With reference to the first aspect, in some implementation manners of the first aspect, the comparison result is a similarity value between the image to be processed and the sample image.

In the embodiment of the present application, the comparison result of the image to be processed and the sample image may be measured by the similarity value between the image feature of the image to be processed and the image feature of the sample image.

Exemplarily, the similarity value of the image feature can be measured by the cosine distance between the image feature of the image to be processed and the image feature of the sample image.

For example, the similarity value between the image to be processed and the sample image can be determined by the following equation:

Among them, i can represent the i-th image feature; n can represent the number of image features; A can represent the image feature to be processed; B can represent the sample image feature; A _i can represent the i-th image feature in the image to be processed; B _i may represent the i-th sample image features of the image, i.e., image features with sample image corresponding to the a _i.

With reference to the first aspect, in some implementations of the first aspect, the controller is further configured to: when the similarity value is greater than a preset threshold, control the dome camera module in the camera module to Tracking and monitoring the target object in the image to be processed in a rotating manner.

For example, when the similarity value is greater than or equal to the preset threshold, it can indicate that the image to be processed and the sample image include the same target object; for example, when the target object is a portrait or face image, it can indicate the monitored pedestrian It is a pedestrian in the blacklist database.

In the embodiment of the present application, when it is determined that the similarity value between the image to be processed and the sample image is greater than the preset threshold, the dome camera module can be controlled by the controller to continuously track the target object, so as to avoid when the target object is far away from the camera module. The problem that the target object cannot be monitored in the monitoring range of the group, the continuous tracking mechanism of the dome camera module proposed in the embodiment of the present application can obtain more information of the target object, thereby improving the safety performance of the monitoring device.

With reference to the first aspect, in some implementations of the first aspect, the box camera module in the camera module is used to obtain the image to be processed.

In a possible implementation manner, the aforementioned camera module may be a bolt-action camera module, and the bolt-action camera module may be used to obtain images to be processed.

For example, the box camera module can be a wide-angle box camera, and can also be called a wide-angle box camera or box camera.

In a possible implementation manner, the above-mentioned monitoring device may be a monitoring device that cooperates with a gun and a ball, and the camera module may include a bolt camera module and a dome camera module, and the bolt camera module in the camera module may be Used to obtain the image to be processed.

For example, when the target object is within the monitoring range of the box camera module and the distance between the box camera module and the box camera module is close, or the box camera module can clearly monitor the target object, the box camera in the camera module The module can obtain the above-mentioned to-be-processed image.

With reference to the first aspect, in some implementations of the first aspect, the dome camera module in the camera module is used to obtain the image to be processed.

With reference to the first aspect, in some implementations of the first aspect, the image to be processed includes a target object, and the dome camera module is configured to obtain the image to be processed according to the target coordinate information of the target object , Wherein the target coordinate information is obtained by performing coordinate mapping on the coordinate information of the target object in the gun camera module in the camera module.

For example, when the distance between the target object and the box camera module is far, the to-be-processed image acquired by the box camera module cannot meet the recognition requirements. At this time, the controller can obtain the image according to the box camera module in the camera module. The coordinate information of the target object obtains the target coordinate information of the dome camera module of the target object in the camera module; the dome camera module in the camera module can obtain the aforementioned image to be processed according to the target coordinate information.

Specifically, the controller can be used to obtain the coordinate information of the target object in the camera module of the dome camera, and perform coordinate mapping through a preset algorithm to obtain the target coordinate information of the target object in the camera module of the dome camera, and then can control the camera module of the dome camera. The group's magnification or zooming parameters, etc., enable the dome camera module to monitor the target object and obtain the to-be-processed image that meets the recognition requirements.

With reference to the first aspect, in some implementation manners of the first aspect, the target object in the image to be processed is a portrait.

In a second aspect, a control method is provided, the control method is applied to a monitoring device, the monitoring device includes a camera module, a controller, and a processor, and the control method includes:

The monitoring device includes a camera module, a controller, and a processor. The control method includes: the camera module obtains an image to be processed; the controller sends a sample image to the processor; The image feature comparison between the to-be-processed image and the sample image is performed to obtain a comparison result.

Wherein, the above-mentioned image to be processed may include a target object.

In a possible implementation manner, the above-mentioned target object may refer to a human figure; or, it may refer to the face of a human figure; or, it may also refer to a vehicle (for example, a vehicle that has obvious characteristics and cannot recognize a license plate number); for example, , The appearance of vehicles with obvious recesses, protrusions or scratches.

In the embodiment of the present application, the processor can perform image feature comparison on the acquired image to be processed and the sample image to obtain the comparison result of the image to be processed; the acquisition, processing and analysis of the image to be processed can be completed in the monitoring device In the process, there is no need to transmit the acquired image to be processed to a server deployed in the background for processing and analysis, thereby avoiding the delay problem introduced by the communication network and improving the processing efficiency of the image to be processed.

In a possible implementation manner, in the case where the foregoing processor is a CPU, the processor and the controller may refer to the same device.

In a possible implementation manner, the above-mentioned controller and processor may be deployed in an integrated chip, which may also be called a system on a chip (system on a chip, SOC), or a part of the system on a chip.

In a possible implementation manner, the above-mentioned controller and processor may be deployed in two physically independent chips.

For example, the controller can be deployed in the main control chip to execute logic programs; the processor can refer to a neural network processor, and the neural network processor can be deployed in an artificial intelligence chip to perform operations in image processing.

With reference to the second aspect, in some implementations of the second aspect, the control method further includes: the processor sends the comparison result to the controller; and the controller controls the comparison result according to the comparison result. Whether the dome camera module in the camera module tracks and monitors the target object in the image to be processed.

In the embodiment of the present application, the processor may send the comparison result to the controller, so that the controller can determine whether to control the dome camera module in the camera module to continuously track the target object in the image to be processed according to the comparison result. This can avoid the problem that real-time monitoring of the target object cannot be achieved when the target object is far away from the monitoring range of the camera module, and the safety performance of the monitoring device can be improved.

With reference to the second aspect, in some implementations of the second aspect, the comparison result is a similarity value between the image to be processed and the sample image.

With reference to the second aspect, in some implementations of the second aspect, the controller controls whether the dome camera module in the camera module tracks and monitors the target object in the image to be processed according to the comparison result , Including: when the similarity value is greater than a preset threshold, the controller controls the dome camera module in the camera module to track and monitor the target object in the image to be processed in a rotating manner.

In the embodiment of the present application, when the controller determines that the similarity value between the image to be processed and the sample image is greater than the preset threshold, the dome camera module can be controlled by the controller to continuously track the target object to avoid when the target object is far away The target object cannot be monitored during the monitoring range of the bullet camera module. The continuous tracking mechanism of the dome camera module proposed in the embodiment of the present application can obtain more information about the target object, thereby improving the security performance of the monitoring device.

With reference to the second aspect, in some implementation manners of the second aspect, the acquiring the image to be processed by the camera module includes: acquiring the image to be processed by the box camera module in the camera module.

For example, when the object to be photographed is within the monitoring range of the box camera module and the distance between the box camera module and the box camera module is close, or the box camera module can clearly monitor the object to be photographed, the gun in the camera module The camera module can obtain the above-mentioned to-be-processed image.

With reference to the second aspect, in some implementations of the second aspect, the dome camera module in the camera module is used to obtain the image to be processed.

With reference to the second aspect, in some implementations of the second aspect, the image to be processed includes a target object, and the dome camera module is configured to obtain the image to be processed according to the target coordinate information of the target object , Wherein the target coordinate information is obtained by performing coordinate mapping on the coordinate information of the target object in the gun camera module in the camera module.

With reference to the second aspect, in some implementation manners of the second aspect, the target object in the image to be processed is a portrait.

In a third aspect, a computer program product is provided. The computer program product includes: computer program code, which when the computer program code runs on a computer, causes the computer to execute the control method in the second aspect.

It should be noted that the above-mentioned computer program code may be stored in whole or in part on a first storage medium, where the first storage medium may be packaged with the processor, or may be packaged separately with the processor. This embodiment of the present application does not deal with this. Specific restrictions.

In a fourth aspect, a computer-readable medium is provided, the computer-readable medium stores a program code, and when the computer program code runs on a computer, the computer executes the control method in the second aspect.

Description of the drawings

FIG. 1 is a schematic diagram of an image shooting system provided by an embodiment of the present application;

Figure 2 is a schematic structural diagram of a monitoring device provided by an embodiment of the present application;

Fig. 3 is a schematic diagram of a monitoring device for gun-and-ball cooperation provided by an embodiment of the present application;

FIG. 4 is a schematic structural diagram of an integrated chip provided by an embodiment of the present application;

Fig. 5 is a schematic structural diagram of a neural network processor provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a processor provided by an embodiment of the present application;

FIG. 7 is a schematic flowchart of a control method provided by an embodiment of the present application;

FIG. 8 is a schematic flowchart of another control method provided by an embodiment of the present application;

Fig. 9 is a schematic flowchart of another control method provided by an embodiment of the present application.

Detailed ways

The following describes the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

Fig. 1 is a schematic diagram of an image capturing system provided by an embodiment of the present application.

As shown in FIG. 1, the image capturing system 100 may include a monitoring device 110 and a server 120, where the monitoring device 110 is used to obtain a monitoring image (for example, a face image), and the server is used to receive the monitoring image sent by the monitoring device 110, And compare the image features according to the monitored images and the sample images in the database (for example, the blacklisted face image library) to obtain the comparison result.

At present, in the image shooting system, it is necessary to transmit the surveillance image acquired by the surveillance device to a server deployed on the back-end through a communication network, and the server performs further processing and analysis on the surveillance image. However, the communication network is usually susceptible to factors such as the environment, which results in a large transmission delay of the surveillance image, which results in a lower efficiency of the overall image capture system in processing the surveillance image.

In view of this, the embodiment of the present application proposes a monitoring device and a control method. The processor deployed in the monitoring device can perform image feature comparison on the acquired image to be processed and the sample image, so as to obtain the comparison result of the image to be processed. The process of acquiring, processing and analyzing the image to be processed in the monitoring device is realized, without the need to transmit the acquired image to be processed to a server deployed in the background for processing and analysis, thereby avoiding the delay problem introduced by the communication network. Improve the processing efficiency of the image to be processed.

Application scenario 1: Intelligent tracing system

In an embodiment, the monitoring device provided in the embodiment of the present application can be applied to a scene of an intelligent tracing system.

For example, send a pedestrian photo (for example, a photo of a missing child) to the monitoring device of the embodiment of the present application, and the monitoring image acquired in real time within the monitoring range of the monitoring device is matched with the child's photo to realize the image matching in the monitoring range. The location information of the missing child can be quickly determined within.

Application Scenario 2: Safe City

In an embodiment, the monitoring device provided in the embodiment of the present application can be applied to a safe city scene.

For example, a pedestrian photo (for example, a blacklisted face photo) is sent to the monitoring device of the embodiment of the present application, and the monitoring image acquired in real time within the monitoring range of the monitoring device is matched with the blacklisted face photo, thereby The location information of suspicious persons can be quickly determined within the monitoring range.

For example, a vehicle photo (for example, the vehicle has obvious characteristics and the license plate number cannot be recognized) is sent to the monitoring device of the embodiment of the present application; for example, a vehicle with obvious concave parts, convex parts or scratches in appearance. The real-time monitoring image acquired by the monitoring device in the monitoring range is matched with the vehicle photo, so as to quickly determine the location information of the suspicious vehicle in the monitoring range.

The monitoring device of the embodiment of the present application will be described in detail below with reference to FIG. 2 to FIG. 5.

Figure 2 is a schematic structural diagram of a monitoring device provided by an embodiment of the present application. As shown in FIG. 2, the monitoring device 200 can include a camera module 210, a controller 220, and a processor 230. The camera module 210 can be used to obtain images to be processed; the controller 220 can be used to send images to the processor 230. Sample image; the processor 230 is used to perform image feature comparison between the image to be processed and the sample image to obtain a comparison result.

For example, the monitoring device can be deployed at subway entrances, buildings, or road intersections, etc. The monitoring device can shoot real-time road images near the monitoring device, and the road images can include pedestrian images or vehicle images.

Wherein, the aforementioned camera module 210 may refer to a camera used to obtain images to be processed in the monitoring device 200, and the images to be processed may include a target object, where the target object may refer to a portrait, or the target object may refer to a portrait of a portrait. The face, or the target object, can also refer to a vehicle (for example, a vehicle that has obvious characteristics and cannot recognize a license plate number).

In this application, the processor may be a general-purpose processor, such as a central processing unit (CPU), or a dedicated processor, such as a graphics processing unit (GPU), or a neural network processor (neural-processing unit, GPU). network processing unit, NPU).

In an example, in the case where the foregoing processor is a CPU, the processor and the controller may refer to the same device.

In a possible implementation manner, the monitoring device 200 may be a bolt-action monitoring device, that is, the camera module 210 may refer to a bolt-action camera module; wherein, the bolt-action camera module may be used to monitor a global picture of a road.

Optionally, when the camera module 210 in the monitoring device 200 is a box camera module, the image to be processed may be the image to be processed obtained by the box camera module.

In another possible implementation manner, the monitoring device 200 may be a monitoring device that cooperates with a bullet camera module and a dome camera module, and may be called a monitoring device with a bullet camera cooperation, that is, the camera module 210 may include a bullet camera. Camera module and dome camera module.

For example, FIG. 3 is a schematic diagram of a monitoring device for gun-and-ball cooperation provided by an embodiment of the present application. As shown in FIG. 3, the monitoring device 300 may include a box camera module 310, a dome camera module 320, and an integrated chip 330. The dome camera module 320 may refer to a dome camera, or it may be called a long camera. Focus ball machine or ball machine; the integrated chip 330 may include the controller 220 and the processor 230 shown in FIG. 2.

It should be understood that in the monitoring device with gun-ball cooperation, the controller 220 may be used to control the gun-camera module and the ball-camera module to monitor. For example, the controller 220 may be used to detect the first coordinate information of the object to be photographed in the box camera module, and map the first coordinate information to obtain the second coordinate information of the object to be photographed in the dome camera module. Thus, the camera module of the dome camera is controlled to monitor the object to be photographed.

For example, when the target pedestrian A monitored by the bolt-action camera module is far away from the monitoring range of the bolt-action camera module, the bolt-action camera module may not be able to obtain the monitored image of pedestrian A. In this case, the controller 220 may Pedestrian A’s coordinate position information in the camera module of the dome camera obtains the coordinate information of pedestrian A in the camera module of the dome camera, thereby adjusting the zoom parameters of the dome camera module and controlling the monitoring distance of the dome camera module. Group of pedestrians A farther away.

Optionally, when the camera module 210 includes a box camera module and a dome camera module, the image to be processed may be an image obtained by the box camera module, or the image to be processed may also be a dome camera module The captured image.

Situation One

Exemplarily, the box camera module in the camera module is used to obtain the above-mentioned image to be processed.

For example, when the object to be photographed is within the monitoring range of the box camera module and the distance between the box camera module and the box camera module is close, or the box camera module can clearly monitor the object to be photographed, the gun in the camera module The camera module can be used to obtain images to be processed.

Situation two

Exemplarily, the dome camera module in the camera module is used to obtain the above-mentioned image to be processed.

For example, the target object can be included in the image to be processed, and the dome camera module in the camera module can be used to obtain the image to be processed according to the target coordinate information of the target object. The coordinate information of the target object in the gun camera module is obtained by coordinate mapping.

For example, when the distance between the target object and the camera module of the box camera is far, the image of the target object acquired by the camera module of the box camera may have the problem of small pixels that cannot meet the recognition requirements; at this time, the controller can obtain The coordinate information of the target object in the camera module of the dome camera can be mapped through the preset algorithm to obtain the target coordinate information of the target object in the camera module of the dome camera, and then the magnification or zoom parameters of the camera module of the dome camera can be controlled. , So that the camera module of the dome camera can monitor the target object and obtain the to-be-processed image that meets the recognition requirements.

In the embodiment of the present application, the image to be processed can be obtained through the box camera module or the dome camera module in the camera module, and the image to be processed is sent to the processor; the processor can be used to connect the image to be processed with The sample image is compared with image features to obtain the comparison result. Through the monitoring device provided by the embodiments of the present application, the process of acquiring, processing, and analyzing the image to be processed is completed in the monitoring device, without the need to transmit the acquired image to be processed to a server deployed in the background for processing and analysis, thereby The time delay introduced by the communication network is avoided, and the processing efficiency of the image to be processed is improved.

Optionally, in the embodiment of the present application, a neural network may be used to perform image feature extraction and image feature comparison between the image to be processed and the sample image to obtain a comparison result.

Further, in the embodiment of the present application, the processor 230 may be further configured to send 220 the comparison result of the image feature comparison between the image to be processed and the sample image to the controller; the controller 220 may be configured to control the camera module according to the comparison result. Whether the dome camera module in the group 210 tracks and monitors the target object in the image to be processed.

Normally, the target object is dynamically moving, therefore, the target object needs to be tracked and monitored. The so-called tracking monitoring means that the dome camera module continuously monitors the target object in the image to be processed for a period of time. Specifically, the dome camera module continuously monitors the target object in the image to be processed. The camera module can track and monitor the target object in a rotating manner until the dome camera module rotates to the maximum angle and cannot rotate further for monitoring. Therefore, the dome camera module tracks the monitoring time, that is, the above period of time. It is related to the angle that the dome camera module can rotate.

Exemplarily, the aforementioned comparison result may be the similarity value between the image to be processed and the sample image.

For example, the processor 230 may refer to a neural network processor. The neural network processor may obtain images to be processed (for example, pedestrian images) and sample patterns (for example, blacklisted face image data); Feature extraction obtains the image features of the image to be processed and the image features of the sample image; according to the image features of the image to be processed and the image features of the sample image, the similarity value of the image features is determined.

In one example, the similarity value of the image feature can be measured by the cosine distance between the image feature of the image to be processed and the image feature of the sample image.

In the embodiment of the present application, when the similarity value is less than the preset threshold, it means that the image to be processed and the sample image include different target objects; for example, when the target object is a portrait or a face image, it can indicate The monitored pedestrian is not a pedestrian in the blacklist database. When the similarity value is greater than or equal to the preset threshold, it means that the image to be processed and the sample image include the same target object; for example, when the target object is a portrait or face image, it can indicate that the monitored pedestrian is a blacklist Pedestrians in the library.

Optionally, in the embodiment of the present application, when the similarity value is greater than a preset threshold, the controller 220 may control the dome camera module in the camera module to track and monitor the target object in the image to be processed in a rotating manner. .

In the embodiment of the present application, when it is determined that the similarity value between the image to be processed and the sample image is greater than the preset threshold, the dome camera module can be controlled by the controller to continuously track the target object, so as to avoid when the target object is far away from the gun. The problem that the camera module cannot monitor the target object during the monitoring range of the camera module. Through the continuous tracking mechanism of the dome camera module proposed in the embodiment of this application, more information about the target object can be obtained, thereby improving the security performance of the monitoring device and improving the efficiency of solving crimes. .

In an example, the aforementioned controller 220 and processor 230 may be deployed in an integrated chip. For example, FIG. 4 is a schematic structural diagram of an integrated chip provided by an embodiment of the present application. As shown in FIG. 4, the integrated chip 400 may include a controller 410 and a processor 420, where the controller 410 may be used to execute logic programs in the monitoring device 200; the processor 420 may be used to execute operations in image processing . It should be noted that the integrated chip 400 may be the integrated chip 330 as shown in FIG. 3.

The integrated chip shown in FIG. 4 may be called a system on a chip (system on a chip, SOC), or a part of a system on a chip.

In another example, the controller 220 and the processor 230 may also be deployed in two physically independent chips, which is not limited in this application.

For example, the controller 220 may be deployed in a main control chip to execute logic programs; the processor 230 may refer to a neural network processor, and the neural network processor may be deployed in an artificial intelligence (AI) chip for Perform calculations in image processing; among them, the main control chip and the AI chip can be two physically independent chips.

In the following, in conjunction with Fig. 5, the processor is an example of a neural network processor. Fig. 5 is a schematic structural diagram of a neural network processor provided by an embodiment of the present application. As shown in Figure 5, the core part of the neural network processor 500 (neural-network processing unit, NPU) is the arithmetic circuit 503, and the controller 504 controls the arithmetic circuit 503 to extract the data in the memory (weight memory or input memory) and perform calculations .

In some implementations, the arithmetic circuit 503 includes multiple processing units (process engines, PE). In some implementations, the arithmetic circuit 503 is a two-dimensional systolic array. The arithmetic circuit 503 may also be a one-dimensional systolic array or other electronic circuit capable of performing mathematical operations such as multiplication and addition. In some implementations, the arithmetic circuit 503 is a general-purpose matrix processor.

For example, suppose there is an input matrix A, a weight matrix B, and an output matrix C. The arithmetic circuit 503 fetches the data corresponding to matrix B from the weight memory 502 and caches it on each PE in the arithmetic circuit 503. The arithmetic circuit 503 fetches the matrix A data and matrix B from the input memory 501 to perform matrix operations, and the partial result or final result of the obtained matrix is stored in an accumulator 508 (accumulator).

The vector calculation unit 507 can perform further processing on the output of the arithmetic circuit 503, such as vector multiplication, vector addition, exponential operation, logarithmic operation, size comparison, and so on. For example, the vector calculation unit 507 can be used for network calculations in the non-convolutional/non-FC layer of the neural network, such as pooling, batch normalization, local response normalization, etc. .

In some implementations, the vector calculation unit 507 can store the processed output vector to the unified memory 506. For example, the vector calculation unit 507 may apply a nonlinear function to the output of the arithmetic circuit 503, such as a vector of accumulated values, to generate the activation value.

In some implementations, the vector calculation unit 507 generates a normalized value, a combined value, or both. In some implementations, the processed output vector can be used as an activated input to the arithmetic circuit 503, for example, for use in a subsequent layer in a neural network.

The unified memory 506 is used to store input data and output data. The weight data directly passes through the storage unit access controller 505 (direct memory access controller, DMAC) to store the input data in the external memory into the input memory 501 and/or unified memory 506, and the weight data in the external memory into the weight memory 502 , And store the data in the unified memory 506 into the external memory.

The bus interface unit 510 (bus interface unit, BIU) is used to implement interaction with the instruction fetch memory 509 through a bus. The instruction fetch buffer 509 (instruction fetch buffer) connected to the controller 504 is used to store instructions used by the controller 504. The controller 504 is used to call the instructions cached in the instruction fetch memory 509 to control the working process of the computing accelerator.

Generally, the unified memory 506, the input memory 501, the weight memory 502, and the instruction fetch memory 509 are all on-chip (On-Chip) memories. The external memory is a memory external to the NPU. The external memory can be a double data rate synchronous dynamic random access memory. Memory (double data rate synchronous dynamic random access memory, DDR SDRAM), high bandwidth memory (HBM) or other readable and writable memory.

It should be understood that since the neural network processor may include the above-mentioned arithmetic circuit 503 or the vector calculation unit 507, when the neural network processor performs matrix operations in image processing, for example, image feature extraction and image feature extraction are performed on the image to be processed and the sample image. The calculation efficiency is higher when comparing features.

In an example, the processor shown in FIG. 6 may be a neural network processor, and the neural network processor and the controller may be respectively deployed in the main control chip and the NPU chip.

As shown in (a) in Figure 6, the NPU chip can include a CPU and a matrix calculation unit, where the CPU can be used to perform processing logic during image feature comparison; the matrix calculation unit can be used to perform matrix operations during image feature comparison ; The main control chip can be used for image management. For example, as shown in Figure 6(b), the main control chip can be used to obtain images in the database, such as blacklisted face images obtained through the security system, or blacklisted vehicle images; the NPU chip can receive the main The database image sent by the control chip and the image to be processed taken by the camera module, the CPU in the NPU chip can be used to control the matrix calculation unit to start performing image comparison; the matrix calculation unit can be used to obtain the image to be processed taken by the camera module Load the image characteristics of the image into the left matrix of the matrix calculation unit, load the blacklist image characteristics into the right matrix of the matrix calculation unit, and obtain the face similarity through the matrix multiplication and addition operation.

It should be noted that FIG. 6 takes the NPU chip including the CPU and the matrix calculation unit as an example for illustration. The NPU may not include the CPU. For example, the NPU chip may be connected to a CPU deployed outside the NPU chip.

In an example, in the case where the NPU chip includes a CPU, the similarity determination may be performed in the NPU chip including the CPU.

For example, the matrix calculation unit in the NPU chip can be used to perform matrix operations on the image features of the image to be processed and the image features of the blacklist image to obtain the similarity value (for example, the cosine distance) between the image features; the NPU chip includes The CPU can be used to compare the magnitude of the similarity value (for example, the cosine distance) with a preset threshold; when the similarity value is less than the preset threshold, it can indicate that the image to be processed and the blacklist image include different target objects. When the similarity value is greater than or equal to the preset threshold, it can indicate that the image to be processed and the blacklist image include the same target object. When the similarity value is greater than the preset threshold, the NPU chip can send the similarity value to the main control chip, and the main control chip can control the dome camera module in the camera module to track and monitor the image in the image to be processed in a rotating manner. target.

In another example, when the NPU chip does not include a CPU, the similarity determination may also be performed in the main control chip.

For example, the matrix calculation unit in the NPU chip can be used to perform matrix operations on the image features of the image to be processed and the image features of the blacklisted image to obtain the similarity value (for example, cosine distance) between the image features; and the similarity value Send to the main control chip, the main control chip executes the comparison between the similarity value and the preset threshold. The main control chip can control whether the dome camera module in the camera module tracks and monitors the target in the image to be processed according to the similarity value Object. For example, when the similarity value is greater than the preset threshold, the main control chip can control the dome camera module in the camera module to track and monitor the target object in the image to be processed in a rotating manner.

The matrix calculation unit shown in FIG. 6 may be the arithmetic circuit 503 or the vector calculation unit 507 shown in FIG. 5.

It should be understood that the above examples are intended to help those skilled in the art understand the embodiments of the present application, and are not intended to limit the embodiments of the present application to the specific numerical values or specific scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples given, and such modifications or changes also fall within the scope of the embodiments of the present application.

The monitoring device provided by the implementation of the present application is described in detail above in conjunction with Figs. 1 to 6, and the control method provided by the present application will be described in detail below in conjunction with Figs. 7 to 9.

It should be understood that the monitoring device in the embodiment of the present application can execute the following control method of the embodiment of the present application, that is, for the specific working process of the above various monitoring devices, refer to the corresponding process in the following method embodiment.

Fig. 7 is a schematic diagram of a control method provided by an embodiment of the present application. The control method shown in FIG. 7 may be applied to a monitoring device, and the monitoring device may include a camera module, a controller, and a processor.

For example, the control method 600 shown in FIG. 7 may be applied to the monitoring device shown in FIG. 2 or FIG. 3 described above. The control method shown in FIG. 7 includes steps 610 to 630, and these steps are respectively described in detail below.

Step 610: The camera module obtains an image to be processed.

Among them, the monitoring device may be deployed at a subway entrance, a building, or a road intersection, and the image to be processed may be a picture within a monitoring range captured by the monitoring device through a camera module.

For example, the image to be processed may include a target object; where the target object may refer to an object whose recognition result obtained by a recognition algorithm is unstructured data.

For example, the target object may refer to a portrait, or the target object may refer to the face of a portrait, or the target object may also refer to a vehicle; for example, a vehicle that has obvious characteristics and cannot recognize a license plate number.

Exemplarily, the above-mentioned vehicle with obvious characteristics and unable to identify the license plate number may refer to a vehicle with obvious recessed parts, raised parts or scratches in appearance.

Step 620: The controller may send the sample image to the processor.

The sample image may be an image in the database; for example, the sample image may be a blacklisted face image obtained through a security system, or the sample image may be an image of a suspicious vehicle obtained, which is not limited in this application.

In an example, when the monitoring device needs to take images of pedestrians on the road for identification and analysis, the sample image may refer to a blacklisted face image in the database or a sample image of a pedestrian to be identified.

In an example, when the monitoring device needs to take images of vehicles on the road for identification and analysis, the sample images may be vehicle images in a database or sample images of vehicles that need to be identified.

Step 630: The processor may perform image feature comparison between the image to be processed and the sample image to obtain a comparison result.

In the embodiment of the present application, the processor may receive the sample image sent by the controller and the image to be processed taken by the camera module, and compare the features of the image to be processed and the sample image to obtain the comparison result of the image to be processed and the sample image, thereby Identify the target object included in the image to be processed.

In a possible implementation, the aforementioned monitoring device may be a bolt-action monitoring device, that is, the camera module may refer to a bolt-action camera module; the bolt-action camera module may be a wide-angle bolt-action camera, or it may be called a wide-angle gun Machine or box camera.

In the case where the camera module is a box camera module, the image to be processed in step 610 may be an image obtained by the box camera module.

In another possible implementation, as shown in FIG. 3, the above-mentioned monitoring device may be a monitoring device that cooperates with the camera module of the bullet camera and the camera module of the dome camera, and may be called the monitoring device of the cooperation of the bullet camera, namely the camera module. It can include a box camera camera module and a ball camera camera module.

In the case that the camera module includes a box camera module and a dome camera module, the image to be processed in the above step 610 may be an image obtained by the box camera module, or may also be an image obtained by the dome camera module .

Situation One

Exemplarily, when the camera module includes a box camera module and a dome camera module, the box camera module in the camera module obtains the above-mentioned image to be processed.

Situation two

In the embodiment of the present application, the image to be processed can be obtained through the box camera module or the dome camera module in the camera module, and the image to be processed is sent to the processor; the processor can be used to connect the image to be processed with The sample image is compared with image features to obtain the comparison result. Through the control method provided in the embodiments of the present application, the process of acquiring, processing, and analyzing the image to be processed in the monitoring device is realized, without the need to transmit the acquired image to be processed to a server deployed in the background for processing and analysis, thereby The time delay introduced by the communication network is avoided, and the processing efficiency of the image to be processed is improved.

Further, the above control method may further include: the processor may send a comparison result to the controller; the controller may control whether the dome camera module in the camera module tracks and monitors the target object in the image to be processed according to the comparison result.

For example, the aforementioned comparison result may refer to the similarity value between the image to be processed and the sample image.

Specifically, the neural network processor can first obtain images to be processed (for example, pedestrian images) and sample patterns (for example, blacklisted face image data), and then perform image feature extraction on the images to be processed and sample images to obtain Image features and image features of the sample image; according to the image features of the image to be processed and the image features of the sample image, determine the similarity value of the image features.

In one example, the controller may compare the received similarity value with a preset threshold. When the similarity value is less than the preset threshold, it means that the image to be processed and the sample image include different target objects; for example, when the target When the object is a portrait or a face image, it can indicate that the monitored pedestrian is not a pedestrian in the blacklist database. When the similarity value is greater than or equal to the preset threshold, it means that the image to be processed and the sample image include the same target object; for example, when the target object is a portrait or face image, it can indicate that the monitored pedestrian is a blacklist Pedestrians in the library.

Further, when the aforementioned similarity value is greater than a preset threshold, the controller may control the dome camera module in the camera module to track and monitor the target object in the image to be processed in a rotating manner.

In an example, the processor may compare the similarity value with a preset threshold value, and send the comparison result to the controller.

The control method of the monitoring device suitable for gun-and-ball cooperation will be described in detail below in conjunction with FIG. 8 and FIG. 9. For a surveillance device with gun-and-ball cooperation, the image acquired by the camera module can be the image acquired by the box camera module, or the image acquired by the camera module can also be the image acquired by the dome camera module. The different possible situations are explained in detail.

Fig. 8 is a schematic diagram of a control method provided by an embodiment of the present application. This control method can be applied to a monitoring device for gun-and-ball cooperation. The control method 700 shown in FIG. 8 includes steps 701 to 710, and these steps are respectively described in detail below.

It should be noted that the control method shown in FIG. 8 is illustrated by taking the target object in the acquired image to be processed as a portrait. The control method shown in FIG. 8 can also be applied to a to-be-processed image that includes other target objects, where the target object may refer to an object whose recognition result obtained by a recognition algorithm is unstructured data.

Step 701: The controller may send a coordinate system synchronization request to the bolt camera module.

Step 702: The controller may send a coordinate system synchronization request to the bolt camera module.

It should be noted that, through the above steps 701 and 702, it is possible to request the bolt camera module and the dome camera module to realize the synchronization of the coordinate system. The above steps 701 and 702 can be performed at the same time, or step 702 can be performed first. , Step 701 is executed again, and the execution sequence of step 701 and step 702 is not limited in this application.

It should be understood that, in the embodiments of the present application, the box camera module and the dome camera module can be integrated into the body of the all-in-one camera, and can communicate with the controller and the NPU; the above controller and the NPU can be integrated in the same chip Or, the controller and NPU can also be deployed in two physically independent chips.

Step 703: The box camera module may send the coordinate system synchronization success to the controller.

Step 704: The dome camera module may send the coordinate system synchronization success to the controller.

In the same way, the above steps 703 and 704 may be performed at the same time, or step 704 may be performed first, and then step 703 may be performed. The present application does not limit the execution order of step 703 and step 704 in any way.

Step 705: The controller sends sample data to the NPU.

In a possible implementation manner, the aforementioned sample data may refer to sample images.

For example, the sample data may refer to a blacklisted image library; for example, it may be a blacklisted face image, or it may also be a blacklisted vehicle image.

In a possible implementation manner, the above-mentioned sample data may refer to blacklist image features obtained after feature extraction of the sample image through a neural network algorithm.

It should be noted that the sample data sent by the controller to the NPU may be the original blacklist image, or may be image features obtained after feature extraction on the blacklist database, and this application does not make any limitation on this.

Step 706: The box camera module may send an image (for example, an image to be processed) to the NPU.

Wherein, the above-mentioned image may be an image taken by the box camera module within the monitoring range.

Exemplarily, the target object may be included in the image. For example, the target object may be a human face, or the target object may be a vehicle with obvious characteristics and an unrecognizable license plate number.

After the NPU obtains the image sent by the box camera module, the image can be processed in the NPU through the detection network, the tracking network, and the image selection network. Among them, the detection network is used to obtain the coordinates of the portrait in the image; the tracking network is used to mark the portrait in the image; the image selection network is used to evaluate the image quality and determine the image with better image quality.

It should be noted that the aforementioned detection network, tracking network, and image selection network may be different algorithms executed in the NPU.

Exemplarily, the NPU receives multi-frame images sent by the box camera module, and the detection network can detect the coordinates of the portrait in each frame of the multi-frame image; the tracking network can detect the portrait of the same pedestrian in the multi-frame image Marking; the image selection network can evaluate the image quality of multi-frame images and select the optimal frame image, that is, the image that needs to be recognized can be determined from the multi-frame image.

Further, the above-mentioned optimal frame image can be identified, that is, step 707 is executed.

Step 707: The NPU chip performs face comparison to determine the similarity value.

In an example, the sample data sent by the controller to the NPU may be a sample image, and the NPU may perform image feature extraction on the portrait and the sample image in the image (for example, the above-mentioned optimal frame image) to obtain image features and samples of the portrait The image characteristics of the image; according to the image characteristics of the portrait and the image characteristics of the sample image, the similarity value of the image characteristics is determined.

In an example, the sample data sent by the controller to the NPU may be sample image features obtained through a neural network algorithm, and the NPU may use the same neural network algorithm to image the portrait in the image (for example, the above-mentioned optimal frame image). Feature extraction to obtain the image features of the portrait; according to the image features of the portrait and the image features of the sample image, determine the similarity value of the image features.

It should be understood that the aforementioned portrait may also refer to a face image.

Exemplarily, the similarity value of the image feature can be measured by the cosine distance between the image feature of the portrait and the image feature of the sample image.

Step 708: The NPU sends the similarity value to the controller.

Step 709: The controller determines whether to continuously track the target object.

For example, the controller compares the preset threshold with the similarity value. When the similarity value is less than the preset threshold, it means that the image to be processed and the sample image include different portraits, which can indicate that the monitored pedestrian is not black. Pedestrians in the list library; when the similarity value is greater than or equal to the preset threshold, it means that the portrait in the image to be processed and the sample image include the same portrait, which can indicate that the monitored pedestrian is a pedestrian in the blacklist library.

Step 710: When the similarity value is greater than or equal to the preset threshold, the controller controls the dome camera module to continuously track the target object.

For example, when the controller determines that the similarity value is greater than or equal to the preset threshold, the controller can immediately send an alarm instruction and control the dome camera module to continuously track the target object.

In the control method shown in FIG. 8, the image to be processed is the image obtained by the box camera module in the camera module. The following is a detailed description of the dome camera module in the camera module. The embodiment of processing the image will be described in detail.

Fig. 9 is a schematic diagram of a control method provided by an embodiment of the present application. This control method can be applied to a monitoring device for gun-and-ball cooperation. The control method 800 shown in FIG. 9 includes steps 801 to 815, and these steps are respectively described in detail below.

It should be understood that the control method shown in FIG. 9 is illustrated by taking the target object in the acquired image to be processed as a portrait. The control method shown in FIG. 9 is also applied to a to-be-processed image including other target objects, where the target object may refer to an object whose recognition result obtained by a recognition algorithm is unstructured data.

Step 801: The controller may send a coordinate system synchronization request to the bolt camera module.

Step 802: The controller may send a coordinate system synchronization request to the bolt camera module.

It should be noted that, through the above steps 801 and 802, the bolt camera module and the dome camera module can be requested to synchronize the coordinate system. The above steps 801 and 802 can be executed at the same time, or step 802 can be executed first. , Step 801 is executed again, and the execution sequence of step 801 and step 802 is not limited in this application.

Step 803: The box camera module may send the coordinate system synchronization success to the controller.

Step 804: The dome camera module may send the coordinate system synchronization success to the controller.

In the same way, the above step 803 and step 804 may be performed at the same time, or step 804 may be performed first, and then step 803 may be performed. The present application does not limit the execution order of step 803 and step 804 in any way.

Step 805: The controller sends sample data to the NPU.

For example, it may refer to a blacklisted image library, for example, it may be a blacklisted face image, or it may also be a blacklisted vehicle image.

Step 806: The box camera module may send the first image to the NPU.

Wherein, the first image may be an image taken by the box camera module within the monitoring range.

Step 807: The NPU detects the portrait coordinates in the first image.

Specifically, after the NPU obtains the first image sent by the box camera module, it is determined through the detection network that the first image includes a moving target object, but the target object is too small to meet the recognition requirements; for example, it may be in the first image The pixels of the portrait are too small to meet the recognition requirements. At this time, the NPU may send the portrait coordinates in the first image obtained through the detection network to the controller, and the controller then controls the dome camera module to obtain the image of the pedestrian.

Step 808: The NPU sends the portrait coordinates in the first image to the controller.

Further, the controller can obtain the target coordinate information of the portrait in the dome camera module through coordinate mapping according to the portrait coordinates in the acquired first image.

Step 809: The controller sends target coordinate information to the camera module of the dome camera.

Step 810: The camera module of the dome camera performs omni-directional movement of the pan/tilt, lens zoom, and zoom control (Pan/Tilt/Zoom, PTZ) adjustments according to the target coordinates.

For example, the dome camera module obtains an image of the target after being adjusted to the best monitoring position through translation, rotation, and zooming according to the target coordinate information.

Step 811: The dome camera module may send the second image to the NPU.

Exemplarily, the NPU can process the acquired multi-frame second image through the detection network, the tracking network, and the image selection network to obtain the optimal frame image in the multi-frame second image; the specific processing flow can be seen in Figure 8 above Step 706 is not repeated here.

Further, the optimal frame image among the multiple frames of second images may be identified, that is, step 812 is performed.

Step 812: The NPU performs face comparison and determines the similarity value.

In an example, the sample data sent by the controller to the NPU may be a sample image, and the NPU may perform image feature extraction on the portrait and the sample image in the second image (for example, the optimal frame image in the multi-frame second image) , Get the image features of the portrait and the image features of the sample image; determine the similarity value of the image features according to the image features of the portrait and the image features of the sample image.

In an example, the sample data sent by the controller to the NPU may be sample image features obtained through a neural network algorithm, and the NPU may use the same neural network algorithm to extract image features of the portrait in the second image to obtain the image of the portrait Features: Determine the similarity value of the image features according to the image features of the portrait and the image features of the sample image.

Exemplarily, the cosine distance between the image feature of the portrait and the image feature of the sample image can be used to measure the similarity value of the image feature.

For example, the similarity value between the image to be processed (for example, the second image) and the sample image can be determined by the following equation:

Step 813: The NPU sends the similarity value to the controller.

Step 814: The controller determines whether to continuously track the target object.

For example, the controller compares the preset threshold with the similarity value. When the similarity value is less than the preset threshold, it means that the portrait in the second image and the sample image include different portraits, which can indicate that the monitored pedestrian is not a blacklist. Pedestrians in the library; when the similarity value is greater than or equal to the preset threshold, it means that the portrait in the second image and the sample image include the same portrait, which can indicate that the monitored pedestrian is a pedestrian in the blacklist library.

Step 815: When the similarity value is greater than or equal to the preset threshold, the controller may control the dome camera module to continuously track the target object.

In the embodiment of the present application, the image to be processed can be obtained through the box camera module or the dome camera module in the camera module, and the image to be processed is sent to the neural network processor; the neural network processor can be used for Perform image feature comparison between the image to be processed and the sample image to obtain the comparison result. Through the control method provided in the embodiments of the present application, the process of acquiring, processing, and analyzing the image to be processed in the monitoring device is realized, without the need to transmit the acquired image to be processed to a server deployed in the background for processing and analysis, thereby The time delay introduced by the communication network is avoided, and the processing efficiency of the image to be processed is improved.

In addition, in the embodiment of the present application, when the controller determines that the similarity value between the image to be processed and the sample image is greater than the preset threshold, the camera module of the dome camera can be controlled by the controller to continuously track the target object, so as to avoid being used as the target object. The problem that the target object cannot be monitored when the object is far away from the monitoring range of the bullet camera module. The continuous tracking mechanism of the dome camera module proposed in the embodiment of this application can obtain more information about the target object, thereby improving the security performance of the monitoring device .

It should be understood that the term "and/or" in this text is only an association relationship describing the associated objects, indicating that there can be three types of relationships, for example, A and/or B, which can mean: A alone exists, and both A and B exist. , There are three cases of B alone. In addition, the character "/" in this text generally indicates that the associated objects before and after are in an "or" relationship.

It should be understood that in the various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not correspond to the embodiments of the present application. The implementation process constitutes any limitation.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, which is not repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional modules in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disks or optical disks and other media that can store program codes. .

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

A monitoring device, which is characterized by comprising a camera module, a controller and a processor, wherein:

The camera module is used to obtain images to be processed;

The controller is used to send a sample image to the processor;

The processor is configured to perform image feature comparison between the to-be-processed image and the sample image to obtain a comparison result.
The monitoring device according to claim 1, wherein the processor is further configured to send the comparison result to the controller;

The controller is used to control whether the dome camera module in the camera module tracks and monitors the target object in the image to be processed according to the comparison result.
3. The monitoring device according to claim 2, wherein the comparison result is a similarity value between the image to be processed and the sample image.
The monitoring device according to claim 3, wherein the controller is further used for:

When the similarity value is greater than a preset threshold, the dome camera module in the camera module is controlled to track and monitor the target object in the image to be processed in a rotating manner.
The monitoring device according to any one of claims 1 to 4, wherein the box camera module in the camera module is used to obtain the image to be processed.
The monitoring device according to any one of claims 1 to 4, wherein the dome camera module in the camera module is used to obtain the image to be processed.
The monitoring device according to claim 6, wherein the image to be processed includes a target object, and the dome camera module is used to obtain the image to be processed according to the target coordinate information of the target object, wherein The target coordinate information is obtained by performing coordinate mapping on the coordinate information of the target object in the gun camera module of the camera module.
8. The monitoring device according to any one of claims 2 to 7, wherein the target object in the image to be processed is a human image.
8. The monitoring device according to any one of claims 1 to 8, wherein the processor is a neural network processor.
A control method, characterized in that the control method is applied to a monitoring device, the monitoring device includes a camera module, a controller, and a processor, and the control method includes:

The camera module obtains an image to be processed;

The controller sends a sample image to the processor;

The processor performs image feature comparison between the image to be processed and the sample image to obtain a comparison result.
The control method according to claim 10, wherein the control method further comprises:

Sending the comparison result to the controller by the processor;

The controller controls whether the dome camera module in the camera module tracks and monitors the target object in the image to be processed according to the comparison result.
The control method according to claim 11, wherein the comparison result is the similarity value between the image to be processed and the sample image.
The control method according to claim 12, wherein the controller controls whether the dome camera module in the camera module tracks and monitors the target object in the image to be processed according to the comparison result, comprising :

When the similarity value is greater than a preset threshold, the controller controls the dome camera module in the camera module to track and monitor the target object in the image to be processed in a rotating manner.
The control method according to any one of claims 10 to 13, wherein the camera module acquiring the image to be processed includes:

The box camera module in the camera module obtains the image to be processed.
The control method according to any one of claims 10 to 13, wherein the camera module acquiring the image to be processed includes:

The dome camera module in the camera module obtains the image to be processed.
The control method according to claim 15, wherein the image to be processed includes a target object, and the dome camera module in the camera module obtains the image to be processed, comprising:

The dome camera module acquires the to-be-processed image according to the target coordinate information of the target object, wherein the target coordinate information is obtained by comparing the target object in the box camera module in the camera module The coordinate information is obtained by coordinate mapping.
The control method according to any one of claims 11 to 16, wherein the target object in the image to be processed is a portrait.
The control method according to any one of claims 10 to 17, wherein the processor is a neural network processor.