CN103985230A

CN103985230A - Notification method, device and system based on image

Info

Publication number: CN103985230A
Application number: CN201410203681.1A
Authority: CN
Inventors: 汪滔
Original assignee: Shenzhen Dajiang Innovations Technology Co Ltd
Current assignee: Shenzhen Dajiang Innovations Technology Co Ltd
Priority date: 2014-05-14
Filing date: 2014-05-14
Publication date: 2014-08-13
Anticipated expiration: 2034-05-14
Also published as: CN103985230B

Abstract

The embodiment of the invention provides a notification method, device and system based on an image. The notification method comprises the steps of obtaining the image collected by a camera module of a terminal at the current time; carrying out feature identification on the image; generating a notification message if an automobile image object meeting the automobile image feature and the static conditions is identified out from the image, wherein the notification message comprises a message of the current position of the terminal and a picture obtained according to the automobile image object; sending the generated notification message to a server. By the adoption of the notification method, device and system based on the image, the requirements for automation and intellectualization of illegal evidence obtaining are met. Meanwhile, the illegal evidence obtaining can be achieved through various intelligent user terminals, then the evidence obtaining can be carried out on illegal parking incidents within the larger range under the cooperation of other users, the working efficiency is improved, only images of automobiles at the illegal parking state are uploaded, and bandwidth is saved.

Description

Image-based notification method, device and system

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to an image-based notification method, an image-based notification apparatus, and a notification system.

Background

In the existing process of traffic violation correction law enforcement, a camera is generally adopted to record traffic violation behaviors in the evidence obtaining stage, relevant image data such as videos and pictures are collected, and then the relevant image data is taken as the basis to process the responsible person.

The collection of picture video is accomplished to camera, electronic eye, the removal that generally adopts various types at present and make a video recording etc. comparatively commonly used mode of collecting evidence in the law enforcement of violating the law includes: the method comprises a traffic police field evidence obtaining mode and a mode of uploading image data in real time through an electronic eye arranged in a relevant area.

In the two ways, the labor cost and the efficiency generated by the on-site evidence obtaining way of the traffic police are high and low. The definition of the video data uploaded by the electronic eye is low due to the limitation of the network bandwidth, and most of the uploaded image data is useless video data, which causes waste of transmission and storage and processing resources.

Disclosure of Invention

The embodiment of the invention mainly solves the technical problem of providing a notification method, a notification device and a notification system based on images, which can effectively reduce the evidence obtaining cost and improve the evidence obtaining efficiency.

In a first aspect, an embodiment of the present invention provides an image-based notification method, including:

acquiring an image acquired by a camera module of a terminal at the current moment;

performing feature recognition on the image, and generating notification information if an automobile image object which meets automobile image features and meets a static condition is recognized from the image, wherein the notification information comprises: the current position information of the terminal and a picture obtained according to the automobile image object;

and sending the generated notification information to a server.

Optionally, before acquiring the image acquired by the camera module of the terminal at the current moment, the method further includes:

acquiring current position information of a terminal, and determining whether the acquired position information is located in a preset alarm area;

and if the terminal is located in a preset alarm area, calling a camera module of the terminal to acquire an image so as to acquire the image acquired by the camera module of the terminal at the current moment.

Optionally, the performing feature recognition on the image, and if an automobile image object that meets the automobile image feature and satisfies the still condition is recognized from the image, generating notification information includes:

performing feature recognition on the image based on a preset recognition rule;

if the automobile image object which meets the automobile image characteristics and meets the static condition is identified from the image, further identifying whether the image comprises a position identification image object for identifying the position of the area;

if the position identification image object is not included, calling a camera module of the terminal to shoot to obtain a new image, wherein the new image comprises the automobile image object and at least one position identification image object;

and generating notification information carrying the new image.

Optionally, the method further includes:

detecting whether a preset alarm key is triggered by clicking or not;

if triggered, executing user authentication operation, and sending out an alarm communication request according to at least one communication identifier bound with the alarm key after the authentication is passed;

the user authentication operation comprises: and authenticating the user fingerprint of clicking the alarm key in the click triggering process, or calling a camera module of the terminal to authenticate the face or iris in the current camera shooting range.

Optionally, before sending the generated notification information to the server, the method further includes:

identifying the automobile image object, and acquiring vehicle information of an automobile corresponding to the automobile image object, wherein the vehicle information comprises: any one or more of license plate information, vehicle type information, and time information;

adding the acquired vehicle information to the notification information.

Correspondingly, the embodiment of the invention also provides an image-based notification device, which comprises:

the acquisition module is used for acquiring an image acquired by a camera module of the terminal at the current moment;

a processing module, configured to perform feature recognition on the image acquired by the acquisition module, and if an automobile image object that meets automobile image features and meets a still condition is identified from the image, generate notification information, where the notification information includes: the current position information of the terminal and a picture obtained according to the automobile image object;

and the sending module is used for sending the notification information generated by the processing module to a server.

Optionally, the apparatus further comprises:

the position determining module is used for acquiring the current position information of the terminal and determining whether the acquired position information is located in a preset alarm area;

and the calling module is used for calling the camera module of the terminal to acquire the image if the terminal is located in a preset alarm area.

Optionally, the processing module includes:

the identification unit is used for carrying out feature identification on the image based on a preset identification rule, and if an automobile image object which meets automobile image features and meets a static condition is identified from the image, whether the image comprises a position identification image object for identifying the position of an area is further identified;

the shooting calling unit is used for calling a camera module of the terminal to shoot and acquire a new image when the recognition result of the recognition unit is that the position identification image object is not included, wherein the new image comprises the automobile image object and at least one position identification image object;

and the generating unit is used for generating the notification information carrying the new image.

Optionally, the apparatus further comprises:

the alarm module is used for detecting whether a preset alarm key is triggered by clicking; if triggered, executing user authentication operation, and sending out an alarm communication request according to at least one communication identifier bound with the alarm key after the authentication is passed;

the alarm module is specifically used for authenticating the fingerprint of the user clicking the alarm button in the click triggering process, or calling a camera module of the terminal to authenticate the face or iris in the current camera shooting range.

Optionally, the processing module further includes:

an obtaining unit, configured to identify the automobile image object, and obtain vehicle information of an automobile corresponding to the automobile image object, where the vehicle information includes: any one or more of license plate information, vehicle type information, and time information;

an adding unit configured to add the vehicle information acquired by the acquiring unit to the notification information.

Correspondingly, the embodiment of the invention also provides an aircraft, which comprises: camera device, processor, wherein:

the camera device is used for collecting images under the control of the processor;

the processor is used for acquiring the image acquired by the camera device at the current moment; carrying out feature recognition on the image, and if an automobile image object which meets the automobile image feature and meets the static condition is recognized from the image, generating notification information; sending the generated notification information to a server, wherein the notification information comprises: the current position information of the aircraft and the picture obtained according to the automobile image object.

Optionally, the processor is further configured to obtain current position information of the aircraft, and determine whether the obtained position information is located in a preset warning region; and if the alarm area is located in the preset alarm area, calling the camera device to acquire the image.

Optionally, the processor is specifically configured to perform feature recognition on the image based on a preset recognition rule; if the automobile image object which meets the automobile image characteristics and meets the static condition is identified from the image, further identifying whether the image comprises a position identification image object for identifying the position of the area; if the position identification image object is not included, calling the camera device to shoot and obtain a new image, wherein the new image comprises the automobile image object and at least one position identification image object; and generating notification information carrying the new image.

Optionally, the processor is further configured to identify the car image object, acquire vehicle information of a car corresponding to the car image object, and add the acquired vehicle information to the notification information, where the vehicle information includes: any one or more of license plate information, vehicle type information, and time information.

Correspondingly, an embodiment of the present invention further provides a notification system, including: aircraft, a control terminal, wherein,

the aircraft is used for acquiring an image of an environment at the current moment, performing feature recognition on the acquired image, and if an automobile image object which meets automobile image features and meets a static condition is recognized from the image, sending current position information and a picture obtained according to the automobile image object to the control terminal;

and the control terminal is used for generating notification information according to the position information and the picture obtained according to the automobile image object and sending the notification information to a server.

Wherein optionally the control terminal is provided on the aircraft.

The embodiment of the invention can automatically monitor and recognize the images of the illegal parking areas, and only when the automobiles in a static state exist in the illegal parking areas are recognized, the photos of the illegal parking image objects and the position information acquired by a GPS and the like are shot and sent to the traffic processing platform server, thereby meeting the requirements of automation and intellectualization of illegal evidence collection. The method can be realized in various intelligent user terminals, and further can be used for carrying out evidence collection processing on illegal events in a large range under the cooperation of other users, so that the working efficiency is improved, only images which are judged to be in an illegal state after being identified are uploaded, a large amount of useless data are not included, and the bandwidth and storage processing resources are saved. Drawings

FIG. 1 is a schematic flow chart diagram of an image-based notification method according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart diagram of another image-based notification method of an embodiment of the present invention;

FIG. 3 is a flow chart of a notification information generation method according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of an image-based notification apparatus according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of another image-based notification appliance, in accordance with an embodiment of the present invention;

FIG. 6 is a schematic diagram of one of the structures of the processing module of FIG. 5;

FIG. 7 is a schematic structural diagram of an aircraft in accordance with an embodiment of the invention;

FIG. 8 is a schematic structural diagram of a notification system according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of another notification system according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the embodiment of the invention, the image monitoring can be carried out on the set areas such as the road sections where parking is forbidden and the like based on the terminals such as the smart phone, the vehicle-mounted monitoring terminal, the aircraft and the like of the common user, the image obtained by the image monitoring is identified, if the image object of the automobile is included and is still, the automobile corresponding to the image object of the automobile is determined to be in the violation state, at the moment, the image including the automobile is obtained by shooting, the current position of the shot terminal is obtained, and the image and the position are directly uploaded to the server of the specified network address, so that the violation evidence reporting is completed.

Referring to fig. 1 specifically, the method is a flowchart of an image-based notification method according to an embodiment of the present invention, and the method according to an embodiment of the present invention may be applied to a mobile terminal with a network function and a camera function, such as a smart phone, a tablet computer, a vehicle-mounted smart terminal, and a smart wearable device, and may also be arranged in a terminal for monitoring, such as an aircraft with a network function, and specifically, the method includes:

s101: and acquiring an image acquired by a camera module of the terminal at the current moment.

In S101, an image in an illegal parking area (warning area) acquired by the terminal camera is specifically acquired. The user can open the corresponding function that sets up in terminals such as intelligent terminal or unmanned aerial vehicle in the highway section of breaking a halt, gathers current environment image by the camera, and the terminal reacquires the image that the camera was gathered in order to carry out analysis and recognition. The image may be a still image, i.e., a picture, acquired by a camera, or a moving image, i.e., a short video.

The terminal can also monitor the coordinate position of the terminal in real time, when the detected coordinate position is located in a preset illegal parking area range (a preset alarm area), related functions are started, the camera of the terminal is automatically called, the current environment image is acquired by the camera, and the image acquired by the camera is acquired by the terminal for analysis and identification.

S102: performing feature recognition on the image, and generating notification information if an automobile image object which meets automobile image features and meets a static condition is recognized from the image, wherein the notification information comprises: the current position information of the terminal and the picture obtained according to the automobile image object.

For the static image, the identification of the automobile image object and the comparison judgment of whether the automobile image object is static can be comprehensively carried out based on the contents of two or more pictures before and after the collection. For dynamic images, the identification of the car image object and the comparison judgment of whether the car image object is still can be specifically carried out based on the content of each picture frame in the video.

The image feature recognition may be performed based on recognition modes such as color features, texture features, shape features, and the like of the image, image feature extraction may be performed after the image features are detected, the extracted image features are compared with each automobile image feature in a preset automobile image feature set, and if the similarity with a certain automobile image feature reaches a certain similarity threshold, it may be determined that the image acquired in S101 includes an automobile image object.

After the automobile image object is determined to be included, whether the automobile image object is in a static state or not is determined based on a fixed reference object in a plurality of still images or moving images (short videos), the automobile image object, the moving speed and direction of the terminal, the time and the like. If yes, the vehicle image object is judged to be in an illegal parking state, and a notification message is generated and notified to a related server, for example, a traffic violation processing platform server and the like.

Certainly, other ways are also included to determine whether the automobile belongs to a static state, specifically, whether a person is included in the corresponding automobile or the cab is determined according to the obtained automobile image object by identifying the automobile image object, and if the person is not included, the automobile corresponding to the automobile image object is directly determined to be in the static state and meet the static condition; if the vehicle includes a person, it may be further determined whether or not the vehicle corresponding to the vehicle image object has a flash instruction or the like based on the luminance characteristics of the plurality of still images or moving images, and if not, it may be determined that the vehicle satisfies the still condition.

The location information may be location coordinate information determined by the terminal itself based on its own GPS (global positioning System) module.

In the process of generating the notification information, the identified automobile image object can be further identified, the license plate information and the like in the automobile image object can be extracted, the license plate information can be extracted by image identification according to the area selected by the user in the automobile image object, optionally, after the license plate information is extracted by the identification, the license plate information can be displayed to the user for viewing, and the license plate information can be used as correct license plate information after the user confirms so as to be added into the notification information later. The vehicle type of the vehicle image object can be determined according to the vehicle type information of the vehicle image feature mapping corresponding to the vehicle image object. Time information may also be obtained based on the current system clock, wherein to ensure accuracy of the time information, the time information may be obtained by requesting GPS system time or requesting system time of a communication base station. Adding license plate information, vehicle type information, and time information(s) to the notification information.

The terminal and the server can negotiate to set notification information with a special format, and the notification information comprises license plate information, vehicle type information, time information fields, picture fields, position information fields and the like. And furthermore, the originally collected video including the static automobile image object can be carried in the notification information and sent to the server, and the notification information also comprises a video field.

S103: and sending the generated notification information to a server.

The notification information may be sent to the server with the specified network address through wifi, GPRS (General Packet Radio Service), and other communication methods.

The embodiment of the invention can automatically monitor and recognize the images of the illegal parking areas, and only when the automobiles in a static state exist in the illegal parking areas are recognized, the photos of the illegal parking image objects and the position information acquired by a GPS and the like are shot and sent to the traffic processing platform server, thereby meeting the requirements of automation and intellectualization of illegal evidence collection. And can realize in various intelligent user terminal, and then can carry out evidence collection processing to the event of violating the parking in the great scope under the cooperation of other users, improved work efficiency, and what upload only is in the car picture of the state of violating the parking, saved the bandwidth.

Referring to fig. 2 again, the method is a flowchart of another image-based notification method according to an embodiment of the present invention, and the method according to an embodiment of the present invention may be applied to a mobile terminal with a network function and a camera function, such as a smart phone, a tablet computer, a vehicle-mounted smart terminal, and a smart wearable device, and may also be arranged in a terminal for monitoring, such as an unmanned aerial vehicle with a network function, and specifically, the method includes:

s201: acquiring the current position information of the terminal, and determining whether the acquired position information is located in a preset alarm area.

The alarm area may be a set of pre-configured coordinate ranges, which may be set and updated in real time according to prescribed illegal road segments and ranges. The current position information of the terminal can be obtained based on built-in GPS positioning, and whether the current position of the terminal is in the alarm area range can be judged according to the related coordinates and the coordinate range.

S202: and if the terminal is located in a preset alarm area, calling a camera module of the terminal to acquire an image.

When in the preset warning area, the modules such as the camera are triggered to be started to acquire the environment image, otherwise the modules such as the camera cannot be started, the automatic and intelligent requirements for starting the notification function based on the image are met, and the electric energy can be effectively saved.

S203: acquiring an image acquired by a camera module of a terminal at the current moment;

s204: performing feature recognition on the image, and generating notification information if an automobile image object which meets automobile image features and meets a static condition is recognized from the image, wherein the notification information comprises: the current position information of the terminal and a picture obtained according to the automobile image object;

before sending the notification message, in the process of generating the notification message, the method may further include: identifying the automobile image object, and acquiring vehicle information of an automobile corresponding to the automobile image object, wherein the vehicle information comprises: any one or more of license plate information, vehicle type information, and time information; adding the acquired vehicle information to the notification information.

S205: and sending the generated notification information to a server.

The specific implementation process of S203 to S205 may refer to the related description of the corresponding embodiment of fig. 1.

Further, a function of setting a one-key alarm may be added to the image-based notification function according to the embodiment of the present invention. Before or after performing any of the above steps S201 to S205, the method of the embodiment of the present invention may further perform the following steps:

s206: and detecting whether a preset alarm key is triggered by clicking.

The preset alarm key can be a preset software key or a physical key configured as an alarm function, for example, a screen unlocking key can be configured to trigger the alarm key by clicking when pressed for a long time.

S207: if the alarm key is triggered, user authentication operation is executed, and after the authentication is passed, an alarm communication request is sent out according to at least one communication identifier bound with the alarm key.

Wherein the user authentication operation comprises: and authenticating the user fingerprint of clicking the alarm key in the click triggering process, or calling a camera module of the terminal to authenticate the face or iris in the current camera shooting range. Other biometric identification and authentication means such as character code identification are also included. And determining the users of the alarm operation according to the authentication operation, and refusing the alarm operation initiated by the illegal users.

After the authentication operation is executed and the authentication is passed, a prompt message for confirming whether the alarm is confirmed can be sent, and when the confirmation operation of the user is received or the cancel operation is not received within the preset time length, an alarm communication request is sent according to at least one communication identifier bound with the alarm key.

The communication identifier bound with the alarm key can be various common telephone numbers such as alarm, fire alarm and the like, and after a user clicks the alarm key according to convention, an alarm communication request is initiated according to associated trigger logic.

Referring to fig. 3 again, a flowchart of a notification information generating method according to an embodiment of the present invention is shown, where the method may correspond to S204 in the foregoing embodiment, and specifically, the method includes:

s301: and performing feature recognition on the image based on a preset recognition rule.

One or more rule algorithms based on feature extraction and feature comparison can be preset, and the content of each picture frame in the image or video image is identified to determine whether an automobile image object meeting the characteristics of the automobile image exists in the shot image.

S302: and if the automobile image object which meets the automobile image characteristics and meets the static condition is identified from the image, further identifying whether the image comprises a position identification image object for identifying the position of the area.

The image features extracted from the image can be compared with one or more automobile image features in the automobile image feature set, and when the similarity obtained by feature comparison reaches a certain similarity threshold, the obtained image can be considered to include the automobile image object.

After the automobile image object is determined to be included, whether the automobile image object is in a static state or not is determined based on a fixed reference object in a plurality of still images or moving images (short videos), the automobile image object, the moving speed and direction of the terminal, and the like. If yes, the vehicle image object is judged to be in an illegal parking state, and a notification message is generated and notified to a related server, for example, a traffic violation processing platform server and the like.

After determining that the automobile image object exists in the acquired image, further identifying whether the acquired image comprises a position identification image object. Specifically, the position identification image object is some predefined target objects, specifically for example: the image of the image object of the automobile including the illegal parking can simultaneously comprise various marks capable of marking the current position of the automobile, so that the position of the illegal parking automobile can be further proved on the basis of the existing GPS coordinate position in the subsequent possible evidence. The license plate information, the vehicle type information, and the time information may be obtained as described in the embodiment corresponding to fig. 1.

S303: and if the position identification image object is not included, calling a camera module of the terminal to shoot and acquire a new image, wherein the new image comprises the automobile image object and at least one position identification image object.

Specifically, the images including the position identification image object and the automobile image object can be obtained based on the shooting angle and the shooting direction of the camera and other modules automatically adjusted by the holder.

S304: and generating notification information carrying the new image.

When the notification information carrying the newly shot picture including the position identification image object is generated in S304, the automobile image object may also be identified, and the vehicle information of the automobile corresponding to the automobile image object is acquired, where the vehicle information includes: any one or more of license plate information, vehicle type information, and time information; adding the acquired vehicle information to the notification information. Namely, the generated notification information includes: including a picture of the location identification image object, location information of the terminal, and including any one or more of license plate information, vehicle type information, and time information.

The embodiment of the invention can automatically detect whether the terminal is in the illegal parking area, carries out image monitoring and identification on the illegal parking area when the terminal is in the illegal parking area, and shoots and obtains the picture of the illegal parking image object and the position information obtained by GPS and the like and sends the picture and the position information to the traffic processing platform server when the automobile in a static state is identified in the illegal parking area, thereby meeting the requirements of automation and intellectualization of illegal evidence collection. And can realize in various intelligent user terminal, and then can carry out evidence collection processing to the event of violating the parking in the great scope under the cooperation of other users, improved work efficiency, and what upload only is in the car picture of the state of violating the parking, saved the bandwidth.

The image-based notification apparatus, aircraft, and system of embodiments of the present invention are described in detail below.

Referring to fig. 4 again, the structure of the image-based notification device according to the embodiment of the present invention is schematically shown, and the device according to the embodiment of the present invention may be disposed in a mobile terminal with a network function and a camera function, such as a smart phone, a tablet computer, a vehicle-mounted smart terminal, and a smart wearable device, or may be disposed in a terminal for monitoring, such as an unmanned aerial vehicle with a network function. Specifically, the apparatus comprises:

the acquisition module 1 is used for acquiring images acquired by a camera module of the terminal at the current moment;

a processing module 2, configured to perform feature recognition on the image acquired by the acquisition module 1, and generate notification information if an automobile image object that meets an automobile image feature and satisfies a still condition is identified from the image, where the notification information includes: the current position information of the terminal and a picture obtained according to the automobile image object;

a sending module 3, configured to send the notification information generated by the processing module 2 to a server.

The acquisition module 1 specifically acquires images in an illegal parking area (alarm area) acquired by camera modules such as a camera. The user can be when being in the highway section of violating the stop, open the corresponding function that sets up in terminals such as intelligent terminal, perhaps unmanned aerial vehicle, gather current environment image by the camera, the image that mobile terminal or unmanned aerial vehicle's camera was gathered is acquireed to acquisition module 1. The image may be a still image, i.e., a picture, acquired by a camera, or a moving image, i.e., a short video.

The terminal with the related function can also monitor the coordinate position of the terminal in real time, when the detected coordinate position is located in a preset illegal parking area range and a preset alarm area, the related function is started, the acquisition module 1 automatically calls the camera of the terminal, the current environment image is acquired by the camera, and the image acquired by the camera is acquired.

For a static image, the processing module 2 may comprehensively perform the identification of the automobile image object and the comparison determination of whether the automobile image object is static or not based on the contents of the two or more collected front and back pictures. For dynamic images, the processing module 2 may specifically perform the identification of the car image object and the comparison determination of whether the car image object is still based on the content of each picture frame in the video.

The processing module 2 may perform feature recognition on the image based on color features, texture features, shape features, and the like of the image, extract image features after the image features are detected, compare the extracted image features with each automobile image feature in a preset automobile image feature set, and if the similarity reaches a certain similarity threshold, the processing module 2 may determine that the image acquired by the acquisition module 1 includes an automobile image object.

After determining that the car image object is included, the processing module 2 further determines whether the car image object is in a still state based on a fixed reference object in a plurality of still images or moving images (short videos), the car image object, the moving speed and direction of the terminal, and the like. If yes, the vehicle image object is judged to be in an illegal parking state, and a notification message is generated and notified to a related server, for example, a traffic violation processing platform server and the like.

Certainly, the processing module 2 further includes other ways to determine whether the automobile belongs to a static state, specifically, it may determine whether a person is included in the corresponding automobile or in the cab according to the automobile image object by identifying the obtained automobile image object, and if the person is not included, directly determine that the automobile corresponding to the automobile image object is in the static state and meets the static condition; if the vehicle includes a person, it may be further determined whether or not the vehicle corresponding to the vehicle image object has a flash instruction or the like based on the luminance characteristics of the plurality of still images or moving images, and if not, it may be determined that the vehicle satisfies the still condition.

The position information may be position coordinate information determined by the mobile terminal or the aircraft terminal itself based on its own GPS positioning.

In the process of generating the notification information, the processing module 2 may further identify the identified car image object, extract the license plate information therein, and the like, where the extraction of the license plate information may be obtained by performing image identification on an area selected by the user in the car image object, and optionally, after the license plate information is identified and extracted, the license plate information may be displayed to the user for viewing, and after the user confirms the extracted license plate information, the extracted license plate information is used as correct license plate information to facilitate subsequent addition to the notification information. The vehicle type of the vehicle image object can be determined according to the vehicle type information of the vehicle image feature mapping corresponding to the vehicle image object. Time information may also be obtained based on the current system clock, wherein to ensure accuracy of the time information, the time information may be obtained by requesting GPS system time or requesting system time of a communication base station. Adding license plate information, vehicle type information, and time information(s) to the notification information.

The sending module 3 may specifically send the notification information to a server with a specified network address through the existing wifi, GPRS and other communication methods.

Referring to fig. 5 again, the structural diagram of another image-based notification device according to an embodiment of the present invention is shown, where the device according to an embodiment of the present invention may be disposed in a mobile terminal with a network function and a camera function, such as a smart phone, a tablet computer, a vehicle-mounted smart terminal, and a smart wearable device, or may be disposed in a terminal for monitoring, such as an unmanned aerial vehicle with a network function. Specifically, the apparatus includes an obtaining module 1, a processing module 2, and a sending module 3 in the previous embodiment, and further, in this embodiment of the present invention, the apparatus further includes:

the position determining module 4 is used for acquiring the current position information of the terminal and determining whether the acquired position information is located in a preset alarm area;

and the calling module 5 is used for calling a camera module of the terminal to acquire an image if the terminal is located in a preset alarm area.

The alarm area may be a set of pre-configured coordinate ranges, which may be set and updated in real time according to prescribed illegal road segments and ranges. The position determining module 4 may obtain the position information of the terminal, such as an aircraft or a mobile terminal, based on the built-in GPS positioning, and may determine whether the current position of the terminal is within the alarm area according to the above-mentioned coordinates and coordinate range.

When the alarm is in a preset alarm area, the calling module 5 triggers and starts the modules such as the camera and the like to acquire the environment image, otherwise, the modules such as the camera and the like cannot be started, so that the automatic and intelligent requirements of starting the notification function based on the image are met, and the electric energy can be effectively saved.

Further optionally, in the embodiment of the present invention, as shown in fig. 6, the processing module 2 may specifically include:

the recognition unit 21 is configured to perform feature recognition on the image based on a preset recognition rule, and if an automobile image object that meets automobile image features and meets a still condition is recognized from the image, further recognize whether a position identification image object for identifying a position of an area is included in the image;

a shooting calling unit 22, configured to, when the recognition result of the recognition unit 21 is that the position identification image object is not included, call a camera module of the terminal to shoot and obtain a new image, where the new image includes the automobile image object and at least one position identification image object;

a generating unit 23, configured to generate notification information carrying the new image.

One or more rule algorithms based on feature extraction and feature comparison can be preset, and the identification unit 21 identifies the content of each picture frame in the image or video image to determine whether an automobile image object conforming to the characteristics of the automobile image exists in the shot image.

The identifying unit 21 may compare the target object feature extracted from the image with one or more automobile image features in the automobile image feature set, and when the similarity obtained by feature comparison reaches a certain similarity threshold, it may be determined that the acquired image includes an automobile image object.

After determining that the image object of the automobile is included, the identification unit 21 further determines whether the image object of the automobile is in a static state within a preset time period based on a reference object in the image (short video), the moving speed and the direction of the terminal, and if so, the static condition is satisfied, and the identification unit 21 may determine that the automobile corresponding to the image object of the automobile is in an illegal parking state.

After determining that the car image object exists in the acquired image, the identifying unit 21 further identifies whether a position identification image object is included in the acquired image. Specifically, the position identification image object is some predefined target objects, specifically for example: the signs are guideboards for location, guideboard signs, various hotels, store buildings, etc. The image including the illegal parking car image object can simultaneously include various marks capable of marking the current position of the car, so that the position of the illegal parking car can be further proved on the basis of the existing GPS coordinate position in the subsequent possible evidence.

The shooting calling unit 22 may specifically obtain a picture including the position identification image object based on a shooting angle and a shooting direction of the pan-tilt automatic adjustment camera and other modules.

Further optionally, when generating notification information carrying the newly-captured picture including the position identification image object, the processing module 2 may further identify the automobile image object, and acquire vehicle information of an automobile corresponding to the automobile image object, and therefore, as shown in fig. 6, the processing module 2 may further include:

an obtaining unit 24, configured to identify the car image object, and obtain vehicle information of a car corresponding to the car image object, where the vehicle information includes: any one or more of license plate information, vehicle type information, and time information;

an adding unit 25 for adding the vehicle information acquired by the acquiring unit 24 to the notification information.

Further optionally, a function of setting a one-key alarm may be added to the image-based notification function according to the embodiment of the present invention. The apparatus of the embodiment of the present invention may further include:

the alarm module 6 is used for detecting whether a preset alarm key is triggered by clicking; if triggered, executing user authentication operation, and sending out an alarm communication request according to at least one communication identifier bound with the alarm key after the authentication is passed;

the alarm module 6 is specifically configured to authenticate a user fingerprint that is clicked by the alarm button in the click triggering process, or to invoke a camera module of the terminal to authenticate a face or an iris within the current camera range.

Other biometric identification and authentication means such as character code identification are also included. And determining the users of the alarm operation according to the authentication operation, and refusing the alarm operation initiated by the illegal users.

Referring to fig. 7, it is a schematic structural diagram of an aircraft according to an embodiment of the present invention, where the aircraft includes existing modules such as a motor, a propeller, a power supply, and the like, and in an embodiment of the present invention, the aircraft further includes: a processor 100 having a particular function and a camera device 200 controlled by the processor 100. The processor 100 executes the notification control operation based on the picture according to the embodiment of the present invention based on the set application program, and the camera device 200 may be a built-in or plug-in camera of an aircraft. Specifically, the method comprises the following steps:

the camera 200 is used for acquiring images under the control of the processor 100;

the processor 100 is configured to obtain an image acquired by the camera device 200 at a current time; carrying out feature recognition on the image, and if an automobile image object which meets the automobile image feature and meets the static condition is recognized from the image, generating notification information; sending the generated notification information to a server, wherein the notification information comprises: the current position information of the aircraft and the picture obtained according to the automobile image object.

Further optionally, before controlling the camera device 200 to acquire an image, the processor 100 is further configured to acquire current position information of the aircraft, and determine whether the acquired position information is located in a preset warning region; and if the alarm area is located in the preset alarm area, calling the camera device 200 to acquire an image.

Further optionally, in the process of performing feature recognition on the image acquired by the image capturing device 200, and if an automobile image object meeting the automobile image feature and meeting the still condition is identified from the image, generating notification information, the processor 100 is specifically configured to perform feature recognition on the image based on a preset recognition rule; if the automobile image object which meets the automobile image characteristics and meets the static condition is identified from the image, further identifying whether the image comprises a position identification image object for identifying the position of the area; if the position identification image object is not included, calling the camera device 200 to shoot and acquire a new image, wherein the new image comprises the automobile image object and at least one position identification image object; and generating notification information carrying the new image.

Further optionally, in the process of generating notification information carrying the new image, the processor 100 may further obtain vehicle information based on the new image, that is, the processor 100 is further configured to identify the automobile image object, obtain vehicle information of an automobile corresponding to the automobile image object, and add the obtained vehicle information to the notification information, where the vehicle information includes but is not limited to: any one or more of license plate information, vehicle type information, and time information.

Specifically, in the embodiment of the present invention, the specific implementation of the processor 100 may refer to the related descriptions in the above method and apparatus embodiments.

Referring to fig. 8, the system in the embodiment of the present invention includes an aircraft 300 and a control terminal 400, where the aircraft 300 may be various types of unmanned aerial vehicles with camera shooting and communication functions, and the control terminal 400 may be a remote controller of the aircraft 300 with a computer data processing function and a data transmission function, or a mobile terminal such as a smart phone, a tablet computer, or a smart wearable device. Specifically, the method comprises the following steps:

the aircraft 300 is configured to collect an image of an environment at the current time, perform feature recognition on the collected image, and send current position information and a picture obtained according to an automobile image object to the control terminal 400 if the automobile image object meeting the automobile image feature and meeting a still condition is identified from the image;

and the control terminal 400 is configured to generate notification information according to the position information and the picture obtained according to the automobile image object, and send the notification information to a server.

Optionally, before the aircraft 300 is used to acquire the image of the environment at the current time, the aircraft 300 is specifically further used to acquire current position information of the aircraft 300, and determine whether the acquired position information is located in a preset alarm region; and if the terminal is located in a preset alarm area, calling a camera module of the terminal to acquire an image.

Optionally, the aircraft 300 is configured to perform feature recognition on the acquired image, and if an automobile image object meeting automobile image features and meeting static conditions is identified from the image, when the current position information and a picture obtained according to the automobile image object are sent to the control terminal 400, the aircraft is specifically configured to perform feature recognition on the image based on a preset recognition rule; if the automobile image object which meets the automobile image characteristics and meets the static condition is identified from the image, further identifying whether the image comprises a position identification image object for identifying the position of the area; if the position identification image object is not included, calling a camera module of the aircraft 300 to shoot and acquire a new image, wherein the new image comprises the automobile image object and at least one position identification image object; the new image and the position information of the aircraft are transmitted to the control terminal 400.

Optionally, before the aircraft 300 is configured to send the new image and the position information of the aircraft to the control terminal 400, the aircraft is further specifically configured to identify the car image object, and acquire vehicle information of a car corresponding to the car image object, where the vehicle information includes: any one or more of license plate information, vehicle type information, and time information. The aircraft 300 then transmits the acquired vehicle information, the new image, and the position information of the aircraft 300 to the control terminal 400.

In particular, the specific implementation of the aircraft 300 may refer to the related description of the corresponding embodiments of fig. 1 to 7.

The control terminal 400 may be directly externally hung or internally installed in the aircraft 300 as required.

Referring to fig. 9 again, it is a schematic structural diagram of another notification system according to an embodiment of the present invention, where the system according to the embodiment of the present invention includes: aircraft 500, control terminal 600, wherein, aircraft 500 can be the unmanned aerial vehicle of each type area camera shooting and communication function, control terminal 600 then can be for the aircraft 500 remote controller that possesses computer data processing function and data transmission function, or mobile terminal such as smart mobile phone, panel computer, intelligent wearable equipment. Wherein,

the aircraft 500 is configured to acquire an image of an environment at a current time, acquire current position information of the aircraft 500, and send the acquired image and the acquired position information to the control terminal 600;

the control terminal 600 is configured to perform feature recognition on the image, generate notification information if an automobile image object that meets an automobile image feature and satisfies a still condition is recognized from the image, and send the generated notification information to a server, where the notification information includes: the current position information of the aircraft 500 and the picture obtained from the car image object.

Optionally, before the aircraft 500 is used to acquire the image of the environment at the current time, the aircraft 500 is specifically further used to acquire current position information of the aircraft 500, and determine whether the acquired position information is located in a preset alarm region; and if the aircraft is located in the preset alarm area, calling a camera module of the aircraft 500 to acquire an image.

Optionally, the control terminal 600 is specifically further configured to detect whether a preset alarm key is triggered by being clicked; if triggered, executing user authentication operation, and sending out an alarm communication request according to at least one communication identifier bound with the alarm key after the authentication is passed; the user authentication operation comprises: and authenticating the user fingerprint of clicking the alarm key in the click triggering process, or calling a camera module of the terminal to authenticate the face or iris in the current camera shooting range.

Specifically, before being configured to send the generated notification information to the server, the control terminal 600 is further configured to identify the automobile image object, and obtain vehicle information of an automobile corresponding to the automobile image object, where the vehicle information includes: any one or more of license plate information, vehicle type information, and time information; adding the acquired vehicle information to the notification information.

Specifically, the aircraft 500 and the control terminal 600 may be implemented with reference to the description of the corresponding embodiments in fig. 1 to 7.

In the embodiments provided in the present invention, it should be understood that the disclosed related devices and methods can be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. An image-based notification method, comprising:

and sending the generated notification information to a server.

2. The method according to claim 1, wherein before acquiring the image captured by the camera module of the terminal at the current time, the method further comprises:

3. The method of claim 1, wherein the performing feature recognition on the image and generating notification information if a car image object that meets a car image feature and satisfies a still condition is identified from the image comprises:

performing feature recognition on the image based on a preset recognition rule;

and generating notification information carrying the new image.

4. The method of any of claims 1 to 3, further comprising:

detecting whether a preset alarm key is triggered by clicking or not;

5. The method according to any one of claims 1 to 3, wherein before sending the generated notification information to a server, further comprising:

adding the acquired vehicle information to the notification information.

6. An image-based notification device, comprising:

7. The apparatus of claim 6, further comprising:

8. The apparatus of claim 6, wherein the processing module comprises:

9. The apparatus of any of claims 6 to 8, further comprising:

10. The apparatus of any of claims 6 to 8, wherein the processing module further comprises:

11. An aircraft, characterized in that it comprises: camera device, processor, wherein:

12. The aircraft of claim 11,

the processor is further configured to acquire current position information of the aircraft and determine whether the acquired position information is located in a preset alarm region; and if the alarm area is located in the preset alarm area, calling the camera device to acquire the image.

13. The aircraft of claim 11,

the processor is specifically configured to perform feature recognition on the image based on a preset recognition rule; if the automobile image object which meets the automobile image characteristics and meets the static condition is identified from the image, further identifying whether the image comprises a position identification image object for identifying the position of the area; if the position identification image object is not included, calling the camera device to shoot and obtain a new image, wherein the new image comprises the automobile image object and at least one position identification image object; and generating notification information carrying the new image.

14. The aircraft according to any one of claims 11 to 13,

the processor is further configured to identify the car image object, acquire vehicle information of a car corresponding to the car image object, and add the acquired vehicle information to the notification information, where the vehicle information includes: any one or more of license plate information, vehicle type information, and time information.

15. A notification system, comprising: aircraft, a control terminal, wherein,

16. The system of claim 15, wherein the control terminal is disposed on the aircraft.