Nothing Special   »   [go: up one dir, main page]

CN116225235A - Data processing method, device, equipment and medium - Google Patents

Data processing method, device, equipment and medium Download PDF

Info

Publication number
CN116225235A
CN116225235A CN202310483543.2A CN202310483543A CN116225235A CN 116225235 A CN116225235 A CN 116225235A CN 202310483543 A CN202310483543 A CN 202310483543A CN 116225235 A CN116225235 A CN 116225235A
Authority
CN
China
Prior art keywords
doorbell
type
information
equipment
detection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310483543.2A
Other languages
Chinese (zh)
Other versions
CN116225235B (en
Inventor
徐士立
洪楷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202310483543.2A priority Critical patent/CN116225235B/en
Publication of CN116225235A publication Critical patent/CN116225235A/en
Application granted granted Critical
Publication of CN116225235B publication Critical patent/CN116225235B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00309Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated with bidirectional data transmission between data carrier and locks
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00571Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated by interacting with a central unit
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/186Video door telephones

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application provides a data processing method, a device, equipment and a medium, wherein the method comprises the following steps: when the doorbell equipment detects a first object, object detail information corresponding to the first object is collected through the doorbell equipment; object identification processing is carried out on the object detail information according to preset object information associated with doorbell equipment, so that an object type of a first object is obtained; the method comprises the steps of sending an object type of a first object to a wearable device, so that the wearable device determines object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with doorbell equipment; the object prompt parameter information is used for driving the wearable device to notify the second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information. Through this application embodiment, can improve the validity that doorbell was reminded.

Description

Data processing method, device, equipment and medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to a data processing method, apparatus, device, and medium.
Background
With the rapid development of computer technology, doorbell-like devices are increasingly used. The current doorbell equipment mainly reminds the accessed object through a bell, and the accessed object can further confirm the information of the accessed object through a terminal operation panel at a fixed position or a gate after receiving the bell of the doorbell equipment, so that whether the door is opened for the accessed object is determined. In this case, if the accessed object has limited ability to receive audio (e.g., the accessed object is a hearing impaired user, the accessed object is in a noisy environment, the accessed object is in a closed environment with good sound insulation effect, etc.), the accessed object may not receive the bell sound of the doorbell class device, resulting in missing the door opening for the accessed object.
Disclosure of Invention
The embodiment of the application provides a data processing method, a device, equipment and a medium, which can improve the effectiveness of doorbell reminding.
In one aspect, an embodiment of the present application provides a data processing method, including:
when the doorbell equipment detects a first object, object detail information corresponding to the first object is collected through the doorbell equipment;
object identification processing is carried out on the object detail information according to preset object information associated with doorbell equipment, so that an object type of a first object is obtained;
The method comprises the steps of sending an object type of a first object to a wearable device, so that the wearable device determines object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with doorbell equipment; the object prompt parameter information is used for driving the wearable device to notify the second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information.
In one aspect, an embodiment of the present application provides a data processing method, including:
receiving an object type of a first object; the object type of the first object is obtained by carrying out object identification processing on object detail information corresponding to the first object according to preset object information associated with doorbell equipment, and the first object is an object detected by the doorbell equipment;
in a haptic cue encoding strategy associated with a doorbell device, determining object cue parameter information that matches an object type of a first object; different object types correspond to different object prompt parameter information;
and driving the wearable device to notify the second object of the object type of the first object in a tactile form according to the object prompt parameter information.
An aspect of an embodiment of the present application provides a data processing apparatus, including:
The information acquisition unit is used for acquiring object detail information corresponding to the first object through the doorbell equipment when the doorbell equipment detects the first object;
the object type identification unit is used for carrying out object identification processing on the object detail information according to preset object information associated with the doorbell equipment to obtain an object type of the first object;
the object type sending unit is used for sending the object type of the first object to the wearable device so that the wearable device can determine object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with the doorbell device; the object prompt parameter information is used for driving the wearable device to notify the second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information.
Wherein the apparatus further comprises:
a detection mode acquisition unit configured to acquire M object detection modes in an on state in the doorbell device, and acquire a detection range of each of the M object detection modes; m is a positive integer;
and the object detection unit is used for determining that the doorbell device detects the first object if the first object is sensed in the detection range of any one of the M object detection modes, and determining the object detection mode in which the first object is sensed as the target detection mode.
Wherein the apparatus further comprises:
a detection mode acquisition unit configured to acquire M object detection modes in an on state in the doorbell device, and acquire a detection range of each of the M object detection modes; m is a positive integer;
a detection priority acquiring unit, configured to acquire detection priorities corresponding to the M object detection modes, determine a detection order corresponding to the M object detection modes according to the detection priorities, and perform object detection within a detection range of the M object detection modes according to the detection order;
the object detection unit is further configured to determine that the doorbell device detects the first object if the first object is sensed within a detection range of a target detection mode included in the M object detection modes.
The information acquisition unit is specifically used for:
when the doorbell equipment detects a first object, a target detection mode corresponding to the first object is sent to the wearable equipment, so that the wearable equipment determines mode prompt parameter information matched with the target detection mode in a touch prompt coding strategy associated with the doorbell equipment; the mode prompting parameter information is used for driving the wearable device to inform the second object of the target detection mode in a tactile mode; different object detection modes correspond to different mode prompt parameter information;
And starting an information acquisition function for the doorbell equipment, and acquiring object detail information corresponding to the first object through the started information acquisition function in the doorbell equipment.
The information acquisition unit acquires object detail information corresponding to a first object through an opened information acquisition function in doorbell equipment, and comprises:
if the started information acquisition function in the doorbell equipment comprises a short-distance wireless communication function, notifying a first object to start the short-distance wireless communication function through the doorbell equipment;
if the started short-distance wireless communication function in the doorbell device is successfully matched with the short-distance wireless communication function started by the first object, acquiring object identification information corresponding to the first object based on the short-distance wireless communication function, and determining the object identification information as object detail information corresponding to the first object.
The information acquisition unit acquires object detail information corresponding to a first object through an opened information acquisition function in doorbell equipment, and comprises:
if the opened information acquisition function in the doorbell equipment comprises a biological feature acquisition function, acquiring a target biological feature corresponding to the first object through the opened biological feature acquisition function in the doorbell equipment, and determining the target biological feature as object detail information corresponding to the first object.
The object type identifying unit is specifically configured to:
acquiring preset object information stored in a database corresponding to doorbell equipment;
if the preset object information contains object detail information, determining the object type of the object detail information in the preset object information as the object type of the first object;
and if the preset object information does not contain the object detail information, determining the object type of the first object as a strange type.
Wherein the object type identification unit determines the object type of the object detail information in the preset object information as the object type of the first object, and comprises:
if the object type of the object detail information in the preset object information is an intimate type, determining the object type of the first object as the intimate type;
if the object type of the object detail information in the preset object information is a service type, determining the object type of the first object as the service type;
and if the object type of the object detail information in the preset object information is a blacklist, determining the object type of the first object as the blacklist.
Wherein the apparatus further comprises:
the fault type determining unit is used for acquiring a fault type corresponding to the system fault in the doorbell device if the system fault of the doorbell device is detected;
The fault type sending unit is used for sending the fault type to the wearable equipment so that the wearable equipment can determine system prompt parameter information matched with the fault type in a touch prompt coding strategy associated with the doorbell equipment; the system prompt parameter information is used for driving the wearable device to notify the second object of the fault type of the doorbell device in a tactile mode; different fault types correspond to different system prompt parameter information.
An aspect of an embodiment of the present application provides a data processing apparatus, including:
an object type receiving unit for receiving an object type of the first object; the object type of the first object is obtained by carrying out object identification processing on object detail information corresponding to the first object according to preset object information associated with doorbell equipment, and the first object is an object detected by the doorbell equipment;
the parameter information determining unit is used for determining object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with the doorbell equipment; different object types correspond to different object prompt parameter information;
and the object prompting unit is used for driving the wearable device to notify the second object of the object type of the first object in a tactile form according to the object prompting parameter information.
Wherein the haptic form comprises a vibrotactile form;
the object prompting unit is specifically configured to:
and generating a vibration coding file according to the object prompt parameter information, and driving vibration hardware in the wearable device to inform the second object of the object type of the first object in a vibration touch mode according to the vibration coding file.
Wherein the apparatus further comprises:
the unlocking instruction generating unit is used for responding to the interactive operation in the wearable equipment and generating a door lock unlocking instruction according to the interactive operation if the object prompting parameter information is the prompting parameter information corresponding to the service type;
and the door lock unlocking unit is used for sending a door lock unlocking instruction to the doorbell equipment so that the doorbell equipment can unlock the door lock for the first object based on the door lock unlocking instruction.
An aspect of the embodiments of the present application provides a computer device, including a memory and a processor, where the memory is connected to the processor, and the memory is used to store a computer program, and the processor is used to call the computer program, so that the computer device performs the method provided in the foregoing aspect of the embodiments of the present application.
An aspect of the present application provides a computer readable storage medium, in which a computer program is stored, the computer program being adapted to be loaded and executed by a processor, to cause a computer device having a processor to perform the method provided in the above aspect of the embodiments of the present application.
According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the method provided in the above aspect.
In the embodiment of the application, when the doorbell device detects the first object, object detail information corresponding to the first object can be acquired through the doorbell device; and then the object identification processing can be carried out on the collected object detail information according to the preset object information associated with the doorbell equipment, so as to obtain the object type of the first object, and further the identification accuracy of the first object (the first object can be a visiting object). The object type of the first object may be sent to a wearable device, which determines object hint parameter information that matches the object type of the first object in a haptic hint encoding policy associated with the doorbell device; the object prompt parameter information may be used to drive the wearable device to notify the second object of the object type of the first object in a tactile form, and different object types may correspond to different object prompt parameter information. Through linkage doorbell equipment and wearable equipment, when detecting first object, can be through the touch-sense suggestion ability of wearable equipment direct to the object type of second object warning first object, make the second object can both in time accurately learn the information of visiting object under any environment, can improve the validity that the doorbell was reminded.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a network architecture according to an embodiment of the present application;
fig. 2 is a schematic architecture diagram of a doorbell reminding system according to an embodiment of the present application;
FIG. 3 is a schematic flow chart of a data processing method according to an embodiment of the present application;
fig. 4 is a schematic diagram of a doorbell reminding scenario provided in an embodiment of the present application;
FIG. 5 is a timing diagram of a data processing method according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of an object type identification process of a first object according to an embodiment of the present application;
fig. 7 is a schematic diagram of doorbell reminding flow based on a wearable device according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;
FIG. 9 is a schematic diagram II of a data processing apparatus according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a network architecture provided in an embodiment of the present application, where the network architecture may include a server 10a, a doorbell device 10b, a mobile terminal device 10c, and a wearable device 10d, and the mobile terminal device 10c in the network architecture may refer to other mobile terminals except the wearable device. It will be appreciated that if the wearable device 10d has related functions (application use function, voice interaction function, video interaction function, etc.) in the mobile terminal device 10c, the network architecture may not include the mobile terminal device 10c; if the wearable device 10d does not have the above-mentioned functions in the mobile terminal device 10c, the network architecture may include both the wearable device 10d and the mobile terminal device 10c; in addition, the number of servers, doorbell devices, mobile terminal devices, and wearable devices in the network architecture shown in fig. 1 may be one or more, which is not limited in this application.
As shown in fig. 1, the network architecture specifically includes a server 10a, a doorbell device 10b, a mobile terminal device 10c, and a wearable device 10d, for example. The server 10a may be network connected to the doorbell device 10b so that the doorbell device 10b may interact with the server 10a via the network connection; the mobile terminal device 10c and the wearable device 10d can be connected with the doorbell device 10b through a network, so that the mobile terminal device 10c and the wearable device 10d can be connected with the doorbell device 10b through the network connection.
The server 10a shown in fig. 1 may be a background server corresponding to the doorbell device 10b, where the server 10a may be an independent physical server, may be a server cluster or a distributed system formed by a plurality of physical servers, or may be a cloud server that provides cloud services, a cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, a content distribution network (Content Delivery Network, CDN), and basic cloud computing services such as big data and an artificial intelligent platform, where the type of the server is not limited in this application.
The doorbell device 10b shown in fig. 1 may be used to actively detect whether there is a visiting object (which may also be referred to as a visiting person, or a visitor), including a visiting object that actively triggers a doorbell and a visiting object that is automatically detected (e.g., the doorbell is not triggered, but rather the doorbell device detects the visiting object by means of footfall, voice, image, infrared sensing recognition, etc.). The doorbell device 10b may be used to identify the object type of the visiting object and to inform the wearable device 10d of the object type of the visiting object, so that the object type of the visiting object is informed to the visited object by the wearable device 10 d.
The wearable device 10d shown in fig. 1 may be configured to receive information such as an object type of the visiting object identified by the doorbell device 10b, and alert the visited object in a tactile manner; meanwhile, the method can also interact with other intelligent terminals (such as the mobile terminal device 10c shown in fig. 1), and provides richer interaction operations for the accessed objects. Tactile forms according to embodiments of the present application may include, but are not limited to, at least one of: vibrotactile forms, electrotactile forms, gravitational tactile forms, and the like. The vibration touch form refers to that the wearable device 10d reminds the visited object in the output form of a vibration signal, and the touch of the visited object can sense the vibration signal; similarly, the electrotactile form refers to that the wearable device 10d alerts the visited object in the output form of a current signal, the touch of which can be perceived by the visited object; the gravity touch form means that the wearable device 10d alerts the visited object in the output form of a gravity signal, and the touch of the visited object can sense the gravity signal. It is understood that the wearable device 10d may include, but is not limited to: AR (Augmented Reality), augmented Reality)/VR (Virtual Reality)/MR (Mixed Reality) head-mounted integrated machine, intelligent audio glasses, bluetooth headset, wearable speaker, intelligent watch, intelligent bracelet, intelligent ring, intelligent clothes, intelligent sports shoes and the like, the application does not limit the type of wearable equipment.
The mobile terminal device 10c shown in fig. 1 may be connected to the doorbell device 10b for providing richer and more convenient functions than the wearable device 10d instead of the doorbell control terminal in a fixed position, for example, viewing images or videos acquired by the doorbell device 10b, voice interaction with visiting objects through the doorbell device 10b, or direct manipulation of door lock opening, etc. The mobile terminal device 10c may include, but is not limited to: smart phones, tablet computers, notebook computers, palm computers, mobile internet devices (mobile internet device, MID), etc. It will be appreciated that the mobile terminal device 10c as shown in fig. 1 may be equipped with an application client for managing the doorbell device 10 b.
Referring to fig. 2, fig. 2 is a schematic architecture diagram of a doorbell reminding system according to an embodiment of the present application; the doorbell reminder system may include, but is not limited to, the following: server, doorbell device, wearable device, mobile terminal device, etc. The server shown in fig. 2 may be the server 10a in the network architecture shown in fig. 1, the doorbell device shown in fig. 2 may be the doorbell device 10b in the network architecture shown in fig. 1, the mobile terminal device shown in fig. 2 may be the mobile terminal device 10c in the network architecture shown in fig. 1, and the wearable device shown in fig. 2 may be the wearable device 10d in the network architecture shown in fig. 1. Wherein:
The server shown in fig. 2 may include, but is not limited to, an authentication module, a communication module, a database, and the like. The authentication module in the server can receive the request of the doorbell equipment through the communication module in the server, and perform authentication and confirmation of authentication information on short-distance wireless communication, so that the authenticity of the information is ensured, and the identity falsification of a visiting object is prevented. The communication module in the server can communicate with the doorbell device, receive and send related network communication packets, process and forward corresponding requests to corresponding modules, such as the authentication module in the server can forward the biological characteristics of the access object, short-distance wireless communication and the like. The database in the server may be used to store setting information of the holding object of the doorbell device, such as the biometric characteristics of the visiting object, etc. Short-range wireless communications to which embodiments of the present application relate may include, but are not limited to, bluetooth communications, NFC (Near Field Communication, near field communications), etc.; the biological features according to embodiments of the present application may include, but are not limited to: fingerprint information, voice data, face data, voiceprint information, palmprint information, iris information, and the like.
The doorbell device shown in fig. 2 may include, but is not limited to, an active detection module, an object recognition module, a system event processing module, and a communication module. The active detection module in the doorbell device can be used for actively detecting whether a visiting object exists, wherein the visiting object comprises an object of an active trigger doorbell, an object actively detected through footstep sound, voice, infrared induction, images and the like acquired by the doorbell device, and the like. The object recognition module in the doorbell device can recognize detailed object information (which can be called object detail information) of the visiting object after the active detection module detects the visiting object, the object detail information can comprise information such as biological characteristics, verification information and the like, and the object type of the visiting object is determined (namely the identity of the visiting object is determined) by comparing the object detail information with preset object information stored in the doorbell device or a server; it can be understood that the verification information in the object detail information can be obtained through the encrypted information of short-distance wireless communication, the data verification can be performed through the server, and the object type of the visiting object can be determined; after the object type of the visiting object is identified through the object identification module in the doorbell device, the communication module of the doorbell device can inform the wearable device to remind the visited object. The communication module in the doorbell device can carry out network communication logic processing with the server, the wearable device and the mobile terminal device. The system event processing module in the doorbell device can detect the state of each software/hardware module of the doorbell system, and when any one of the software/hardware modules is abnormal, the communication module in the doorbell device can be used for sending a prompt to the wearable device to prompt related objects (such as a visited object or a close contact of the visited object) for processing.
The wearable device shown in fig. 2 may include, but is not limited to, a tactile cue coding module, a tactile cue driving module, a communication module, and the like. The communication module in the wearable device can be used for processing network communication logic between the door bell device. The haptic cue coding module in the wearable device can receive various reminding information issued by the communication module in the wearable device, and generate haptic cue coding files (which can be determined by haptic cue parameter information such as haptic cue frequency, haptic cue intensity, haptic cue duration and the like) corresponding to different types of reminding information according to a preset haptic cue coding strategy; for example, different object types may correspond to different tactile cue code files, different software/hardware exception types may correspond to different tactile cue code files, different ways of detecting visiting objects may correspond to different tactile cue code files, etc., the tactile cue code strategy described in detail in the following steps. The haptic cue driver module in the wearable device may receive the haptic cue code file of the haptic cue code module and drive haptic cue hardware in the wearable device to perform an actual haptic cue based on the received haptic cue code file.
The mobile terminal device shown in fig. 2 may include a voice interaction module, a system device module, a communication module, and the like. The communication module in the mobile terminal device can be used for processing network communication logic between the door bell device. The voice interaction module in the mobile terminal equipment can establish a bidirectional voice channel through the communication module in the mobile terminal equipment and the doorbell equipment so as to facilitate voice communication between the visited object and the visiting object. The system setting module in the mobile terminal device may be used to mark the object type of the visiting object and store the object type of the visiting object in the server.
It can be understood that the server, the doorbell device, the mobile terminal device, and the wearable device shown in fig. 2 may each include a communication module, through which network communication logic between different devices may be implemented. If the doorbell device includes the aforementioned active detection module, the object identification module, the communication module, and the system event processing module, and further includes the aforementioned database and the authentication module mentioned by the server, the doorbell reminding system may include only the doorbell device, the wearable device, and the mobile terminal device. If the wearable device includes the voice interaction module and the system device module mentioned by the mobile terminal device in addition to the haptic alert encoding module, the haptic alert driving module, and the communication module, the doorbell alert system may include only the server, the doorbell device, and the wearable device; the doorbell reminding system according to the embodiment of the present application may determine the number of devices and the types of devices according to actual needs and functions of the devices used, which is not limited in this application.
According to the method and the device, the reminding function of the doorbell equipment can be assisted through the haptic reminding function of the wearable equipment, the problem that a visited object with limited audio receiving capacity cannot hear audio is solved, the advantages that the wearable equipment is carried along and the haptic reminding is not interfered by the environment can be fully exerted, the information of a visiting object is transferred more timely and not missed, and the effectiveness of doorbell reminding can be improved; meanwhile, through the linkage between the mobile terminal equipment and the doorbell equipment, the characteristics of answering and moving of the functions of the mobile equipment are fully exerted, the visited personnel can conveniently interact with the doorbell equipment without reaching a fixed position, the interactivity of the doorbell equipment can be improved, and the convenience of the visited personnel can be further improved.
Referring to fig. 3, fig. 3 is a flow chart of a data processing method according to an embodiment of the present application. It will be appreciated that the data processing method may be performed by a doorbell device 10b in the network architecture shown in fig. 1. The data processing method may include the following steps S101 to S103:
step S101, when the doorbell device detects a first object, object detail information corresponding to the first object is collected through the doorbell device.
Specifically, in the doorbell reminding scene, whether a visiting object exists or not can be actively detected through the doorbell device, and for convenience of understanding, the visiting object can be called a first object, and the visited object is called a second object. If the doorbell equipment detects the first object, namely when the visiting object is detected, the information acquisition function can be started for the doorbell equipment, and object detail information corresponding to the first object can be acquired through the started information acquisition function in the doorbell equipment. The information collection function integrated by the doorbell device can comprise, but is not limited to, a short-distance wireless communication function, a biological characteristic collection function and the like; short-range wireless communication functions may include, but are not limited to, one or more of the following communication technologies: bluetooth, NFC, wiFi (Wireless Fidelity ), etc., the biometric acquisition function may include, but is not limited to, one or more of the following: fingerprint collection, image collection, iris collection, palm print collection, voice collection, voiceprint collection and the like. The object detail information may be object identification information of the first object, such as a radio frequency identification tag carried by a special device used by the first object, or information that may be used to identify the identity of the first object, such as work card information of the first object; or the object detail information may be a target biological feature of the first object, such as at least one of fingerprint information, voiceprint information, face information, iris information, palmprint information, voice information, and the like of the first object.
It can be understood that the doorbell device can adopt different object detection modes to detect whether the first object exists outside the door, that is, the doorbell device can integrate multiple object detection modes to realize the detection process of the first object, and the integrated multiple object detection modes can be associated with two states, namely an on state and an off state; the object detection mode in the on state may be used to detect whether the first object is present or not, and the object detection mode in the off state is temporarily incapable of object detection. Specifically, the detection process of the first object may include: acquiring M object detection modes in an on state in doorbell equipment, and acquiring a detection range of each object detection mode in the M object detection modes, wherein M is a positive integer, and if M can be 1,2 and … …; if the first object is sensed in the detection range of any one of the M object detection modes, the doorbell device is determined to successfully detect the first object, and the object detection mode in which the first object is sensed is determined to be the target detection mode.
Wherein the M object detection modes may include, but are not limited to, one or more of the following: modes such as initiative triggering doorbell, footstep sound detection, infrared induction detection, image detection and the like; different object detection modes can correspond to different detection ranges, and when any one of the object detection modes in an on state integrated by the doorbell device senses any object in the detection range, the doorbell device can be determined to successfully detect the first object. For example, the detection range of the active trigger doorbell mode may be considered as a doorbell key integrated with the trigger doorbell device; when an object actively presses a doorbell button, the first object is successfully detected by adopting an active trigger doorbell mode, and the active trigger doorbell mode at the moment can be called a target detection mode.
The detection range of the step sound detection mode may be a fixed sector area right in front of the doorbell device (for convenience of understanding, the fixed sector area herein may be referred to as a first fixed sector area), where the first fixed sector area may be a sector area with an angle of 90 degrees and a distance of 1.5 meters right in front of the doorbell device, or may be a sector area with an angle of 180 degrees and a distance of 1.5 meters right in front of the doorbell device, or may be other areas set according to actual requirements of an application scenario, which is not limited in this application. If the step sound detection mode is in the on state, if the step sound of the pedestrian is detected in the first fixed sector area of the step sound detection mode, the step sound detection mode indicates that the first object is successfully detected, and the step sound detection mode at this time may be referred to as a target detection mode.
The detection range of the sound detection mode may be a fixed sector area right in front of the doorbell device (for ease of understanding, the fixed sector area may be referred to as a second fixed sector area), and the sound detection mode may be preset with a decibel threshold; the second fixed sector area may be a sector area with an angle of 180 degrees and a distance of 1.5 meters right in front of the doorbell, or may be other areas set according to actual requirements of an application scene, where the decibel threshold may be set to 40 decibels, or may be set to other decibel values, which is not limited in this application. In the case that the sound detection mode is in the on state, if any sound is detected in the second fixed sector area of the sound detection mode and the detected sound db is greater than or equal to the preset db threshold (e.g., 40 db as described above), the sound detection mode indicates that the first object is successfully detected by using the sound detection mode, and the sound detection mode at this time may be referred to as the target detection mode.
The detection range of the infrared sensing detection mode may be an infrared sensing area covered by the doorbell device. If any object is sensed in the infrared sensing area covered by the doorbell device under the condition that the infrared sensing mode is in the on state, the first object is successfully detected by using the infrared sensing mode, and the infrared sensing mode at this time may be referred to as a target detection mode.
The detection range of the image detection mode may be a shooting range covered by a camera integrated in the doorbell device. In the case where the image detection mode is in the on state, if a face image is acquired in a shooting area covered by a camera of the doorbell device, it indicates that the first object is successfully detected in the image detection mode, and the image detection mode at this time may be referred to as a target detection mode.
In one or more embodiments, the detecting of the first object may further include: acquiring M object detection modes in an on state in doorbell equipment, and acquiring a detection range of each object detection mode in the M object detection modes, wherein M is a positive integer; acquiring detection priorities corresponding to the M object detection modes, determining detection sequences corresponding to the M object detection modes according to the detection priorities, and performing object detection in the detection ranges of the M object detection modes according to the detection sequences; if the first object is sensed within the detection range of the target detection mode included in the M object detection modes, determining that the doorbell device detects the first object. It will be appreciated that the detection priorities may be preset for all object detection modes integrated in the doorbell device, and that the detection priorities corresponding to these object detection modes may be stored in the doorbell device or in a server corresponding to the doorbell device (e.g., a server in a doorbell reminder system as shown in fig. 2). Among the M object detection modes in the on state, the object detection mode with the highest detection priority may be preferentially adopted to perform object detection, while the object detection modes with other detection priorities may be temporarily in a standby state, i.e. the higher the detection priority is, the earlier the detection order of the object detection mode in the on state is; the object detection is sequentially carried out according to the detection sequence until the first object is successfully detected, so that when the doorbell device carries out object detection, only one object detection mode in an on state is in a normal working state, the situation that multiple object detection modes simultaneously carry out object detection can be avoided, and the loss of the doorbell device can be reduced.
For example, it is assumed that all object detection modes integrated in the doorbell device include the aforementioned active trigger doorbell mode, step sound detection mode, infrared induction detection mode, and image detection mode, and the detection priority of the active trigger doorbell mode is higher than that of the infrared induction detection mode, the detection priority of the infrared induction detection mode is higher than that of the image detection mode, the detection priority of the image detection mode is higher than that of the step sound detection mode, and the detection priority of the step sound detection mode is higher than that of the sound detection mode. If the object detection mode in the on state in the doorbell device includes an active trigger doorbell mode and an image detection mode, the doorbell device can actively detect whether an object actively triggers a doorbell button on the doorbell device or not because the detection priority of the active trigger doorbell mode is higher than that of the image detection mode, and if the object actively triggers the doorbell button on the doorbell device, the first object is detected through the active trigger doorbell mode, and the active trigger doorbell mode at this time can be referred to as a target detection mode. If the residence time of the object in front of the doorbell device is sensed to exceed the time threshold and the doorbell is not actively triggered, an image detection mode can be adopted to detect the object, for example, the image data of the object is collected through a camera integrated with the doorbell device, if the collected image data is the face data of the object, the first object is successfully detected through the image detection mode, and the image detection mode at this time can be called as a target detection mode.
Step S102, object identification processing is carried out on the object detail information according to preset object information associated with doorbell equipment, and the object type of the first object is obtained.
Specifically, after object detail information corresponding to the first object is collected through the doorbell device, preset object information stored in a database corresponding to the doorbell device can be obtained, and then the object type of the first object can be identified by comparing the object detail information corresponding to the first object with the preset object information. In other words, the object detail information may be matched with preset object information, and the object type of the first object may be determined based on the matching result; for example, if the preset object information includes the object detail information of the first object, the object type of the object detail information in the preset object information may be determined as the object type of the first object; if the preset object information does not contain the object detail information of the first object, the object type of the first object can be determined as a strange type. The preset object information may refer to object information of a visiting object acquired by the doorbell device, such as a biological feature of a previous visiting object, or object identification information of a previous visiting object; the preset object information may be stored in a database of the doorbell device or may be stored in a database of a server with which the doorbell device is associated (e.g., a server in a doorbell reminder system as shown in fig. 2).
Optionally, the determining the object type of the object detail information of the first object in the preset object information may include: if the object type of the object detail information in the preset object information is an intimate type, determining the object type of the first object as the intimate type; if the object type of the object detail information in the preset object information is a service type, determining the object type of the first object as the service type; and if the object type of the object detail information in the preset object information is a blacklist, determining the object type of the first object as the blacklist. The intimacy type can comprise family, friends and the like, and the service type comprises professionals such as express delivery, takeaway and the like, and public service personnel such as water, electricity and gas service personnel, community staff, medical staff and the like.
It is to be appreciated that embodiments of the present application may divide a visit object into a plurality of object types, where the object types may include, but are not limited to, one or more of the following object types: family members (family members), friends, blacklist members, couriers, takeaway, public service personnel, strangers (i.e., the aforementioned stranger types), etc. of the object being visited. Wherein:
(1) Family members, i.e. family members of the visited objects, can usually collect biological characteristics of family members in advance through doorbell equipment, and a first object belonging to family types can be obtained through biological characteristic recognition of fingerprint information, facial images, iris information, voiceprint information and the like.
(2) Friends, i.e. friends of the object to be visited, are usually frequent or once visited objects, and the first object belonging to the friend type can be obtained by biological feature recognition of fingerprint information, facial image, iris information, voiceprint information, etc. collected in the past.
(3) The blacklist member is typically an object that has been visited, but the object may not welcome the object, and thus the object may be set as the blacklist member. In other words, a blacklist member may refer to an object that is not popular with the visited object.
(4) Express delivery and takeaway personnel, usually professionals, can register in related systems (such as express delivery personnel systems, takeaway personnel systems and the like) in advance through obtaining object identification information (such as work card information and the like of visiting objects) of visiting objects through a short-range wireless communication function, and a first object belonging to the express delivery and takeaway personnel types can be obtained through doorbell equipment encryption identification. It can be understood that the doorbell device can obtain the read permission of the object identification information corresponding to the express delivery personnel and the takeaway personnel in advance, for example, the permission of the express delivery personnel, the takeaway personnel or the enterprise in which the express delivery personnel and the takeaway personnel are located can be obtained in advance. Optionally, when the first object belonging to the express delivery and takeaway personnel types is visited, if the visited object is inconvenient to open the door, the first object can be guided by voice communication to realize contactless delivery.
(5) Public service personnel can include, but are not limited to, water, electricity and gas service personnel, community staff or medical workers and the like, and a first object belonging to the type of the public service personnel can conduct object type identification processing through a short-range wireless communication function. Compared with the express delivery personnel and takeaway personnel, the public service personnel generally need to open the door of the visited object to enter the room to provide corresponding services.
(6) The stranger may determine the object type of the first object, which is not within the range of the foregoing (1) to (5), as a strange type, that is, the first object is an object that the accessed object does not recognize. The object to be accessed can determine the actual type of the first object by looking at the image data, video data and communicating by voice of the first object.
Step S103, the object type of the first object is sent to the wearable device, so that the wearable device determines object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with the doorbell device; the object prompt parameter information is used for driving the wearable device to notify the second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information.
Specifically, after identifying the object type of the first object, the doorbell device may send the object type of the first object to the wearable device. The wearable device can receive the object type of the first object notified by the doorbell device, and determine object prompt parameter information matched with the object type of the first object in a haptic prompt coding strategy associated with the doorbell device; and then the wearable device can be driven to notify the second object (the accessed object) of the object type of the first object in a tactile manner according to the object prompting parameter information. In other words, the object hint parameter information that matches the object type of the first object, i.e. the haptic hint code that matches the object type of the first object, may be looked up from a pre-designed haptic hint code strategy.
It will be appreciated that different object types may correspond to different object hint parameter information in a haptic hint encoding policy, where the haptic hint encoding policy may include haptic encoding of different types of hint messages, e.g., the haptic hint encoding policy may include predefining a matching haptic hint encoding for each object type, predefining a matching haptic hint encoding for each anomaly type of software/hardware module, predefining a matching haptic hint encoding for each object detection mode integrated with a doorbell device, etc., which is not limited in this application.
The haptic cue codes in the haptic cue code strategy can correspond to different cue parameter information, and the cue parameter information can comprise dimensional information such as haptic cue frequency, haptic cue intensity, haptic cue duration and the like; that is, the haptic cue encoding policy associated with the doorbell device may be previously encoded with dimensional information such as the haptic cue frequency, the haptic cue intensity, and the haptic cue duration, and stored in the doorbell device.
The haptic cue coding strategy may be a vibrotactile cue coding strategy, or may be an electrotactile cue coding strategy, or may be a gravity haptic cue coding strategy, or the like, which is not limited in this application. After receiving the notification message (such as the object type of the first object) issued by the doorbell device, the wearable device can find the haptic cue code matched with the first object from the haptic cue code strategy, and further can transmit different information (such as the object type of the first object, the fault type in the doorbell device and the like) to the second object (the visited object).
Referring to fig. 4, fig. 4 is a schematic diagram of a doorbell reminding scene according to an embodiment of the present application. In the embodiment of the present application, the touch form is described as a vibrotactile form, as shown in fig. 4, when the doorbell device 20b detects that the first object 20a actively triggers a doorbell button in the doorbell device 20b, the doorbell device 20b may collect object detail information corresponding to the first object 20a, and further may determine an object type of the first object 20a (for example, a family member of the second object 20 e) by comparing preset object information with the object detail information corresponding to the first object 20 a. The doorbell device 20b may send the object type of the first object 20a to the wearable device 20d, the wearable device 20d may determine, in a pre-designed vibrotactile alert encoding policy, vibration parameter information that matches the object type of the first object 20a after receiving the object type of the first object 20a sent by the doorbell device 20b, may generate a vibration encoding file based on the matched vibration parameter information, may drive the vibration hardware in the wearable device 20d to actually vibrate according to the vibration encoding file, and the second object 20e may perceive the object type of the first object 20a according to the vibration form of the wearable device 20 d.
Alternatively, after the second object 20e senses the object type of the first object 20a through the vibration form of the wearable device 20d, it may be decided whether the door 20c needs to be opened for the first object 20 a. If the second object 20e wants to open the door for the first object 20a, but it is currently inconvenient to walk to the front of the door to open the door manually, the second object 20e may use the mobile terminal device 20f to enter the display interface 20g associated with the doorbell device 20 b. The face image of the first object 20a acquired by the doorbell device 20b, and a door opening control can be presented in the display interface 20 g; when the second object 20e performs a triggering operation on the door opening control in the display interface 20g, the mobile terminal device 20f may generate a door lock opening instruction in response to the triggering operation on the door opening control in the display interface 20g, and send the door lock opening instruction to the doorbell device 20b, where the door lock opening instruction is used to instruct to open the door 20c, so that the first object 20a may enter the room through the opened door 20c.
In the embodiment of the application, when the doorbell device detects the first object, object detail information corresponding to the first object can be acquired through the doorbell device; and then the object identification processing can be carried out on the collected object detail information according to the preset object information associated with the doorbell equipment, so as to obtain the object type of the first object, and further the identification accuracy of the first object (the first object can be a visiting object). The object type of the first object may be sent to a wearable device, which determines object hint parameter information that matches the object type of the first object in a haptic hint encoding policy associated with the doorbell device; the object prompt parameter information may be used to drive the wearable device to notify the second object of the object type of the first object in a tactile form, and different object types may correspond to different object prompt parameter information. Through linkage doorbell equipment and wearable equipment, when detecting first object, can be through the touch-sense suggestion ability of wearable equipment direct to the object type of second object warning first object, make the second object can both in time accurately learn the information of visiting object under any environment, can improve the validity that the doorbell was reminded.
Referring to fig. 5, fig. 5 is a timing diagram of a data processing method according to an embodiment of the present application. It will be appreciated that the data processing method is performed interactively by the doorbell device with the wearable device. The data processing method may include the following steps S201 to S210:
in step S201, when the doorbell device detects a first object, a target detection mode of the first object is transmitted.
Specifically, in the doorbell reminding scene, the doorbell device may actively detect whether a potential visiting object (first object) exists, and if the doorbell device detects the first object in the M object detection modes in the on state, the target detection mode may be sent to the wearable device. The above-mentioned M object detection modes and the detection process of the first object may refer to the related description of step S101 in the embodiment corresponding to fig. 3, which is not described herein.
Step S202, determining mode prompt parameter information matched with a target detection mode in a touch prompt coding strategy associated with doorbell equipment; the mode alert parameter information is used to drive the wearable device to notify the second object of the target detection mode in a tactile form.
Specifically, after the wearable device receives the target detection mode sent by the doorbell device, the haptic cue coding strategy associated with the doorbell device can search for the haptic cue code matched with the target detection mode, namely the mode cue parameter information corresponding to the target detection mode; and driving haptic hardware in the wearable device to carry out haptic reminding according to the mode prompt parameter information corresponding to the target detection mode, and informing the second object doorbell device of the mode of detecting the first object through the haptic reminding of the wearable device. The haptic alert may be a vibration alert, or may be an electrohaptic alert (it should be understood that the current signal used for the point haptic alert herein refers to a safe current that can be perceived by a human body), or may be a gravity haptic alert, etc., which is not limited in this application.
It will be appreciated that the haptic cue coding strategy may include the haptic cue coding of all object detection modes integrated by the doorbell device (including the coding of parameter information such as the haptic cue frequency, the haptic cue intensity, and the haptic cue duration). In the following description, a haptic cue coding strategy is taken as an example of a vibrotactile cue coding strategy, and the haptic cue coding of each object detection mode may be a vibration coding, where the vibration coding may be coded by three dimensions of a vibration frequency (in HZ, abbreviated as HZ, the unit of the foregoing haptic cue frequency is HZ), a vibration intensity (in relative values, i.e., the maximum intensity supported by the wearable device is 100, the minimum intensity is 0,0 to 100 indicates that the vibration intensity is gradually enhanced, the unit of the foregoing haptic cue intensity is the relative value), and a vibration duration (in milliseconds, abbreviated as ms, the unit of the foregoing haptic cue duration is milliseconds); the vibration encoding rules of the various object detection modes in the tactile cue encoding strategy may be as shown in table 1 below:
TABLE 1
Figure SMS_1
The values of the vibration frequency, the vibration intensity, and the vibration duration of the various object detection modes shown in table 1 are merely illustrative of one of the embodiments of the present application, and the present application is not limited thereto. The camera used in the image detection mode may be a camera integrated in the doorbell device, or may be an external camera device capable of performing data interaction with the doorbell device, which is not limited in this application. The infrared sensing device used in the infrared sensing detection mode can be an infrared sensing component integrated in the doorbell device, or can be an external infrared sensing device capable of performing data interaction with the doorbell device, which is not limited in the application.
In one or more embodiments, after receiving the target detection mode of the first object, the wearable device may obtain mode prompt parameter information corresponding to the target detection mode through the vibration encoding rule in table 1. For example, when the target detection mode is an active trigger doorbell mode, the mode prompting parameter information corresponding to the active trigger doorbell mode acquired by table 1 includes: the vibration frequency was 20HZ, the vibration intensity was 40, and the vibration duration was 100 milliseconds. Further, based on the mode prompt parameter information corresponding to the active triggering doorbell mode, the wearable device can trigger vibration with the vibration frequency of 20HZ, the vibration intensity of 40 and the vibration duration of 100 milliseconds; after the second object senses the vibration of the wearable device, the detection mode of the first object can be sensed based on the vibration form of the wearable device.
Step S203, an information acquisition function is started for the doorbell device, and object detail information corresponding to the first object is acquired through the started information acquisition function in the doorbell device.
Specifically, the information acquisition function can be started for the doorbell device, and if the started information acquisition function in the doorbell device comprises the short-distance wireless communication function, the first object can be informed to start the short-distance wireless communication function through the doorbell device; if the started short-distance wireless communication function in the doorbell device is successfully matched with the short-distance wireless communication function started by the first object, the first object passes identity authentication, and object identification information corresponding to the first object can be acquired based on the short-distance wireless communication function, and the object identification information can be determined to be object detail information corresponding to the first object. If the opened information acquisition function in the doorbell equipment comprises a biological feature acquisition function, acquiring a target biological feature corresponding to the first object through the opened biological feature acquisition function in the doorbell equipment, and determining the target biological feature as object detail information corresponding to the first object. The object identification information may include, but is not limited to, a radio frequency identification tag or a device unique tag carried by a special device used by the first object, and information that may be used to identify the identity of the first object, such as work card information of the first object. The target biometric characteristic may be at least one of the aforementioned biometric characteristics of fingerprint information, voiceprint information, facial information, iris information, palmprint information, voice information, and the like.
And step S204, carrying out object identification processing on the object detail information according to preset object information associated with the doorbell equipment to obtain the object type of the first object.
The specific implementation process of step S204 may be referred to the description of step S102 in the embodiment corresponding to fig. 3, and will not be described herein.
Referring to fig. 6, fig. 6 is a schematic diagram of an object type identification process of a first object according to an embodiment of the present application. As shown in fig. 6, the doorbell device may detect arrival information of a new visiting object in real time, e.g., the new visiting object may actively trigger the doorbell, or may set the doorbell device to enable detection capability of the new visiting object when there is other information in the doorway, e.g., at least one of footstep sound, voice, image data (including a face), and infrared signals may be detected by the doorbell device.
After detecting a new visiting object, the doorbell device may then refer to the new visiting object as the first object. NFC can be opened to doorbell equipment to remind first object through doorbell equipment to carry out NFC discernment, if first object opens NFC, can adopt NFC to carry out object identification processing to first object, NFC discernment's process can include: in the NFC identification process, NFC authentication needs to be started for the NFC device used by the first object first, and when the NFC device used by the first object is authenticated and authenticated, NFC identification can be started. It will be appreciated that a first object belonging to the express, takeaway and public service personnel types may typically hold NFC devices.
Optionally, after the doorbell device detects the first object, the doorbell device may turn on bluetooth, and remind the first object to perform bluetooth matching through the doorbell device; in general, the first object may be connected through bluetooth through a terminal device used by the first object, if the first object starts bluetooth matching, bluetooth may be used to perform object identification processing on the first object, and the bluetooth identification process is similar to the foregoing NFC identification process, and first bluetooth authentication needs to be started for the terminal device (with a bluetooth communication function) used by the first object, and when the terminal device used by the first object is authenticated and authenticated, bluetooth identification may be started. It will be appreciated that a first object belonging to the class of couriers, takeaway and public service personnel may typically hold authentication information corresponding to bluetooth identification.
Optionally, after detecting the first object, the doorbell device may start the fingerprint acquisition function and remind the first object to perform fingerprint identification. If the first object inputs fingerprint information in the doorbell device, fingerprint identification processing can be entered; if the first object does not input fingerprint information in the doorbell device and exceeds a duration threshold preset by the doorbell device (for example, the duration threshold may be set to 2 minutes, or may be set to other durations according to actual scene requirements, etc.), the doorbell device may enter a standby state. After the doorbell device collects the fingerprint information (object detail information of the first object) input by the first object, the doorbell device can compare the fingerprint information input by the first object with preset fingerprint information (belonging to preset object information) stored in the doorbell device (or a server); if the fingerprint information input for the first object in the preset fingerprint information is matched with the existing fingerprint information, the object type corresponding to the matched fingerprint information can be acquired, the wearable device is notified of the object type, and the wearable device notifies the second object of the object type of the first object.
Optionally, after the doorbell device detects the first object, if the object type of the first object is not determined by the manners of NFC identification, bluetooth identification, fingerprint identification, and the like, an image acquisition function of the doorbell device may be started; after the image data of the first object is acquired through the image acquisition function, the acquired image data can be identified, and after the human image is identified, the preset object information stored in the doorbell device (or the server) can be compared; if the identified portrait in the preset object information is matched with the existing portrait information, the object type corresponding to the matched portrait information can be acquired, the wearable device is notified of the object type, and the wearable device notifies the second object of the object type of the first object.
It will be appreciated that, after identifying the object type of the first object (new visiting object), the first object may be marked with its corresponding object type; if the object type of the first object is not obtained based on the manners of NFC identification, bluetooth identification, fingerprint identification, image identification and the like, the first object may be marked as a strange type. The doorbell device may inform the wearable device of the object type, and the wearable device informs the second object of the object type of the first object.
In step S205, the object type of the first object is transmitted.
Specifically, after identifying the object type of the first object, the doorbell device may send the object type of the first object to the wearable device, so that the wearable device notifies the second object (the accessed object) of the object type of the first object.
In step S206, in the haptic cue coding policy associated with the doorbell device, object cue parameter information matching the object type of the first object is determined, and different object types correspond to different object cue parameter information.
Step S207, the wearable device is driven to notify the second object of the object type of the first object in a tactile form according to the object prompt parameter information.
Specifically, after the wearable device receives the object type of the first object sent by the doorbell device, the haptic cue coding strategy associated with the doorbell device can search for the haptic cue code matched with the object type of the first object, namely object cue parameter information corresponding to the object type of the first object; and then, the haptic hardware in the wearable device can be driven to carry out haptic reminding according to the object prompt parameter information corresponding to the object type of the first object, and the second object can sense the object type of the first object through the haptic reminding of the wearable device.
It will be appreciated that the haptic cue coding strategy may include haptic cue coding of all object types corresponding to the visiting object. In the following, the haptic cue coding strategy is taken as an example of the vibrotactile cue coding strategy, and the haptic cue coding of various object types can be vibration coding, and at this time, the vibration coding of each object type can be coded by three dimensions of vibration frequency, vibration intensity and vibration duration; among them, vibration encoding rules of various object types in the tactile cue encoding strategy can be seen in the following specific contents in table 2.
It should be noted that the values of the vibration frequency, the vibration intensity, and the vibration duration of the various object types shown in table 2 are only one example of the embodiments of the present application, and specific values of the three dimensions are not limited in the present application. In one or more embodiments, after the wearable device receives the object type of the first object, the object prompt parameter information corresponding to the object type of the first object may be obtained through the vibration encoding rule in table 2. For example, when the object type of the first object is a family type, the determining, in the vibration encoding rule shown in table 2, object prompt parameter information corresponding to the object type of the first object includes: the vibration frequency is 20HZ, the vibration intensity is 80, and the vibration duration is 500ms; further, a vibration encoding file may be generated according to the object prompting parameter information, and the vibration hardware in the wearable device is driven to notify the second object of the object type of the first object in a vibration tactile form according to the vibration encoding file. In other words, based on the object prompt parameter information corresponding to the family type, the wearable device can trigger vibration with a vibration frequency of 20HZ, a vibration intensity of 80 and a vibration duration of 500ms; after the second object senses the vibration of the wearable device, the object type of the first object can be sensed as the family type based on the vibration form of the wearable device. The details in table 2 may be as follows:
TABLE 2
Figure SMS_2
For example, assuming that the doorbell device detects the first object in an actively triggered doorbell mode and the object type of the first object is the express, takeaway person type, the wearable device may trigger two vibrations based on the vibration encoding rules shown in the foregoing tables 1 and 2: a vibration with a vibration frequency of 20HZ, a vibration intensity of 40 and a vibration duration of 100ms, and a vibration with a vibration frequency of 150HZ, a vibration intensity of 80 and a vibration duration of 500ms, the vibration codes of which are described as follows:
{
"Metadata" {// Metadata
"Version": 2,// Version number, integer data type
"Created": "xxxx-xx-xx",// creation time, string type (a String structure form)
"Description": "game graphic",// vibration effect Description, string type
}
"Pattern":// Pattern
[
{
"Event" {// Event
"Position": 0,// indicates the type of vibration used, where the default motor vibration is used, can be overridden by the vibration gesture in cure (a distributed storage system)
"Type": "transaction",// event Type: continuous represents continuous vibration, transient represents brief vibration
"relative time": 0,// relative start time, integer data type in ms
"Duration": 100,// continuous vibration type parameter: duration of vibration, type of data of integer type in ms
"Parameters" {// parameter information
"sensitivity": 40,// vibration Intensity, integer data type, its value range is [0,100].0 represents a minimum vibration intensity value supported by the wearable device, 100 represents a maximum vibration intensity value supported by the wearable device
"Frequency": 20,// vibration Frequency, integer data type
}
}
}
{
"Event": {
"Position": 0,// indicates the type of vibration used, where default motor vibration is used
"Type": "transaction",// event Type: continuous represents continuous vibration, transient represents brief vibration
"relative time": 500,// relative start time, integer data type in ms
"Parameters" {// parameter information
"integrity" 80,// vibration Intensity, integer data type, its value range is [0,100],0 represents the minimum vibration Intensity value supported by the wearable device, 100 represents the maximum vibration Intensity value supported by the wearable device
"Frequency": 150,// vibration Frequency, integer data type
}
}
}
]
}
Step S208, if the doorbell device is detected to have a system fault, the fault type corresponding to the system fault in the doorbell device is obtained.
Specifically, the doorbell device can also perform system detection, and if the doorbell device is detected to have a system fault, the fault type corresponding to the system fault in the doorbell device can be obtained. Wherein the fault type may be considered as exception information for a software/hardware module in the doorbell reminder system, which may include, but is not limited to, one or more of the following system faults: insufficient electric quantity, NFC function abnormality, fingerprint acquisition function abnormality, camera abnormality, bluetooth module abnormality and other function abnormality.
Step S209, the fault type is sent.
Specifically, after detecting a fault type of a system fault existing in the doorbell device, the fault type may be sent to the wearable device.
Step S210, determining system prompt parameter information matched with the fault type in a touch prompt coding strategy associated with doorbell equipment; the system prompt parameter information is used for driving the wearable device to notify the second object of the fault type of the doorbell device in a tactile mode.
Specifically, after the wearable device receives the fault type sent by the doorbell device, the haptic cue coding strategy associated with the doorbell device can search the haptic cue coding matched with the fault type, namely the system cue parameter information corresponding to the fault type; and driving haptic hardware in the wearable equipment to carry out haptic reminding according to the system prompt parameter information corresponding to the fault type, and informing the fault type existing in the second object doorbell equipment through the haptic reminding of the wearable equipment.
It will be appreciated that all system fault type haptic cue codes that may be included in the haptic cue code strategy. In the following, the haptic cue coding strategy is taken as an example of the vibrotactile cue coding strategy, and the haptic cue coding of various system fault types can be vibration coding, and at this time, the vibration coding of each system fault type can also be coded by three dimensions of vibration frequency, vibration intensity and vibration duration; among them, vibration encoding rules of various system failure types in the tactile cue encoding strategy can be seen in the following specific contents in table 3.
It should be noted that the values of the vibration frequency, the vibration intensity, and the vibration duration of the various fault types shown in table 3 are only one example of the embodiments of the present application, and specific values of the three dimensions are not limited in the present application. In one or more embodiments, after the wearable device receives the fault type, system prompt parameter information corresponding to the fault type may be obtained through the vibration encoding rule in table 3. For example, when the fault type is insufficient electric quantity, the system prompting parameter information corresponding to the insufficient electric quantity can be determined in the vibration coding rule shown in table 3, where the system prompting parameter information includes: the vibration frequency is 20HZ, the vibration intensity is 60, and the vibration duration is 200ms; further, based on system prompt parameter information corresponding to insufficient electric quantity, the wearable device can trigger vibration with the vibration frequency of 20HZ, the vibration intensity of 60 and the vibration duration of 200ms; after the second object senses the vibration of the wearable device, the doorbell device can be sensed to have insufficient electric quantity based on the vibration form of the wearable device. The details in table 3 may be as follows:
TABLE 3 Table 3
Figure SMS_3
For example, assuming a doorbell device that has insufficient battery power, based on the vibration encoding rules shown in table 3, the wearable device may trigger a vibration with a vibration frequency of 20HZ, a vibration intensity of 60, and a vibration duration of 200ms, the vibration encoding of which is described as follows:
{
"Metadata" {// Metadata
"Version": 2,// Version number, integer data type
"Created": "xxxx-xx-xx",// creation time, string type
"Description" device power too low ",// fault type Description, string type
}
"Pattern":// Pattern
[
{
"Event" {// Event
"Position": 0,// indicates the type of vibration used, where default motor vibration is used
"Type": "transaction",// event Type: continuous represents continuous vibration, transient represents brief vibration
"relative time": 0,// relative start time, integer data type in ms
"Duration": 200,// continuous vibration type parameter: duration of vibration, type of data of integer type in ms
"Parameters" {// parameter information
"integrity" 60,// vibration Intensity, integer data type, its value range is [0,100],0 represents the minimum vibration Intensity value supported by the wearable device, 100 represents the maximum vibration Intensity value supported by the wearable device
"Frequency": 20,// vibration Frequency, integer data type
}
}
}
]
}
In one or more embodiments, if the object prompt parameter information is prompt parameter information corresponding to a service type, responding to an interactive operation in the wearable equipment, and generating a door lock opening instruction according to the interactive operation; and sending a door lock unlocking instruction to the doorbell device so that the doorbell device unlocks the door for the first object based on the door lock unlocking instruction. Wherein for a first object belonging to a service type (including courier, takeaway type and public service type), a second object may interact with the doorbell device using a wearable device (or mobile terminal device), thereby determining whether opening of the door for the first object is required.
Referring to fig. 7, fig. 7 is a schematic diagram of doorbell reminding flow based on a wearable device according to an embodiment of the present application. As shown in fig. 7, the system event detection refers to that the doorbell device is always in a real-time detection state, where the detection may include system abnormality, active visiting of a visiting object, or a potential visiting object (first object) analyzed by other information (such as the above-mentioned footstep sound, image, and infrared sensing information). The system abnormality may be that after detecting that various system fault types shown in table 3 occur in the doorbell device, the doorbell device may notify the wearable device to trigger a corresponding reminding in a tactile form.
The active visiting may refer to that when the visiting object actively triggers the doorbell, the reminding in the touch form of the wearable device can be triggered after the identification logic of the visiting object judges the object type of the visiting object. The system detecting the visiting object may refer to that when the doorbell device detects abnormal information (such as footfall sound, image, infrared sensing information, etc.), object identification processing is performed on the detected visiting object, so as to obtain an object type of the visiting object, and the wearable device is notified to perform reminding in a tactile form.
Triggering the reminder may mean that the wearable device performs vibration encoding and triggers a reminder in a tactile form after receiving various reminder messages of the doorbell device. The object interaction may be that after the second object (the visited object) receives the reminding in the tactile form triggered by the wearable device, the second object may perform corresponding interaction with the doorbell device, for example, closing the reminding or opening the mobile terminal device to view the image information of the visited object, and performing operations such as voice communication or opening the door.
In the embodiment of the application, when the doorbell device detects the first object, object detail information corresponding to the first object can be acquired through the doorbell device; furthermore, object identification processing can be carried out on the acquired object detail information according to preset object information associated with doorbell equipment to obtain the object type of the first object, so that the identification accuracy of the first object (the first object can be a visiting object) can be improved; the reminding function of the doorbell device can be assisted through the touch reminding function of the wearable device, the problem that a visited object with limited audio receiving capacity cannot hear audio is solved, the advantages that the wearable device is carried along and the touch reminding is not interfered by the environment can be fully exerted, the information of the visiting object is transferred more timely and not missed, and the effectiveness of doorbell reminding can be improved; meanwhile, through the linkage between the mobile terminal equipment and the doorbell equipment, the characteristics of answering and moving of the functions of the mobile equipment are fully exerted, the visited personnel can conveniently interact with the doorbell equipment without reaching a fixed position, the interactivity of the doorbell equipment can be improved, and the convenience of the visited personnel can be further improved.
It will be appreciated that in the specific embodiments of the present application, it may relate to the fingerprint, face, voice, voiceprint, iris, etc. of a user, the video data, footstep, image, etc. of a user, and the identity information (e.g., work card information, etc.) of service personnel such as takers, couriers, community personnel, medical workers, water and electricity gas service personnel, etc., and that when the above embodiments of the present application are applied to specific products or technologies, permission or consent of a user needs to be obtained, and the collection, use and processing of relevant data needs to comply with relevant legal regulations and standards of relevant countries and regions.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application; it will be appreciated that the data processing apparatus may be employed in a doorbell device 10b as shown in figure 1. As shown in fig. 8, the data processing apparatus 1 may include an information acquisition unit 11, an object type identification unit 12, and an object type transmission unit 13;
an information acquisition unit 11, configured to acquire object detail information corresponding to a first object through a doorbell device when the doorbell device detects the first object;
An object type identifying unit 12, configured to perform object identification processing on object detail information according to preset object information associated with the doorbell device, to obtain an object type of the first object;
an object type sending unit 13, configured to send an object type of the first object to the wearable device, so that the wearable device determines object prompt parameter information that matches the object type of the first object in a haptic prompt encoding policy associated with the doorbell device; the object prompt parameter information is used for driving the wearable device to notify the second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information.
In one or more embodiments, the data processing apparatus 1 further comprises: a detection mode acquisition unit 14, an object detection unit 15;
a detection mode acquiring unit 14 configured to acquire M object detection modes in an on state in the doorbell device, and acquire a detection range of each of the M object detection modes; m is a positive integer;
the object detection unit 15 is configured to determine that the doorbell device detects the first object if the first object is sensed within a detection range of any one of the M object detection modes, and determine the object detection mode in which the first object is sensed as the target detection mode.
In one or more embodiments, the data processing apparatus 1 further comprises: a detection mode acquisition unit 14, a detection priority acquisition unit 16, an object detection unit 15;
a detection mode acquiring unit 14 configured to acquire M object detection modes in an on state in the doorbell device, and acquire a detection range of each of the M object detection modes; m is a positive integer;
a detection priority acquiring unit 16, configured to acquire detection priorities corresponding to the M object detection modes, determine a detection order corresponding to the M object detection modes according to the detection priorities, and perform object detection within a detection range of the M object detection modes according to the detection order;
the object detection unit 15 is further configured to determine that the doorbell device detects the first object if the first object is sensed within a detection range of a target detection mode included in the M object detection modes.
In one or more embodiments, the information acquisition unit 11 is specifically configured to:
when the doorbell equipment detects a first object, a target detection mode corresponding to the first object is sent to the wearable equipment, so that the wearable equipment determines mode prompt parameter information matched with the target detection mode in a touch prompt coding strategy associated with the doorbell equipment; the mode prompting parameter information is used for driving the wearable device to inform the second object of the target detection mode in a tactile mode; different object detection modes correspond to different mode prompt parameter information;
And starting an information acquisition function for the doorbell equipment, and acquiring object detail information corresponding to the first object through the started information acquisition function in the doorbell equipment.
In one or more embodiments, the information collecting unit 11 collects object detail information corresponding to the first object through an opened information collecting function in the doorbell device, including:
if the started information acquisition function in the doorbell equipment comprises a short-distance wireless communication function, notifying a first object to start the short-distance wireless communication function through the doorbell equipment;
if the started short-distance wireless communication function in the doorbell device is successfully matched with the short-distance wireless communication function started by the first object, acquiring object identification information corresponding to the first object based on the short-distance wireless communication function, and determining the object identification information as object detail information corresponding to the first object.
In one or more embodiments, the information collecting unit 11 collects object detail information corresponding to the first object through an opened information collecting function in the doorbell device, including:
if the opened information acquisition function in the doorbell equipment comprises a biological feature acquisition function, acquiring a target biological feature corresponding to the first object through the opened biological feature acquisition function in the doorbell equipment, and determining the target biological feature as object detail information corresponding to the first object.
In one or more embodiments, the object type recognition unit 12 is specifically configured to:
acquiring preset object information stored in a database corresponding to doorbell equipment;
if the preset object information contains object detail information, determining the object type of the object detail information in the preset object information as the object type of the first object;
and if the preset object information does not contain the object detail information, determining the object type of the first object as a strange type.
In one or more embodiments, the object type identifying unit 12 determines an object type of the object detail information in the preset object information as an object type of the first object, including:
if the object type of the object detail information in the preset object information is an intimate type, determining the object type of the first object as the intimate type;
if the object type of the object detail information in the preset object information is a service type, determining the object type of the first object as the service type;
and if the object type of the object detail information in the preset object information is a blacklist, determining the object type of the first object as the blacklist.
In one or more embodiments, the data processing apparatus 1 further comprises: a failure type determining unit 17, a failure type transmitting unit 18;
A fault type determining unit 17, configured to obtain a fault type corresponding to a system fault in the doorbell device if the system fault is detected to exist in the doorbell device;
a fault type sending unit 18, configured to send a fault type to the wearable device, so that the wearable device determines, in a haptic cue coding policy associated with the doorbell device, system cue parameter information that matches the fault type; the system prompt parameter information is used for driving the wearable device to notify the second object of the fault type of the doorbell device in a tactile mode; different fault types correspond to different system prompt parameter information.
According to one embodiment of the present application, the steps involved in the data processing method shown in the foregoing may be performed by respective units in the data processing apparatus 1 shown in fig. 8. For example, step S101 shown in fig. 3 may be performed by the information acquisition unit 11 shown in fig. 8, step S102 shown in fig. 3 may be performed by the object type identification unit 12 shown in fig. 8, step S103 shown in fig. 3 may be performed by the object type transmission unit 13 shown in fig. 8, and so on.
According to an embodiment of the present application, each unit in the data processing apparatus 1 shown in fig. 8 may be separately or completely combined into one or several units to form a structure, or some unit(s) therein may be further split into at least two sub-units with smaller functions, so that the same operation may be implemented without affecting the implementation of the technical effects of the embodiments of the present application. The above units are divided based on logic functions, and in practical applications, the functions of one unit may be implemented by at least two units, or the functions of at least two units may be implemented by one unit. In other embodiments of the present application, the data processing device 1 may also comprise other units, and in practical applications, these functions may also be implemented with the assistance of other units, and may be implemented by cooperation of at least two units.
In the embodiment of the application, when the doorbell device detects the first object, object detail information corresponding to the first object can be acquired through the doorbell device; furthermore, object identification processing can be carried out on the acquired object detail information according to preset object information associated with doorbell equipment to obtain the object type of the first object, so that the identification accuracy of the first object (the first object can be a visiting object) can be improved; the reminding function of the doorbell equipment can be assisted through the touch prompt function of the wearable equipment, the problem that the visited object with limited audio receiving capability cannot hear audio is solved, the advantages that the wearable equipment is carried along and the touch prompt is not interfered by the environment can be fully exerted, the information of the visiting object is transferred more timely and not missed, and the effectiveness of doorbell reminding can be improved.
Referring to fig. 9, fig. 9 is a schematic diagram of a second structure of a data processing apparatus according to an embodiment of the present application; it will be appreciated that the data processing apparatus may be employed in the wearable device 10d shown in fig. 1. As shown in fig. 9, the data processing apparatus 2 may include an object type receiving unit 21, a parameter information determining unit 22, and an object prompting unit 23;
An object type receiving unit 21 for receiving an object type of the first object; the object type of the first object is obtained by carrying out object identification processing on object detail information corresponding to the first object according to preset object information associated with doorbell equipment, and the first object is an object detected by the doorbell equipment;
a parameter information determining unit 22, configured to determine object prompt parameter information that matches an object type of the first object in a haptic prompt encoding policy associated with the doorbell device; different object types correspond to different object prompt parameter information;
the object prompting unit 23 is configured to drive the wearable device to notify the second object of the object type of the first object in a tactile form according to the object prompting parameter information.
In one or more embodiments, the haptic form includes a vibrotactile form;
the object prompting unit 23 is specifically configured to:
and generating a vibration coding file according to the object prompt parameter information, and driving vibration hardware in the wearable device to inform the second object of the object type of the first object in a vibration touch mode according to the vibration coding file.
In one or more embodiments, the data processing apparatus 2 further comprises: an unlock instruction generation unit 24, a door lock unlock unit 25;
An opening instruction generating unit 24, configured to respond to the interaction in the wearable device and generate a door lock opening instruction according to the interaction if the object prompt parameter information is prompt parameter information corresponding to the service type;
the door lock unlocking unit 25 is configured to send a door lock unlocking instruction to the doorbell device, so that the doorbell device unlocks the door for the first object based on the door lock unlocking instruction.
According to one embodiment of the present application, the steps involved in the data processing method shown in the foregoing may be performed by respective units in the data processing apparatus 2 shown in fig. 9. For example, step S205 shown in fig. 5 may be performed by the object type receiving unit 21 shown in fig. 9, step S206 shown in fig. 5 may be performed by the parameter information determining unit 22 shown in fig. 9, step S207 shown in fig. 5 may be performed by the object presenting unit 23 shown in fig. 9, and so on.
According to an embodiment of the present application, each unit in the data processing apparatus 1 shown in fig. 9 may be separately or completely combined into one or several units to form a structure, or some unit(s) therein may be further split into at least two sub-units with smaller functions, so that the same operation may be implemented without affecting the implementation of the technical effects of the embodiments of the present application. The above units are divided based on logic functions, and in practical applications, the functions of one unit may be implemented by at least two units, or the functions of at least two units may be implemented by one unit. In other embodiments of the present application, the data processing device 1 may also comprise other units, and in practical applications, these functions may also be implemented with the assistance of other units, and may be implemented by cooperation of at least two units.
In the embodiment of the application, when the doorbell device detects the first object, object detail information corresponding to the first object can be acquired through the doorbell device; furthermore, object identification processing can be carried out on the acquired object detail information according to preset object information associated with doorbell equipment to obtain the object type of the first object, so that the identification accuracy of the first object (the first object can be a visiting object) can be improved; the reminding function of the doorbell device can be assisted through the touch reminding function of the wearable device, the problem that a visited object with limited audio receiving capacity cannot hear audio is solved, the advantages that the wearable device is carried along and the touch reminding is not interfered by the environment can be fully exerted, the information of the visiting object is transferred more timely and not missed, and the effectiveness of doorbell reminding can be improved; meanwhile, through the linkage between the mobile terminal equipment and the doorbell equipment, the characteristics of answering and moving of the functions of the mobile equipment are fully exerted, the visited personnel can conveniently interact with the doorbell equipment without reaching a fixed position, the interactivity of the doorbell equipment can be improved, and the convenience of the visited personnel can be further improved.
Referring to fig. 10, fig. 10 is a schematic structural diagram of a computer device according to an embodiment of the present application. As shown in fig. 10, the computer device 1000 may be the server 10d in the embodiment corresponding to fig. 1, and the computer device 1000 may include: processor 1001, network interface 1004, and memory 1005, in addition, the computer device 1000 may further comprise: a user interface 1003, and at least one communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may also include a standard wired interface, a wireless interface, among others. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 1005 may also optionally be at least one storage device located remotely from the processor 1001. As shown in fig. 10, an operating system, a network communication module, a user interface module, and a device control application program may be included in the memory 1005, which is one type of computer-readable storage medium.
The network interface 1004 of the computer device 1000 may also provide network communication functions. In the computer device 1000 shown in FIG. 10, the network interface 1004 may provide network communication functions; while user interface 1003 is primarily used as an interface for providing input to a user; and the processor 1001 may be used to invoke a device control application stored in the memory 1005 to implement:
when the doorbell equipment detects a first object, object detail information corresponding to the first object is collected through the doorbell equipment;
object identification processing is carried out on the object detail information according to preset object information associated with doorbell equipment, so that an object type of a first object is obtained;
the method comprises the steps of sending an object type of a first object to a wearable device, so that the wearable device determines object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with doorbell equipment; the object prompt parameter information is used for driving the wearable device to notify the second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information.
Alternatively, the processor 1001 may be configured to invoke a device control application program stored in the memory 1005 to implement:
Receiving an object type of a first object; the object type of the first object is obtained by carrying out object identification processing on object detail information corresponding to the first object according to preset object information associated with doorbell equipment, and the first object is an object detected by the doorbell equipment;
in a haptic cue encoding strategy associated with a doorbell device, determining object cue parameter information that matches an object type of a first object; different object types correspond to different object prompt parameter information;
and driving the wearable device to notify the second object of the object type of the first object in a tactile form according to the object prompt parameter information.
It should be understood that the computer apparatus 1000 described in the embodiments of the present application may perform the description of the data processing method in any of the embodiments corresponding to fig. 3 and 5, or may perform the description of the data processing apparatus 1 in the embodiment corresponding to fig. 8, or the description of the data processing apparatus 2 in the embodiment corresponding to fig. 9, which will not be repeated herein. In addition, the description of the beneficial effects of the same method is omitted.
Furthermore, it should be noted here that: the embodiments of the present application further provide a computer readable storage medium, in which the aforementioned computer program executed by the data processing apparatus 1 or the data processing apparatus 2 is stored, and the computer program includes program instructions, when executed by a processor, can execute the description of the data processing method in any of the foregoing embodiments corresponding to fig. 3 and 5, and therefore, a detailed description will not be given here. In addition, the description of the beneficial effects of the same method is omitted. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like. For technical details not disclosed in the embodiments of the computer-readable storage medium according to the present application, please refer to the description of the method embodiments of the present application. As an example, program instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or, alternatively, across multiple computing devices distributed across multiple sites and interconnected by a communication network, where the multiple computing devices distributed across multiple sites and interconnected by the communication network may constitute a blockchain system.
In addition, it should be noted that: embodiments of the present application also provide a computer program product or computer program that may include computer instructions that may be stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor may execute the computer instructions, so that the computer device performs the description of the data processing method in any of the foregoing embodiments corresponding to fig. 3 and 5, and thus, a detailed description will not be given here. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the computer program product or the computer program embodiments related to the present application, please refer to the description of the method embodiments of the present application.
The terms first, second and the like in the description and in the claims and drawings of the embodiments of the present application are used for distinguishing between different media content and not for describing a particular sequential order. Furthermore, the term "include" and any variations thereof is intended to cover a non-exclusive inclusion. For example, a process, method, apparatus, article, or device that comprises a list of steps or elements is not limited to the list of steps or modules but may, in the alternative, include other steps or modules not listed or inherent to such process, method, apparatus, article, or device.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied in electronic hardware, in computer software, or in a combination of the two, and that the elements and steps of the examples have been generally described in terms of function in the foregoing description to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The methods and related devices provided in the embodiments of the present application are described with reference to the method flowcharts and/or structure diagrams provided in the embodiments of the present application, and each flowchart and/or block of the method flowcharts and/or structure diagrams may be implemented by computer program instructions, and combinations of flowcharts and/or blocks in the flowchart and/or block diagrams. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or structural diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or structures.
The foregoing disclosure is only illustrative of the preferred embodiments of the present application and is not intended to limit the scope of the claims herein, as the equivalent of the claims herein shall be construed to fall within the scope of the claims herein.

Claims (16)

1. A method of data processing, comprising:
when a doorbell device detects a first object, object detail information corresponding to the first object is collected through the doorbell device;
performing object identification processing on the object detail information according to preset object information associated with the doorbell equipment to obtain an object type of the first object;
transmitting the object type of the first object to a wearable device, so that the wearable device determines object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with the doorbell device; the object prompt parameter information is used for driving the wearable device to notify a second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information.
2. The method according to claim 1, wherein the method further comprises:
Acquiring M object detection modes in an on state in the doorbell device, and acquiring a detection range of each object detection mode in the M object detection modes; m is a positive integer;
and if the first object is sensed in the detection range of any one of the M object detection modes, determining that the doorbell device detects the first object, and determining the object detection mode in which the first object is sensed as a target detection mode.
3. The method according to claim 1, wherein the method further comprises:
acquiring M object detection modes in an on state in the doorbell device, and acquiring a detection range of each object detection mode in the M object detection modes; m is a positive integer;
acquiring detection priorities corresponding to the M object detection modes, determining detection sequences corresponding to the M object detection modes according to the detection priorities, and performing object detection in the detection ranges of the M object detection modes according to the detection sequences;
and if the first object is sensed in the detection range of the target detection modes included in the M object detection modes, determining that the doorbell device detects the first object.
4. A method according to any one of claims 2 to 3, wherein when the doorbell device detects a first object, object detail information corresponding to the first object is acquired by the doorbell device, comprising:
when a doorbell device detects a first object, a target detection mode corresponding to the first object is sent to the wearable device, so that the wearable device determines mode prompt parameter information matched with the target detection mode in a touch prompt coding strategy associated with the doorbell device; the mode prompting parameter information is used for driving the wearable device to notify the second object of the target detection mode in a tactile mode; different object detection modes correspond to different mode prompt parameter information;
and starting an information acquisition function for the doorbell equipment, and acquiring object detail information corresponding to the first object through the started information acquisition function in the doorbell equipment.
5. The method according to claim 4, wherein the collecting object detail information corresponding to the first object through the turned-on information collecting function in the doorbell device includes:
If the started information acquisition function in the doorbell equipment comprises a short-distance wireless communication function, informing the first object to start the short-distance wireless communication function through the doorbell equipment;
and if the started short-distance wireless communication function in the doorbell device is successfully matched with the short-distance wireless communication function started by the first object, acquiring object identification information corresponding to the first object based on the short-distance wireless communication function, and determining the object identification information as object detail information corresponding to the first object.
6. The method according to claim 4, wherein the collecting object detail information corresponding to the first object through the turned-on information collecting function in the doorbell device includes:
if the started information acquisition function in the doorbell equipment comprises a biological characteristic acquisition function, acquiring a target biological characteristic corresponding to the first object through the started biological characteristic acquisition function in the doorbell equipment, and determining the target biological characteristic as object detail information corresponding to the first object.
7. The method according to claim 1, wherein the performing object recognition processing on the object detail information according to preset object information associated with the doorbell device to obtain an object type of the first object includes:
Acquiring preset object information stored in a database corresponding to the doorbell equipment;
if the preset object information contains the object detail information, determining the object type of the object detail information in the preset object information as the object type of the first object;
and if the preset object information does not contain the object detail information, determining the object type of the first object as a strange type.
8. The method of claim 7, wherein the determining the object type of the object detail information in the preset object information as the object type of the first object comprises:
if the object type of the object detail information in the preset object information is an intimate type, determining the object type of the first object as an intimate type;
if the object type of the object detail information in the preset object information is a service type, determining the object type of the first object as the service type;
and if the object type of the object detail information in the preset object information is a blacklist, determining the object type of the first object as the blacklist.
9. The method according to claim 1, wherein the method further comprises:
if the doorbell equipment is detected to have the system fault, acquiring a fault type corresponding to the system fault in the doorbell equipment;
transmitting the fault type to the wearable device so that the wearable device can determine system prompt parameter information matched with the fault type in a touch prompt coding strategy associated with the doorbell device; the system prompt parameter information is used for driving the wearable device to notify the second object of the fault type of the doorbell device in a tactile mode; different fault types correspond to different system prompt parameter information.
10. A method of data processing, comprising:
receiving an object type of a first object; the object type of the first object is obtained by performing object identification processing on object detail information corresponding to the first object according to preset object information associated with doorbell equipment, wherein the first object is an object detected by the doorbell equipment;
determining object prompt parameter information matched with the object type of the first object in a touch prompt coding strategy associated with the doorbell device; different object types correspond to different object prompt parameter information;
And driving the wearable equipment to notify the second object of the object type of the first object in a tactile form according to the object prompt parameter information.
11. The method of claim 10, wherein the haptic form comprises a vibrotactile form;
the driving the wearable device to notify the second object of the object type of the first object in a tactile form according to the object prompt parameter information comprises the following steps:
and generating a vibration coding file according to the object prompt parameter information, and driving vibration hardware in the wearable equipment to inform the object type of the first object to the second object in a vibration touch mode according to the vibration coding file.
12. The method according to claim 10, wherein the method further comprises:
if the object prompt parameter information is prompt parameter information corresponding to a service type, responding to interactive operation in the wearable equipment, and generating a door lock opening instruction according to the interactive operation;
and sending the door lock unlocking instruction to the doorbell device so that the doorbell device unlocks the door for the first object based on the door lock unlocking instruction.
13. A data processing apparatus, comprising:
The information acquisition unit is used for acquiring object detail information corresponding to a first object through doorbell equipment when the doorbell equipment detects the first object;
the object type identification unit is used for carrying out object identification processing on the object detail information according to preset object information associated with the doorbell equipment to obtain the object type of the first object;
an object type sending unit, configured to send an object type of the first object to a wearable device, so that the wearable device determines object prompt parameter information that matches the object type of the first object in a haptic prompt encoding policy associated with the doorbell device; the object prompt parameter information is used for driving the wearable device to notify a second object of the object type of the first object in a tactile form; different object types correspond to different object prompt parameter information.
14. A data processing apparatus, comprising:
an object type receiving unit for receiving an object type of the first object; the object type of the first object is obtained by performing object identification processing on object detail information corresponding to the first object according to preset object information associated with doorbell equipment, wherein the first object is an object detected by the doorbell equipment;
A parameter information determining unit, configured to determine, in a haptic cue coding policy associated with the doorbell device, object cue parameter information that matches an object type of the first object; different object types correspond to different object prompt parameter information;
and the object prompting unit is used for driving the wearable equipment to notify the second object of the object type of the first object in a tactile form according to the object prompting parameter information.
15. A computer device comprising a memory and a processor;
the memory is connected to the processor for storing a computer program for invoking the computer program to cause the computer device to perform the method of any of claims 1 to 9 or to perform the method of any of claims 10 to 12.
16. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any of claims 1 to 9 or to perform the method of any of claims 10 to 12.
CN202310483543.2A 2023-05-04 2023-05-04 Data processing method, device, equipment and medium Active CN116225235B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310483543.2A CN116225235B (en) 2023-05-04 2023-05-04 Data processing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310483543.2A CN116225235B (en) 2023-05-04 2023-05-04 Data processing method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN116225235A true CN116225235A (en) 2023-06-06
CN116225235B CN116225235B (en) 2023-08-08

Family

ID=86573500

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310483543.2A Active CN116225235B (en) 2023-05-04 2023-05-04 Data processing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN116225235B (en)

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150054949A1 (en) * 2013-07-26 2015-02-26 SkyBell Technologies, Inc. Doorbell communication systems and methods
US20150109112A1 (en) * 2012-09-21 2015-04-23 Google Inc. Occupant notification of visitor interaction with a doorbell at a smart-home
CN104602204A (en) * 2014-12-31 2015-05-06 小米科技有限责任公司 Visitor informing method and device
US20180026808A1 (en) * 2014-09-15 2018-01-25 SkyBell Technologies, Inc. Doorbell communication systems and methods
CN108810470A (en) * 2018-06-14 2018-11-13 北京奇虎科技有限公司 A kind of intelligent doorbell, intellectual broadcast method and device
CN108810472A (en) * 2018-06-14 2018-11-13 北京奇虎科技有限公司 A kind of control method and device of intelligent doorbell, intelligent doorbell
CN109660767A (en) * 2018-12-29 2019-04-19 成都国科微电子有限公司 A kind of visitor's response method, intelligent doorbell and the system of intelligent doorbell
CN109963038A (en) * 2019-02-27 2019-07-02 上海华镇电子科技有限公司 Door bell and button system and its working method
CN209593758U (en) * 2019-02-14 2019-11-05 爱耳发科技股份有限公司 The Information Exchange System used for the person that listens to barrier
US20200005610A1 (en) * 2018-06-29 2020-01-02 Futurewei Technologies, Inc. Intruder detection method and apparatus
CN111131695A (en) * 2019-12-12 2020-05-08 深圳市大拿科技有限公司 Doorbell control method and related device
CN111158481A (en) * 2019-12-27 2020-05-15 腾讯科技(深圳)有限公司 Prompting method and device and computer readable storage medium
CN111768574A (en) * 2019-04-01 2020-10-13 北京奇虎科技有限公司 Doorbell prompt tone processing method and doorbell equipment
CN112381971A (en) * 2020-11-09 2021-02-19 珠海格力电器股份有限公司 Door lock control method, device, equipment and storage medium
CN114445982A (en) * 2022-01-04 2022-05-06 上海应用技术大学 Special doorbell system for people with hearing and vision disorders
CN115131846A (en) * 2021-03-29 2022-09-30 上海博泰悦臻网络技术服务有限公司 Visitor identification method and device, electronic equipment and storage medium
CN115439989A (en) * 2021-06-04 2022-12-06 重庆海尔洗衣机有限公司 Object detection method and device and smart home system

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150109112A1 (en) * 2012-09-21 2015-04-23 Google Inc. Occupant notification of visitor interaction with a doorbell at a smart-home
US20150054949A1 (en) * 2013-07-26 2015-02-26 SkyBell Technologies, Inc. Doorbell communication systems and methods
US20180026808A1 (en) * 2014-09-15 2018-01-25 SkyBell Technologies, Inc. Doorbell communication systems and methods
CN104602204A (en) * 2014-12-31 2015-05-06 小米科技有限责任公司 Visitor informing method and device
CN108810470A (en) * 2018-06-14 2018-11-13 北京奇虎科技有限公司 A kind of intelligent doorbell, intellectual broadcast method and device
CN108810472A (en) * 2018-06-14 2018-11-13 北京奇虎科技有限公司 A kind of control method and device of intelligent doorbell, intelligent doorbell
US20200005610A1 (en) * 2018-06-29 2020-01-02 Futurewei Technologies, Inc. Intruder detection method and apparatus
CN109660767A (en) * 2018-12-29 2019-04-19 成都国科微电子有限公司 A kind of visitor's response method, intelligent doorbell and the system of intelligent doorbell
CN209593758U (en) * 2019-02-14 2019-11-05 爱耳发科技股份有限公司 The Information Exchange System used for the person that listens to barrier
CN109963038A (en) * 2019-02-27 2019-07-02 上海华镇电子科技有限公司 Door bell and button system and its working method
CN111768574A (en) * 2019-04-01 2020-10-13 北京奇虎科技有限公司 Doorbell prompt tone processing method and doorbell equipment
CN111131695A (en) * 2019-12-12 2020-05-08 深圳市大拿科技有限公司 Doorbell control method and related device
CN111158481A (en) * 2019-12-27 2020-05-15 腾讯科技(深圳)有限公司 Prompting method and device and computer readable storage medium
CN112381971A (en) * 2020-11-09 2021-02-19 珠海格力电器股份有限公司 Door lock control method, device, equipment and storage medium
CN115131846A (en) * 2021-03-29 2022-09-30 上海博泰悦臻网络技术服务有限公司 Visitor identification method and device, electronic equipment and storage medium
CN115439989A (en) * 2021-06-04 2022-12-06 重庆海尔洗衣机有限公司 Object detection method and device and smart home system
CN114445982A (en) * 2022-01-04 2022-05-06 上海应用技术大学 Special doorbell system for people with hearing and vision disorders

Also Published As

Publication number Publication date
CN116225235B (en) 2023-08-08

Similar Documents

Publication Publication Date Title
CN107065586B (en) Interactive intelligent home service system and method
CN104850827B (en) Fingerprint identification method and device
US10515203B2 (en) Method and system for improving security of a mobile terminal
CN106504390A (en) Control method for door lock, apparatus and system
EP2492878A1 (en) Methods and apparatus to control access
CN105637522B (en) Access control is driven using the world of trusted certificate
CN101625716A (en) Method for preventing peep on computer and computer with method
CN105447691A (en) E-card transaction authorization based on geographic location
KR20150046766A (en) Unlocking process mehtod, apparatus and device for terminal
CN109979047B (en) Multi-network intelligent door lock control method, storage medium, controller and fingerprint lock
KR101944965B1 (en) User authentication system using face recognition and biometric authentication card, and method thereof
US20150098631A1 (en) Apparatus and method for recording evidence of a person's situation
CN105407098A (en) Identity verification method and device
CN108038360B (en) Operation mode switching method and mobile terminal
EP3249570B1 (en) Method and device for providing prompt indicating loss of terminal
CN106970552B (en) Switch control method, intelligent switch and mobile terminal
CN114267105A (en) Doorbell control method, intelligent doorbell and related equipment
CN107710714A (en) Dispose the risk case of mobile device
CN103791686A (en) Intelligent refrigerator with iris recognition function
CN107733872A (en) Information Method of printing and device
CN112135275A (en) Bluetooth scanning method and device, electronic equipment and readable storage medium
CN106506810A (en) The method and apparatus of the use time of limiting terminal equipment
CN108625723B (en) Method and system for controlling a physical object to be shared by several potential users
CN116225235B (en) Data processing method, device, equipment and medium
CN112509197A (en) Visitor management method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40086900

Country of ref document: HK