KR20210019211A - Smart door - Google Patents

Abstract

A smart door according to an embodiment of the present invention includes: a first door installed to divide an indoor space and an outdoor space and forming a food storage room therein; A second door installed on the first door and capable of opening and closing the food storage compartment; A sensing unit that obtains data for authentication of a visitor; And a processor that unlocks one of the first door and the second door based on the obtained data.

Description

Smart door {SMART DOOR}

The present invention relates to a smart door capable of storing food.

Many families deliver milk or dairy products early in the morning. In recent years, as the number of nuclear families, the increase of single families, and the increase in women's social life, they use a variety of delivery food services such as vegetables and fruits as well as dairy products.

However, when leaving the house for a long period of time, such as on a summer vacation or a holiday, the delivered food is often corrupted or spoiled because it cannot maintain freshness. In particular, the average annual temperature is increasing due to global warming, and accordingly, the necessity to keep the delivered food fresh from spring to autumn as well as summer is increasing.

In this regard, Korean Patent Laid-Open Publication No. 10-2011-0033394 (March 31, 2011) discloses a front door and a refrigerator attached to the front door.

The refrigerator disclosed in the prior literature includes a cooling device installed inside the frame, a food storage room, an inner door installed toward the inside of the frame, and an outer door installed toward the outside opposite to the inner door. Accordingly, the refrigerator is integrally attached to the front door or the front door to freshly store various delivered foods.

However, since the front door and the refrigerator attached to the front door disclosed in the prior literature do not provide a separate locking function, there is a concern that food stored in the refrigerator may be stolen. In addition, when the refrigerator is provided with a locking function, it is difficult for a delivery person or a courier to release the locked state, and thus it is difficult to store and release the refrigerator.

Publication number (published date): 10-2011-0033394 (March 31, 2011).

An object of the present invention is to provide a smart door that can easily store food or parcels outside the house and maintain freshness.

Another object of the present invention is to provide a smart door that can prevent theft of food or parcels and improve security.

Another object of the present invention is to provide a smart door capable of automatically unlocking a desired door among a front door or a refrigerator door.

A smart door according to an embodiment of the present invention for achieving the above object includes a first door forming a food storage compartment therein, and a second door installed on the first door and capable of opening and closing the food storage compartment. And a sensing unit that obtains data for authentication of a visitor, and a processor that unlocks one of the first door and the second door based on the obtained data.

In this case, the first door may be a front door that divides an indoor space and an outdoor space. Alternatively, the first door may be a gate located in the yard.

Specifically, the processor may detect the visitor's approach toward the smart door, and when the visitor's approach is detected, obtain biometric data related to the visitor's physical characteristics. In addition, the processor may compare the obtained biometric data with biometric data stored in the memory to determine whether the visitor is a family member, a delivery driver, or an outsider.

That is, the smart door determines whether to unlock which door of the first door and the second door by attempting visitor authentication.

When it is determined that the visitor is a family member, the processor may unlock the first door, and when it is determined that the visitor is a delivery driver, the second door may be unlocked.

Also, when determining that the visitor is a family member, the processor may determine whether a touch on the second door is detected. At this time, if it is determined that the touch on the second door is not detected, the processor releases the lock on the first door.

On the other hand, if the processor determines that a touch on the second door is detected, the lock on the second door may be released.

That is, when the user touches the second door when attempting to use the refrigerator function, the lock on the second door may be automatically released.

In addition, when the lock of the second door is released, the processor may transmit unlocking information to the user terminal. Therefore, when the lock on the second door is released by the delivery man or the delivery driver, the user can easily know that the delivery has arrived through the terminal.

The sensing unit includes at least one of a fingerprint recognition sensor for obtaining human fingerprint data, an iris recognition sensor for obtaining human iris data, and a face recognition sensor for obtaining human face data.

The processor may perform visitor authentication by receiving specific data from a terminal registered in the smart door. At this time, the specific data includes a Bluetooth connection signal transmitted from the terminal.

When receiving specific data from the terminal registered in the smart door, the processor may unlock the second door.

That is, when a delivery driver having a terminal registered in the smart door approaches the smart door, the lock for the second door may be automatically released.

The sensing unit may include a reader that recognizes code information of any one of a barcode, a QR code, and a dot code. In this case, the processor may perform authentication of the visitor based on the code information recognized through the reader.

For example, the processor may determine whether the recognized code information and the code information stored in the memory match, and when it is determined to match, unlock the second door.

That is, when the code related to the delivery service attached to the package or the code displayed on the terminal is recognized, the lock for the second door may be automatically released.

In addition, the processor may capture a visitor's face image through the sensing unit and store it in a memory, and the face image stored in the memory may be registered as a visitor list. Therefore, when the face image of the delivery driver who first visits is registered, the lock on the second door can be automatically released after that without a separate authentication procedure of the delivery driver.

According to the smart door according to the embodiment of the present invention constituting the above configuration has the following effects.

First, there is an advantage that food or parcel delivery can be easily stored outside the house and freshness can be maintained.

Second, since the front door or the refrigerator door can be selectively opened through user authentication, theft of parcels is prevented and convenience of use is improved.

Third, it is possible to easily unlock the refrigerator door by registering biometric information on the delivery driver or the terminal. In addition, since the refrigerator door can be easily unlocked through the code information attached to the parcel or the code information displayed on the terminal, there is an advantage in that it is easy to store and release.

Fourth, when the lock on the refrigerator door is released, the unlock information can be received from the user terminal, so that it is possible to immediately know that the delivery service has arrived.

1 is a diagram illustrating a smart door and a terminal according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a smart door according to an embodiment of the present invention.
3 is a block diagram showing a configuration of a terminal according to an embodiment of the present invention.
4 is a flow chart showing a method of controlling a smart door according to an embodiment of the present invention.
5 is a diagram illustrating a method of authenticating a terminal in which a smart door is registered according to an embodiment of the present invention.
6 is a diagram illustrating a method of registering a terminal in a smart door according to an embodiment of the present invention.
7 and 8 are diagrams illustrating a method for a smart door to recognize code information according to an embodiment of the present invention.
9 is a diagram illustrating a method for a smart door to recognize a delivery driver according to an embodiment of the present invention.
10 is a diagram illustrating a method of registering biometric data of a delivery driver in a smart door according to an embodiment of the present invention.
11 and 12 are diagrams illustrating a method of unlocking a second door by a smart door recognizing a family member according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar elements are denoted by the same reference numerals regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves.

In addition, in describing the embodiments disclosed in the present specification, when it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed in the present specification is not limited by the accompanying drawings, and all modifications included in the spirit and scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "comprises" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance.

Mobile terminals described herein include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation systems, and slate PCs. , Tablet PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, smartwatch, glass-type terminal (smart glass), HMD (head mounted display)), etc. may be included. have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in the present specification may also be applied to fixed terminals such as digital TVs, desktop computers, and digital signage, except when applicable only to mobile terminals. will be.

1 is a diagram illustrating a smart door and a terminal according to an embodiment of the present invention.

Referring to Figure 1, the smart door 200 according to the present invention may be a front door of a house. The smart door 200 may distinguish between inside and outside the house and provide a lock/unlock function. The smart door 200 may include a door lock capable of locking or unlocking the door. Alternatively, the smart door 200 may be a front door of a house.

Hereinafter, a case where the smart door 200 is applied to a front door that divides an indoor space and an outdoor space of a house will be described.

Specifically, the smart door 200 includes a first door 201.

The first door 201 is installed to substantially divide the inside and outside the house. The first door 201 may be moved or rotated to open or close the inside and outside of the house.

The first door 201 may be formed to have a certain thickness, and a food storage room 301 may be provided therein.

For example, a part of the first door 201 may be recessed inside (inside the house) to form a food storage room 301. In addition, the smart door 200 may include a second door 320 installed to open and close the food storage room 301 from the first door 201.

The first door 201 is a door that is opened for a user to enter the interior of the house, and the second door 320 is understood as a door that is opened by a user or a delivery driver to put or take out food into the food storage room 301 Can be. That is, the second door 320 may be used as a door for a delivery unit or a delivery driver to store or release food or packages.

In addition, the smart door 200 may further include a cooling passage connected to an external cooling device in order to provide cool air to the food storage room 301.

The cooling device includes a compressor, a condenser, an expander, and an evaporator, and the cooling flow path may be connected to the evaporator.

For another example, a refrigerator 300 forming a food storage room 301 may be provided inside the first door 201. The refrigerator 300 may include a refrigerator body 310 forming the food storage compartment 301 and a second door 320 installed to open and close the food storage compartment 301.

The second door 320 may be hinged to one side of the refrigerator body 310 to open and close the food storage compartment 301.

The refrigerator 300 or the second door 320 may be installed in the center of the first door 201. Accordingly, it may be easier for a user or a delivery driver to open the second door 320 to place or take out food in the food storage room 301.

The first door 201 may be referred to as “main door”, and the second door 320 may be referred to as “sub door” or “refrigerator door”.

The smart door 200 includes a display unit 231.

The display unit 231 may be provided on the front surface of the first door 201. The display unit 231 may display dong/lake information of a house or building. The display unit 231 may further display a button for ringing a bell installed in the house and/or a call switch for connecting to an interphone provided in the house.

The smart door 200 includes at least one sensor 221.

The sensor 221 may include an image sensor for photographing an object or a biometric authentication sensor for obtaining biometric information of a person.

The image sensor is a device for photographing an object or a person positioned in front of the smart door 200. In this embodiment, a plurality of image sensors are provided, so that an object or person positioned in front of the smart door 200 can be easily recognized.

The biometric authentication sensor may obtain data for authenticating or identifying a user (a member of a house or a visitor). For example, the biometric authentication sensor may include a fingerprint recognition sensor, an iris recognition sensor, or a voice recognition sensor.

The biometric authentication sensor may be installed at different locations depending on its type. In the case of the iris recognition sensor, the biometric authentication sensor may be disposed at a relatively high position in the height direction of the smart door 200. Alternatively, in the case of a fingerprint recognition sensor, the biometric authentication sensor may be disposed at a relatively lower position than the iris recognition sensor. That is, the installation location of the biometric authentication sensor may be variously designed.

In addition, the sensor 221 may include a reader that recognizes various code information such as a barcode or a QR code.

The terminal 100 may include a mobile terminal that a user can carry. The mobile terminal 100 may be a mobile terminal of a member (family) of a house in which the smart door 200 is installed. The mobile terminal 100 may include a mobile terminal for each family residing in a house in which the smart door 200 is installed.

In addition, the mobile terminal 100 may be a mobile terminal registered with the smart door 200. For example, the mobile terminal 100 may be a delivery driver registered in the smart door 200 or a mobile terminal of a friend.

The smart door 200 and the mobile terminal 100 may transmit and receive various data. For example, the mobile terminal 100 may transmit access information corresponding to visitor information to the smart door 200. In addition, when there is a visitor, the smart door 200 may obtain visitor information or visitor access information and transmit it to the mobile terminal 100.

2 is a block diagram showing the configuration of a smart door according to an embodiment of the present invention.

Referring to FIG. 2, the smart door 200 includes a communication unit 210, a sensing unit 220, an input unit 230, an output unit 240, a memory 250, a first door lock 260, and a processor 270. ) And at least one or more or all of the second door lock 280 may be included.

The communication unit 210 is connected between the smart door 200 and the wireless communication system, between the smart door 200 and the mobile terminal 100, and between the smart door 200 and the server through a wired or wireless connection. It may include a communication module that enables communication.

The communication unit 210 may include a mobile communication module (mobile communication circuit).

The mobile communication module includes technical standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA)), Code Division Multi Access 2000 (CDMA2000), EV-DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.), transmits and receives radio signals with at least one of a base station, an external terminal, and a server on a mobile communication network.

The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The communication unit 210 may include a wireless Internet module (wireless Internet circuit).

The wireless Internet module refers to a module for wireless Internet access, and may be built into or external to the smart door 200. The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet module Data is transmitted and received according to at least one wireless Internet technology within a range including Internet technologies not listed above.

At this time, from the viewpoint of wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc., through a mobile communication network, the wireless Internet module performing wireless Internet access through the mobile communication network May be understood as a kind of the mobile communication module.

The communication unit 210 may include a short-range communication module (a short-range communication circuit).

The short range communication module is for short range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication.

Such a short-range communication module, through a wireless area network (Wireless Area Networks), between the smart door 200 and the wireless communication system, between the smart door 200 and the mobile terminal 100, the smart door 200 It is possible to support wireless communication between the and the server, or between the smart door 200 and a network connecting the smart door 200 and another device (system).

The local area wireless communication network may include wireless personal area networks (Wireless Personal Area Networks).

Meanwhile, the communication unit 210 may obtain data for authenticating or identifying a user (a member of the house or a visitor). For example, the short-range communication module may receive a user's unique ID from the user's mobile terminal 100.

When the smart door 200 is connected to an external device by wire, the communication unit 210 may include an interface that serves as a passage with the external device.

These interfaces include a data port, a memory card port, a port connecting a device equipped with an identification module, an audio input/output (I/O) port, and a video I/O. It may include at least one of a (Input/Output) port and an earphone port.

The sensing unit 220 is a component that obtains data for authenticating or identifying a user (a member of the house or a visitor). The sensing unit 220 may acquire biometric data of a user.

Specifically, the sensing unit 220 may acquire biometric data related to a user's physical characteristics. For example, the sensing unit 220 may include a fingerprint recognition sensor to obtain user's fingerprint data, a vein recognition sensor to obtain user's vein data, and an iris recognition sensor to obtain user's iris data.

In addition, the sensing unit 220 may include a face recognition sensor that acquires face data of a user, a voice recognition sensor that acquires voice data of the user, and a palmistry recognition sensor that acquires user's palmistry data.

In addition, the sensing unit 220 may include a long recognition sensor that obtains long (or height) data of a user, a retina recognition sensor that obtains retina data of a user, and a DNA recognition sensor that obtains DNA of a user.

The sensing unit 220 may acquire biometric data related to a user's behavioral characteristics. For example, the sensing unit 220 may include a handwriting recognition sensor that obtains handwriting data of a user, a lip movement recognition sensor that obtains data on a habit of movement of the user's lips, and a black masturbation area caused by the user's eye blink It may include at least one of an eye blink recognition sensor that acquires data on the amount of change, and a gait recognition sensor that acquires data on a gait characteristic of a user.

The smart door 200 disclosed in the present specification may authenticate or identify a user by using a multimodal biometrics method in which data detected by at least two or more of these sensors is combined.

The sensing unit 220 may include one or more cameras (or image sensors) that acquire image data. In addition, one or more cameras may be configured as at least one of the various sensors described above.

The sensing unit 220 may include one or more microphones that acquire voice data. In addition, one or more microphones may be configured as at least one of the various sensors described above.

The sensing unit 220 may include a reader that recognizes various code information such as a barcode or a QR code.

The input unit 220 is for inputting image information (or signal), audio information (or signal), data, or information input from a user, and includes a camera for inputting an image signal, and a microphone for inputting an audio signal. ), a user input unit (for example, a touch key, a mechanical key, etc.) for receiving information from a user.

The voice data or image data collected by the input unit 220 may be analyzed and processed as a user's control command. In order to input image information, the input unit 220 may include one or a plurality of cameras.

The camera processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on a display or stored in the memory 250.

The microphone processes an external sound signal into electrical sound data. The processed voice data may be used in various ways according to a function (or an application program being executed) being executed in the smart door 200. Various noise removal algorithms for removing noise generated in a process of receiving an external sound signal may be implemented in the microphone.

The user input unit is for receiving information from a user, and when information is input through the user input unit, the processor 270 may control the operation of the mobile terminal 100 to correspond to the input information. This user input unit is a mechanical input means (for example, a button located on at least one of the front and rear of the smart door 200, a dome switch, a jog wheel, a jog switch, etc.) or a touch input It may include means.

As an example, the touch input means is composed of a virtual key, a soft key, or a visual key displayed on a touch screen through software processing, or parts other than the touch screen It may be made of a touch key disposed on (for example, a touch pad).

The virtual key or visual key can be displayed on the touch screen while having various forms, for example, graphic, text, icon, video, or a combination thereof Can be made.

The output unit 240 is for generating an output related to visual, auditory or tactile sense, and may include at least one of a display unit, an audio output unit, a haptic module, and a light output unit.

The display unit may form a layer structure with a touch sensor or are integrally formed to implement a touch screen. Such a touch screen may function as a user input unit that provides an input interface between the smart door 200 and a user, and may provide an output interface between the smart door 200 and the user.

The display unit displays (outputs) information processed by the smart door 200. For example, the display unit may display execution screen information of an application program driven by the smart door 200, or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information.

The sound output unit receives audio data from the communication unit 210, stored in the memory 250, or generated by the processor 270 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, etc. Can be printed.

The sound output unit 152 may also output sound signals related to functions (eg, call signal reception sound, message reception sound, etc.) performed by the smart door 200. The sound output unit may include a receiver, a speaker, and a buzzer.

The haptic module generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module may include vibration. The intensity and pattern of vibrations generated by the haptic module may be controlled by a user's selection or setting of a controller. For example, the haptic module may synthesize and output different vibrations or sequentially output them.

The light output unit outputs a signal for notifying the occurrence of an event using light from a light source of the smart door 200.

The signal output by the light output unit is implemented as the smart door 200 emits a single color or multiple colors of light to the front or rear. The signal output may be terminated when the smart door 200 detects a user's event confirmation.

The first door lock 260 is a mechanical device mounted on the smart door 200 and is driven by electric energy to lock or unlock the first door 201. The first door lock 260 may include an actuator that is a mechanical driving source.

Here, lock means a lock, and the meaning that the first door 201 is locked means that the first door 201 is changed from an unlocked state to a locked state, or This may mean that the first door 201 that was in the locked state continues to maintain the locked state.

On the other hand, unlock means unlocking, and the meaning that the first door 201 is unlocked means that the first door 201 is in a locked state to an unlocked state. It may mean that the first door 201 that has been changed or has been in an unlocked state continues to be maintained in an unlocked state.

The second door lock 280 is a mechanical device mounted on the smart door 200 and is driven by electric energy to lock or unlock the second door 320. The second door lock 280 may include an actuator that is a mechanical driving source.

The first door lock 260 and the second door lock 280 may be formed as separate modules or as a single module.

The processor 270 includes at least one of the communication unit 210, the sensing unit 220, the input unit 230, the output unit 240, the memory 250, the first door lock 260, and the second door lock 280 You can control more or all.

For example, the processor 270 controls the operation of the smart door 200 by using the data acquired by the communication unit 210 or the sensing unit 220, or is installed in the smart door 200. You can perform data processing, functions, or operations related to the application program.

The processor 270 may lock or unlock the first door lock 260 and/or the second door lock 280 using the data acquired from the communication unit 210.

For example, when an ID is transmitted from the user's mobile terminal 100 to the communication unit 210 through short-range or long-distance communication, and the previously registered ID and the ID obtained through short-range or long-distance communication match, the processor 270 ) May unlock the first door lock 260 and/or the second door lock 280.

In addition, the processor 270 may lock or unlock the first door lock 260 and/or the second door lock 280 using the data acquired by the sensing unit 220. .

For example, when the previously registered fingerprint and the fingerprint data acquired through the fingerprint recognition sensor match, the processor 270 unlocks the first door lock 260 and/or the second door lock 280. can do. On the other hand, if the previously registered fingerprint and the fingerprint data acquired through the fingerprint recognition sensor do not match, the processor 270 locks the first door lock 260 and/or the second door lock 280. I can.

For another example, when a previously registered iris and iris data acquired through an iris recognition sensor match, the processor 270 may unlock the door lock 260. On the other hand, when the previously registered iris and iris data acquired through the iris recognition sensor do not match, the processor 270 may lock the door lock 260.

The memory 250 stores data supporting various functions of the smart door 200. The memory 250 may store a plurality of application programs (application programs) driven by the smart door 200 and data and commands for the operation of the smart door 200.

At least some of these application programs may be downloaded from an external server through wireless communication. At least some of these application programs may exist on the smart door 200 from the time of shipment to perform the function of the smart door 200. The application program may be stored in the memory 250, installed on the smart door 200, and driven by the processor 270 to perform an operation (or function) of the smart door 200.

Biometric data registered through the sensing unit 220 or biometric data received through the mobile terminal 100 may be stored in the memory 250. That is, various biometric data previously registered may exist in the memory 250.

Various code information such as a barcode or QR code transmitted through the communication unit 210 may be stored in the memory 250. For example, code information on parcels from an external server or the mobile terminal 100 may be transmitted to the communication unit 210 of the smart door 200. In addition, the transmitted code information may be wetted in the memory 250.

The processor 270 controls the overall operation of the smart door 200 in addition to the operation related to the application program. The processor 270 processes signals, data, information, etc. that are input or output through the above-described components, or drives an application program stored in the memory 250 to provide or process appropriate information or functions to a user. have.

In addition, the processor 270 may control at least some of the constituent elements described in this drawing in order to drive the application program stored in the memory 150.

Further, the processor 270 may operate by combining at least two or more of the components included in the smart door 200 to drive the application program.

In order to implement various embodiments described below on the smart door 200 according to the present invention, the processor 270 may control any one or a combination of a plurality of components described in this drawing.

The smart door 200 further includes a power supply unit provided to receive power.

The power supply unit may receive external power and internal power under the control of the processor 270 to supply power to each of the components included in the smart door 200. The power supply unit may include a battery, and the battery may be a built-in battery or a replaceable battery.

Meanwhile, in the following, various embodiments may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

3 is a block diagram showing a configuration of a terminal according to an embodiment of the present invention.

Referring to FIG. 3, the terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and Some or all of the power supply unit 190 may be included.

The wireless communication unit 110 includes one or more modules that enable wireless communication between the terminal 100 and a wireless communication system, between the terminal 100 and other terminals, or between the terminal 100 and an external server. Can include. In addition, the wireless communication unit 110 may include one or more modules that connect the terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example, It may include a touch key (touch key), a push key (mechanical key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the terminal 100, information on a surrounding environment surrounding the terminal 100, and user information.

For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, It may include at least one or more of a gravity sensor (G-sensor), a gyroscope sensor (gyroscope sensor), a motion sensor (motion sensor).

The sensing unit 140 includes an RGB sensor, an infrared sensor, a fingerprint recognition sensor, an ultrasonic sensor, an optical sensor, a microphone, a battery gauge, and an environmental sensor. (E.g., barometer, hygrometer, thermometer, radiation detection sensor, heat detection sensor, gas detection sensor, etc.), and chemical sensors (eg, electronic nose, healthcare sensor, biometric sensor, etc.) can do.

The terminal 100 disclosed in this specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and at least one of the display unit 151, the sound output unit 152, the hap tip module 153, and the light output unit 154 Can include.

The display unit 151 may form a layer structure with a touch sensor or are integrally formed to implement a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the terminal 100 and a user, and may provide an output interface between the terminal 100 and a user.

The interface unit 160 serves as a passage between various types of external devices connected to the terminal 100. The interface unit 160 is a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and a port for connecting a device equipped with an identification module. It may include at least one of (port), an audio input/output (I/O) port, an input/output (video I/O) port, and an earphone port. In response to the external device being connected to the interface unit 160, the terminal 100 may perform appropriate control related to the connected external device.

The memory 170 stores data supporting various functions of the terminal 100. The memory 170 may store a plurality of application programs (application programs or applications) driven by the terminal 100 and data or commands for operation of the terminal 100.

At least some of the application programs may be downloaded from an external server through wireless communication. In addition, at least some of the application programs may exist on the terminal 100 from the time of shipment for basic functions of the terminal 100 (eg, incoming calls, outgoing functions, message reception, and outgoing functions).

Meanwhile, the application program may be stored in the memory 170, installed on the terminal 100, and driven by the controller 180 to perform an operation (or function) of the terminal 100.

The controller 180 controls overall operations of the terminal 100 in addition to operations related to the application program. The controller 180 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. that are input or output through the above-described components or by driving an application program stored in the memory 170. have.

In order to drive an application program stored in the memory 170, the controller 180 includes the wireless communication unit 110, the input unit 120, the sensing unit 140, the output unit 150, the interface unit 160, and At least part of the memory 170 may be controlled.

The power supply unit 190 receives external power or internal power under the control of the controller 180 to supply power to each of the components included in the terminal 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

Meanwhile, the term “control unit” may be used interchangeably with the term “processor”.

4 is a flowchart showing a method of controlling a smart door according to an embodiment of the present invention, FIG. 5 is a view showing a method of authenticating a terminal in which a smart door is registered according to an embodiment of the present invention, and FIG. A diagram showing a method of registering a terminal in a smart door according to an embodiment of.

First, referring to FIG. 4, in step S10, the smart door 200 detects a visitor's approach.

Specifically, the smart door 200 may recognize that an object (person) approaches through a camera or an infrared sensor installed in front of the smart door 200.

When a visitor's approach is detected, in step S20, the smart door 200 determines whether to receive specific data or obtain code information from the registered terminal.

If it is determined that specific data has been received or code information has been obtained, in step S30, the smart door 200 determines whether the received data or code information is information related to parcel delivery. If the determination result is the parcel delivery-related information, the smart door 200 unlocks the second door 320 in step S40.

Specifically, the smart door 200 may receive a signal related to parcel delivery from a registered terminal. For example, the parcel delivery related signal may be a Bluetooth (BT) related signal.

As shown in FIG. 5, the smart door 200 may determine whether the registered terminal 30 enters within the detection range R centering on the smart door 200. That is, when the terminal 30 enters within the detection range R, the smart door 200 may receive a Bluetooth signal for the terminal 30.

Accordingly, the smart door 200 can confirm that the delivery driver 20 approaches the smart door 200 through a Bluetooth signal transmitted from the terminal 30.

In this case, the smart door 200 unlocks the second door 320 so that the food storage room 301 can be opened. Then, the delivery driver 20 may open the second door 320 to easily insert food or packaged goods into the food storage room 301.

When the lock on the second door 320 is released, the smart door 200 may transmit unlocking information to the user terminal. Therefore, when the lock on the second door 320 is released by the delivery man or the delivery driver, the user can easily know that the delivery has arrived through the terminal.

The courier-related signal may include a courier code or a courier arrival notification signal.

For example, the delivery driver 20 may access the smart door 200 and then transmit a delivery code or a delivery arrival notification signal to the smart door 200 using the terminal 30. Then, the smart door 200 may determine that the delivery driver 20 has approached and unlock the second door 320.

Meanwhile, hereinafter, a method of registering the terminal 30 in the smart door 200 will be described.

First, as shown in (a) of FIG. 6, the terminal 30 of the delivery driver 20 enters the Bluetooth setting screen. Then, the Bluetooth connection button 31 is selected on the Bluetooth setting screen.

When the Bluetooth connection button 31 is selected, a Bluetooth signal for the smart door 200 may be searched for and displayed as an icon 32 on the Bluetooth setting screen as shown in FIG. 6B. When the icon 32 is selected, a Bluetooth connection signal can be transmitted from the terminal 30 to the smart door 200.

The Bluetooth connection signal may include a Bluetooth Mac address, terminal information, or user information.

When the Bluetooth connection signal is transmitted, a Bluetooth connection signal to the terminal 30 of the delivery driver 20 is detected on the display unit 231 of the smart door 200 as shown in FIG. 6C. In addition, after checking the detected connection signal, the user selects the registration button 231a to complete the registration for the terminal 30. At this time, the smart door 200 may request a user to input a password to check whether to register the terminal 30 in the smart door 200.

According to this configuration, the delivery driver 20 can easily open the food storage room 301 provided in the smart door 200 without a separate authentication procedure. In addition, since the food storage room 301 maintains a low temperature storage state by cold air, it is possible to prevent food or parcels from being damaged or spoiled.

In addition, the smart door 200 may obtain code information related to parcel delivery. The code information related to parcel delivery may include a barcode, a QR code, and a dot code including parcel delivery information.

Hereinafter, a method for the smart door 200 to recognize code information will be described.

7 and 8 are diagrams illustrating a method for a smart door to recognize code information according to an embodiment of the present invention.

7 and 8, the smart door 200 may recognize the code information 11 attached to the package 10 or the code information displayed on the terminal 30.

For example, the sensor 221 of the smart door 200 includes a reader that recognizes code information. The reader may determine whether the packaged product 10 is a packaged product of the user by reading the code information 11 provided in the packaged product 10.

In this case, the smart door 200 may be in a state in which the corresponding code information has been previously transmitted through the server of the delivery company or the terminal 30 of the delivery driver 20. That is, the memory 250 of the smart door 200 may store pre-delivered parcel delivery-related code information. Accordingly, the smart door 200 compares the code information stored in the memory 250 with the code information acquired through the reader to check whether they match.

When the code information 11 is photographed or read, the corresponding code information 231d is displayed on the screen on the display unit 231 as shown in FIG. 8A. In addition, when the code information is authenticated, an authentication confirmation phrase 231e is displayed on the display unit 231 as shown in (b) of FIG. 8 and the lock for the second door 320 is released.

Accordingly, the delivery driver 20 may open the second door 30 to insert a package. In addition, when the second door 320 is closed, a lock for the second door 320 is set, and a lock setting screen 231f is displayed on the display unit 231 as shown in FIG. 8C. Can be displayed.

Meanwhile, when data or code information is not obtained from the terminal registered in step S20, the smart door 200 obtains biometric data for visitor authentication in step S60.

Specifically, the smart door 200 acquires biometric data related to a person's physical characteristics using the sensor 221 or the sensing unit 220.

As described above, the sensor 221 includes at least one of a fingerprint recognition sensor, a vein recognition sensor, an iris recognition sensor, a face recognition sensor, a voice recognition sensor, and a palm finger recognition sensor.

However, in order to accurately determine a person who approaches the smart door 200 from the outside, it is preferable to use the person's face data through a face recognition sensor. That is, the smart door 200 may acquire face data of a person approaching through a face recognition sensor.

Alternatively, the smart door 200 may acquire human fingerprint data through a fingerprint recognition sensor. In this case, the smart door 200 may acquire various biometric data through the fingerprint recognition sensor and the face recognition sensor.

In step S70, the smart door 200 authenticates the visitor by comparing the obtained biometric data with the stored biometric data.

Specifically, biometric data for family members is previously stored and registered in the memory 250 of the smart door 200. For example, the memory 250 may store fingerprint data, vein data, iris data, face data, voice data, palmistry data, and the like for each family member.

In addition, the smart door 200 may register biometric data for a desired person (eg, acquaintances or courier) in the memory 250 in advance.

With this configuration, the smart door 200 may determine whether the approaching visitor is a delivery driver, a family member, or an outsider.

If it is determined in step S80 that the visitor is a delivery driver, in step S40, the smart door 200 unlocks the second door 320.

9 is a diagram showing a method for a smart door to recognize a delivery driver according to an embodiment of the present invention.

Specifically, as shown in FIG. 9, when the delivery driver 20 approaches the smart door 200, the smart door 200 uses a sensor 221 to display the face of the delivery driver 20. Acquire data (images).

The smart door 200 compares the acquired face data with the face data stored in the memory 250 to determine whether the visitor is a registered delivery driver, a family member, or an outsider.

If it is determined that the visitor is a registered delivery driver, the smart door 200 unlocks the second door 320 so that the delivery driver 20 can open the second door 320. Then, the delivery driver 20 may open the second door 320 to easily insert food or packaged goods into the food storage room 301.

Meanwhile, hereinafter, a method of registering biometric data of the delivery driver 20 in the smart door 200 will be described.

10 is a diagram illustrating a method of registering biometric data of a delivery driver in a smart door according to an embodiment of the present invention.

First, as shown in (a) of FIG. 10, a user registration setting screen is entered from the main screen of the display unit 231.

In this case, in order to enter the user registration setting screen, the user may touch the main screen of the display unit 231 for a predetermined time. And after entering the password, the user can enter the user registration setting screen.

A family registration button 231g and an outsider registration button 231h may be displayed on the user registration setting screen.

The family registration button 231g is a button for registering a family member who can use both the first door 201 and the second door 320.

The outsider registration button 231h is a button for registering an outsider (courier or delivery person) who can only use the refrigerator door, that is, the second door 320.

Accordingly, the outsider registration button 231h is selected to register the delivery driver 20 to the smart door 200.

Then, as shown in (b) of FIG. 10, all of the face images 231i of a person photographed until recently may be displayed on the display unit 231.

At least some of the face images 231i displayed on the display unit 231 may be a person who has ever approached the smart door 231.

Alternatively, at least some of the face images 231i displayed on the display unit 231 may be images transmitted from the user terminal.

When the face image of the courier driver to be registered is selected from among the face images 231i displayed on the display unit 231, a confirmation window notifying that registration of an outsider is completed on the display unit 231 (231j) is output, and the face data for the delivery driver 20 is stored in the memory 250. In this case, the smart door 200 may request the user to input a password to check whether to register the selected face image in the memory 250.

With this configuration, when the delivery driver 20 approaches the smart door 200 and face data is recognized, the second door 320 is automatically unlocked and the second door 320 can be opened. It becomes a state of being.

Meanwhile, if it is determined in step S90 that the visitor is a family member, in step S100 the smart door 200 determines whether a touch on the door is detected.

Here, the reason for determining whether a touch on the door is detected is to confirm the intention of the user to open the first door 201 or to open the second door 320.

For example, when the user touches the second door 320, it may be recognized as an action for using the second door 320.

When a touch on the door is detected, the smart door 200 unlocks the second door 320 in step S40.

Hereinafter, a method of unlocking the second door by recognizing a family member by the smart door 200 will be described.

11 and 12 are diagrams illustrating a method of unlocking a second door by a smart door recognizing a family member according to an embodiment of the present invention.

First, referring to FIG. 11, when the user 40 approaches the front of the smart door 200, a face image of the user 40 may be confirmed by the sensor 221.

In this case, as illustrated in FIG. 12, the photographed face image 231k of the user 40 may be displayed on the display unit 231.

And when the touch 41 on the second door 320 is sensed, the smart door 200 determines that the user 40 wants to open the second door 320 and the second door 320 Unlock.

In this case, the touch 41 on the second door 320 may include a touch using a finger and a touch using a palm. That is, a sensing sensor for sensing a physical touch may be provided on the outer surface of the second door 320. The detection sensor may include a pressure-sensitive or capacitive sensor.

On the other hand, if the visitor is not a courier or a family member, the smart door 200 determines that the visitor is an outsider and maintains the locks of the first door 201 and the second door 320.

Claims (15)

A first door installed to divide an indoor space and an outdoor space and forming a food storage room therein;
A second door installed on the first door and capable of opening and closing the food storage compartment;
A sensing unit that obtains data for authentication of a visitor; And
And a processor that unlocks one of the first door and the second door based on the acquired data. The method of claim 1,
The processor,
Detecting the visitor's approach toward the smart door,
A smart door that acquires biometric data related to the visitor's physical characteristics when a visitor's approach is detected. The method of claim 2,
The processor,
A smart door that compares the acquired biometric data with the biometric data stored in the memory to determine whether the visitor is a family member, a delivery driver, or an outsider. The method of claim 3,
The processor,
If it is determined that the visitor is a member of the family, unlocking the first door,
A smart door that unlocks the second door when it is determined that the visitor is a delivery driver. The method of claim 3,
The processor, when determining that the visitor is a family member, determines whether a touch on the second door is detected. The method of claim 5,
When it is determined that the touch to the second door is not detected, the processor releases the lock on the first door. The method of claim 5,
The processor, when it is determined that the touch to the second door is detected, unlocks the second door. The method of claim 1,
The sensing unit includes at least one of a fingerprint recognition sensor for obtaining human fingerprint data, an iris recognition sensor for obtaining human iris data, and a face recognition sensor for obtaining human face data. The method of claim 1,
The processor, when the second door is unlocked, transmits unlocking information to the user terminal. The method of claim 1,
The processor is a smart door that performs visitor authentication by receiving specific data from a terminal registered in the smart door. The method of claim 10,
The specific data is a smart door including a Bluetooth connection signal transmitted from the terminal. The method of claim 10,
The processor, when receiving specific data from a terminal registered in the smart door, unlocks the second door. The method of claim 1,
The sensing unit includes a reader that recognizes code information of any one of a barcode, a QR code, and a dot code,
The processor, a smart door that authenticates a visitor based on code information recognized through the reader. The method of claim 13,
The processor,
Determine whether the recognized code information and the code information stored in the memory match,
When it is determined that they match, the smart door unlocks the second door. The method of claim 1,
The processor captures the visitor's face image through the sensing unit and stores it in a memory,
The face image stored in the memory can be registered as a visitor list.

Images