KR20220125656A - User terminal apparatus and control method thereof - Google Patents

Abstract

A user terminal device is disclosed. The user terminal device comprises: a communication interface for communication with multiple electronic devices arranged in a home; a memory in which a pet profile is stored; a display; and a processor which identifies the location of a user corresponding to that of the user terminal device and, when the identified location of the user is determined not to be in the home, controls the communication interface to transmit control signals for controlling the multiple electronic devices on the basis of the pet profile, and controls the display to display a UI providing pet information received from the multiple electronic devices. The present invention provides a UI for controlling the electronic device disposed in a home through an application based on a companion animal profile.

Description

User terminal device and its control method {USER TERMINAL APPARATUS AND CONTROL METHOD THEREOF}

The present disclosure relates to a user terminal device and a control method thereof, and more particularly, to a user terminal device for controlling an electronic device in a home through an application according to a profile of a companion animal, and a method for controlling the same.

BACKGROUND ART With the development of electronic technology, various types of electronic devices are being developed and distributed. In particular, home appliances used at home have been continuously developed in recent years to satisfy the needs of users.

Recently, various methods for controlling home appliances in a home through an application installed on a smart phone have been popularized.

On the other hand, when the user is absent due to going out, there is a problem that the control method of home appliances for providing a customized care function for the companion animal in a situation where the companion animal is alone in the home is not yet widely distributed.

SUMMARY OF THE INVENTION The present disclosure is to solve the above problems, and an object of the present disclosure is to provide a UI for controlling an electronic device disposed in a home through an application based on a companion animal profile, and to provide a companion animal received from the electronic device. An object of the present invention is to provide a user terminal device for providing information and a method for controlling the same.

A user terminal device according to an embodiment of the present disclosure for achieving the above object includes a communication interface for communicating with a plurality of electronic devices disposed in a home, a memory in which a companion animal profile is stored, a display, and the user terminal Check the location of the user corresponding to the location of the device, and control the communication interface to transmit a control signal for controlling the plurality of electronic devices based on the companion animal profile when it is determined that the confirmed user location is not the home and a processor controlling the display to display a UI providing companion animal information received from the plurality of electronic devices.

In this case, the control signal for controlling the plurality of electronic devices is a control signal for controlling to perform a preset operation corresponding to the companion animal profile, a signal for controlling the robot cleaner to clean with a low suction intensity, and the companion animal profile. A signal to control the air conditioner to set the temperature corresponding to the age or fur length of the companion animal included in the animal profile, a signal to control the cooking device to deactivate the control unit, a signal to control the TV to output companion animal content, strong wind A signal for controlling the air purifier to set the intensity, a signal for controlling the companion animal feeder to adjust the number of feedings and the amount of feeding according to the companion animal profile, and a signal for controlling the blind to adjust opening and closing according to the companion animal profile may include at least one of

Meanwhile, the user terminal device further includes a location sensor, and the processor checks the user location based on the location of the user terminal device sensed by the location sensor, and the confirmed user location is preset from the home. If the distance is greater than the distance, it may be determined that the user's location is not the home.

Meanwhile, the plurality of electronic devices include a robot cleaner, and the processor is a UI that provides the received motion information or sound information when motion information or sound information of a companion animal sensed through a sensor of the robot cleaner is received The display may be controlled to display

In this case, the sound information of the companion animal may include at least one of a number of barking, a degree of barking, and a barking time of the companion animal.

Meanwhile, the plurality of electronic devices include an AI speaker, and when a companion animal sound detection signal is received from the robot cleaner, the communication interface is configured to receive sound generation location information from the robot cleaner and the AI speaker. control, estimating a sound generating position based on the sound generating position information received from the robot cleaner and the AI speaker, and transmitting a control signal for controlling to move to the estimated sound generating position to the robot cleaner, and the robot cleaner When the companion animal image photographed at the sound generating position is received from the display, the display may be controlled to display a UI providing the received image.

Meanwhile, the processor controls the display to display at least one of a UI or content corresponding to the motion information or sound information of the companion animal, and the UI or content is a calming sound through a speaker of the robot cleaner. sound), a UI for controlling an active sound or white noise output, and at least one of expert consultation recommended content.

On the other hand, when the motion detection information of the companion animal is received from the robot cleaner, the processor transmits a control signal for controlling the companion animal to move along the companion animal and photograph the companion animal through the camera of the robot cleaner to the robot cleaner, When the photographed image of the companion animal is received from the robot cleaner, the display may be controlled to display a UI providing the received photographed image.

In this case, the companion animal profile includes information on the type of companion animal, and the processor controls the height adjustment range of the camera of the robot cleaner to photograph the height range corresponding to the activity range according to the type of companion animal. to transmit a control signal to the robot cleaner.

Meanwhile, the processor may control the display to provide a manual operation UI for controlling the movement of the robot cleaner, and transmit a control signal corresponding to a user input through the manual operation UI to the robot cleaner.

On the other hand, the method of controlling a user terminal device according to an embodiment of the present disclosure includes the steps of checking a user's location corresponding to the location of the user terminal device, and when it is determined that the checked user location is not home, the and transmitting a control signal for controlling a plurality of electronic devices disposed in the home based on the companion animal profile, and displaying a UI providing companion animal information received from the plurality of electronic devices.

In this case, the control signal for controlling the plurality of electronic devices is a control signal for controlling to perform a preset operation corresponding to the companion animal profile, a signal for controlling the robot cleaner to clean with a low suction intensity, and the companion animal profile. A signal to control the air conditioner to set the temperature corresponding to the age or fur length of the companion animal included in the animal profile, a signal to control the cooking device to deactivate the control unit, a signal to control the TV to output companion animal content, strong wind A signal for controlling the air purifier to set the intensity, a signal for controlling the companion animal feeder to adjust the number of feedings and the amount of feeding according to the companion animal profile, and a signal for controlling the blind to adjust opening and closing according to the companion animal profile may include at least one of

On the other hand, the step of confirming the location of the user, checking the user location based on the location of the user terminal device sensed by the location sensor, and if the confirmed user location is greater than a preset distance from the home, the user location is the home It can be judged that this is not the case.

Meanwhile, the plurality of electronic devices include a robot cleaner, and the displaying of the UI includes when motion information or sound information of a companion animal sensed through a sensor of the robot cleaner is received, the received motion information or sound information You can display a UI that provides

In this case, the sound information of the companion animal may include at least one of a number of barking, a degree of barking, and a barking time of the companion animal.

Meanwhile, the plurality of electronic devices include an AI speaker, and when a companion animal sound detection signal is received from the robot cleaner, receiving sound generation location information from the robot cleaner and the AI speaker, the robot cleaner and the AI Estimating a sound generating position based on sound generating position information received from a speaker, and transmitting a control signal for controlling to move to the estimated sound generating position to the robot cleaner, and displaying the UI may display a UI providing the received image when the companion animal image photographed at the sound generating position is received from the robot cleaner.

Meanwhile, the control method includes displaying at least one of UI or content corresponding to motion information or sound information of the companion animal, wherein the UI or content is a calming sound through a speaker of the robot cleaner. ), a UI for controlling an active sound or white noise output, and at least one of expert consultation recommended content.

Meanwhile, in the control method, when motion detection information of the companion animal is received from the robot cleaner, the robot cleaner moves along the companion animal and transmits a control signal for controlling the companion animal to be photographed through the camera of the robot cleaner to the robot cleaner. and, in the displaying of the UI, when a photographed image of a companion animal is received from the robot cleaner, a UI providing the received photographed image may be displayed.

In this case, the companion animal profile includes information on the type of companion animal, and the transmitting includes: a height adjustment range of the camera of the robot cleaner to photograph a height range corresponding to the activity range according to the type of companion animal may transmit a control signal for controlling to the robot cleaner.

Meanwhile, the control method may further include providing a manual operation UI for controlling movement of the robot cleaner and transmitting a control signal corresponding to a user input through the manual operation UI to the robot cleaner.

1 is a diagram schematically illustrating an electronic system according to an embodiment of the present disclosure.
2 is a block diagram illustrating a configuration of a user terminal device according to an embodiment of the present disclosure.
3 is a block diagram illustrating a detailed configuration of a user terminal device according to an embodiment of the present disclosure.
4 is a flowchart illustrating an operation of a user terminal device according to an embodiment of the present disclosure.
5 is a diagram for describing operations performed by a plurality of electronic devices under control of a user terminal device according to an embodiment of the present disclosure.
6 is a view for explaining a companion animal profile according to an embodiment of the present disclosure.
7 is a diagram for explaining an example of a UI provided through a user terminal device to control a plurality of electronic devices.
8 is a diagram for describing an example of a UI for managing an electronic device control schedule of a user terminal device according to an embodiment of the present disclosure.
9 is a view illustrating an operation of estimating a sound generation position of a companion animal through a robot cleaner and an AI speaker and transmitting an image of the companion animal photographed at the sound generation position to the user terminal device according to an embodiment of the present disclosure; It is a drawing.
10 is a diagram for explaining an operation of providing a notification and real-time monitoring through a user terminal device when a sound of a companion animal is detected by the robot cleaner according to an embodiment of the present disclosure;
11 is a diagram for explaining a UI corresponding to sound information of a companion animal and a UI for providing customized content accordingly.
12 is a diagram for explaining a UI for providing a sound generation history of a companion animal.
13 is a view for explaining a UI for controlling a sound output through a speaker of the robot cleaner.
14 is a diagram for explaining a UI for controlling a robot cleaner to observe and photograph a companion animal.
15 is a diagram for explaining a UI for manually controlling the movement of a robot cleaner to observe and photograph a companion animal.
16 is a diagram for explaining an operation of automatically photographing a companion animal and providing a photographed image to a user terminal device when the robot cleaner recognizes the companion animal according to an embodiment of the present disclosure.
17 is a diagram for explaining a UI for providing a photographed image of a companion animal received from a robot cleaner.
18 is a diagram for explaining an operation of providing a notification through a user terminal device when the movement of the companion animal is not detected through the robot cleaner.
19 is a diagram for explaining an example of a UI for managing the weight and feed information of a companion animal.
20 is a diagram for explaining an example of a UI for controlling a feeder according to the weight and feed information of the companion animal.
21 is a diagram for explaining a UI for providing a regular feed purchase service according to feed information.
22 and 23 are diagrams for explaining an example of a companion animal care application provided through a user terminal device according to an embodiment of the present disclosure.
24 is a flowchart illustrating a method of controlling a user terminal device according to an embodiment of the present disclosure.

It should be understood that the embodiments described below are illustratively shown to help the understanding of the present disclosure, and the present disclosure may be implemented with various modifications, unlike the embodiments described herein. However, in the following description of the present disclosure, if it is determined that a detailed description of a related known function or component may unnecessarily obscure the subject matter of the present disclosure, the detailed description and specific illustration thereof will be omitted. In addition, the accompanying drawings are not drawn to scale in order to help understanding of the disclosure, but dimensions of some components may be exaggerated.

The terms used in this specification and claims have been chosen in consideration of the function of the present disclosure. However, these terms may vary depending on the intention, legal or technical interpretation of a person skilled in the art, and the emergence of new technology. Also, some terms are arbitrarily selected by the applicant. These terms may be interpreted in the meaning defined in the present specification, and if there is no specific term definition, it may be interpreted based on the general content of the present specification and common technical knowledge in the art.

In the description of the present disclosure, the order of each step should be understood as non-limiting unless the preceding step must be logically and temporally performed before the subsequent step. That is, except for the above exceptional cases, even if the process described as the subsequent step is performed before the process described as the preceding step, the essence of the disclosure is not affected, and the scope of rights should also be defined regardless of the order of the steps.

In the present specification, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The above terms may be used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present disclosure, a first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

In addition, since the present specification describes components necessary for the description of each embodiment of the present disclosure, the present disclosure is not necessarily limited thereto. Accordingly, some components may be changed or omitted, and other components may be added. In addition, they may be distributed and arranged in different independent devices.

Furthermore, embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings and the contents described in the accompanying drawings, but the present disclosure is not limited or limited by the embodiments.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating an electronic system according to an embodiment of the present disclosure.

Referring to FIG. 1 , an electronic system 1000 may include a user terminal device 100 , a plurality of electronic devices 200 disposed in a home 10 , and a server 20 .

The user terminal device 100 is a device capable of performing various functions, such as providing information to a user or receiving a user command, and may be various electronic devices such as a smart phone, a tablet, a wearable device, and a PC.

According to an embodiment of the present disclosure, the user terminal device 100 controls a plurality of electronic devices 200 disposed in the home 10 through an application, and displays information received from the plurality of electronic devices 200 . UI can be provided. In particular, in a state where the user lives with the companion animal, the user terminal device 100 may provide a customized care service for taking care of the companion animal alone in the home 10 when the user is absent.

The plurality of electronic devices 200 include a robot cleaner 210, an AI speaker 220, an air conditioner, a lighting device, a kitchen device, a TV, an air purifier, a feeder for companion animals, a blinds, a PC, a laptop ( laptop), a refrigerator, an oven, a cooktop, a microwave oven, a dishwasher, a washing machine, a dryer, a clothes processor, and the like, and may include an Internet of Things (IoT) device capable of Wi-Fi communication.

For example, the plurality of electronic devices 200 may be various IoT devices controllable through an application installed in the user terminal device 100 .

The server 20 may refer to an electronic device that collects and processes data of an external device. For example, the server 20 is not only a device that performs a function dedicated to the server, such as a cloud server, but also various electronic devices such as a smartphone, tablet, wearable device, and PC capable of performing the function of the server together with other functions. may be implemented. However, this is only an example, and the server 20 may be implemented with various types of electronic devices not listed here. Also, the server 20 may be implemented as a single device or as an aggregate comprising a plurality of devices. For example, the server 20 may be a server that provides a SmartThings™ service.

Meanwhile, various operations performed by the electronic device such as the user terminal device 100 , the robot cleaner 210 , and the AI speaker 220 disclosed herein may be performed through the server 20 .

The user terminal device 100 may download and install an application from a server (not shown) that provides the application. In this case, the user executes the application in the user terminal device 100 and inputs a user account, and can log in to the server 20 through the input user account, and the user terminal device 100 receives the logged in user account. Based on the communication can be performed with the server (20).

The user terminal device 100 accesses the server 20 through the access point 30 or accesses the server 20 through a mobile communication network such as LTE, 5G, etc. It is possible to transmit and receive various information to and from the server 20 through the For example, the user terminal device 100 may transmit a control signal for controlling the plurality of electronic devices 200 through the server 20 or receive information provided from the plurality of electronic devices 200 .

2 is a block diagram illustrating a configuration of a user terminal device according to an embodiment of the present disclosure.

Referring to FIG. 2 , the user terminal device 100 may include a communication interface 110 , a memory 120 , a display 130 , and a processor 140 .

The communication interface 110 may transmit/receive various data by performing communication with an external device. For example, the user terminal device 100 may transmit/receive information to and from the plurality of electronic devices 200 and the server 20 through the communication interface 110 .

The communication interface 110 can communicate with an external device through a local area network (LAN), an Internet network, and a mobile communication network, as well as BT (Bluetooth), BLE (Bluetooth Low Energy), WI- It is possible to communicate with an external device through various communication methods such as FI (Wireless Fidelity), WI-FI Direct (Wireless Fidelity Direct), Zigbee, NFC, and the like. To this end, the communication interface 110 may include various communication modules for performing network communication. For example, the communication interface 110 may include a Bluetooth chip, a Wi-Fi chip, a wireless communication chip, and the like.

The memory 120 is electrically connected to the processor 140 and may store data necessary for various embodiments of the present disclosure.

Specifically, a companion animal profile may be stored in the memory 120 . The companion animal profile refers to information about companion animals, and may include information on the type, breed, name, date of birth, gender, weight, neutering, vaccination, past medical history, etc. of the companion animal. The companion animal profile may be saved by a user's input.

Meanwhile, the memory 120 may store commands or data related to at least one other component of the user terminal device 100 . The memory 120 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The memory 120 is accessed by the processor 140 , and reading/writing/modification/deletion/update of data by the processor 140 may be performed. In the present disclosure, the term memory refers to a memory 120, a ROM, a RAM, or a memory card mounted in the user terminal device 100 (eg, micro SD card, memory stick) in the processor 140 . may include.

The display 130 may output information in a visual form. The display 130 may display various UIs provided through applications.

The display 130 may be implemented as a display including a self-luminous device or a display including a non-light-emitting device and a backlight. For example, Liquid Crystal Display (LCD), Organic Light Emitting Diodes (OLED) displays, Light Emitting Diodes (LEDs), micro LEDs (micro LEDs), Mini LEDs, Plasma Display Panel (PDP), Quantum dot (QD) displays. , Quantum dot light-emitting diodes (QLEDs) may be implemented in various types of displays. The display 130 may also include a driving circuit, a backlight unit, and the like, which may be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, or an organic TFT (OTFT). On the other hand, the display 130 is implemented as a touch screen combined with a touch sensor, a flexible display, a rollable display, a three-dimensional display (3D display), a display in which a plurality of display modules are physically connected, etc. can be

The processor 140 is electrically connected to the communication interface 110 , the memory 120 , and the display 130 , and may control the overall operation of the user terminal device 100 .

According to an embodiment of the present disclosure, the processor 140 checks the user's location corresponding to the location of the user terminal device 100 , and when it is determined that the checked user location is not the home, multiple items based on the companion animal profile controls the communication interface 110 to transmit a control signal for controlling the electronic device 200 of can do.

Accordingly, the plurality of electronic devices 200 disposed in the groove 10 are controlled according to the companion animal profile, and the companion animal detected by the plurality of electronic devices 200 in the groove 10 is controlled even when the user is absent. The status information may be received and provided, and a personalized care service for companion animals may be provided to the user by recommending customized contents according to the condition of the companion animal.

To this end, the processor 140 may be implemented as a digital signal processor (DSP), a microprocessor (microprocessor), or a time controller (TCON) that processes digital signals, but is not limited thereto, and the central central processing unit (CPU), micro controller unit (MCU), micro processing unit (MPU), controller, application processor (AP), or communication processor (CP) , ARM processor, AI (Artificial Intelligence) processor, or may include one or more of, or may be defined by a corresponding term In addition, the processor 140 is a SoC (System on Chip) with a built-in processing algorithm, LSI (large scale) integration) or implemented in the form of a field programmable gate array (FPGA), the processor 140 may perform various functions by executing computer executable instructions stored in the memory 120 . can

3 is a block diagram illustrating a detailed configuration of a user terminal device according to an embodiment of the present disclosure.

Referring to FIG. 3 , the user terminal device 100 includes a communication interface 110 , a memory 120 , a display 130 , a processor 140 , a position sensor 150 , an input interface 160 , and an output interface 170 . ) may be included. A detailed description of the portion overlapping with the configuration shown in FIG. 2 among the configuration shown in FIG. 3 will be omitted.

The position sensor 150 may sense the position of the user terminal device 100 . The location sensor 150 may be implemented as a global positioning system (GPS) receiver, but is not limited and applicable as long as it can acquire location information of the user terminal device 100 .

The input interface 160 may receive various user commands. For example, the input interface 160 may receive a user command for controlling the user terminal device 100 . The input interface 160 may include a physical button for receiving a user command, a microphone for receiving a user's spoken voice, and a display for receiving a user command through a touch screen.

The output interface 170 may include at least one of a display and a speaker. Here, the display is a device for outputting information in a visual form (eg, text, image, etc.). The display may display the image frame in all or part of the display area. The display area may refer to the entire area of a pixel unit in which information or data is visually displayed. A speaker is a device that outputs information in an audible form (eg, voice). The speaker may directly output various types of notification sounds or voice messages as well as various audio data on which various processing operations such as decoding, amplification, and noise filtering have been performed by the audio processing unit.

4 is a flowchart illustrating an operation of a user terminal device according to an embodiment of the present disclosure.

Referring to FIG. 4 , the user terminal device 100 may determine the user's location ( S410 ) and determine whether the user's location is the home ( S420 ). When it is determined that the identified user's location is not the home, the user terminal device 100 may transmit a control signal for controlling the plurality of electronic devices 200 ( S430 ). Here, the user terminal device 100 may transmit a control signal corresponding to each of the plurality of electronic devices to each electronic device. When the control signal is received, the plurality of electronic devices 200 may perform an operation corresponding to the control signal. A detailed description related thereto will be described later with reference to FIG. 5 .

The plurality of electronic devices 200 may transmit information collected about the companion animal to the user terminal device 100 ( S440 ). For example, the robot cleaner 210 may provide an image of a companion animal captured through a camera or sound information of the companion animal received through a microphone to the user terminal device. The user terminal device 100 may display a UI providing companion animal information received from the plurality of electronic devices 200 through the display 130 . A detailed description related thereto will be described later with reference to the accompanying drawings.

5 is a diagram for describing operations performed by a plurality of electronic devices under control of a user terminal device according to an embodiment of the present disclosure.

The control signal transmitted by the user terminal device 100 is a control signal for controlling to perform a preset operation corresponding to the companion animal profile, and the plurality of electronic devices 200 receive the control signal corresponding to the companion animal profile. A preset operation may be performed.

Referring to FIG. 5 , a preset operation performed according to a type of an electronic device is illustrated by way of example.

For example, the control signal transmitted by the user terminal device 100 is a signal for controlling the robot cleaner to clean with a low suction intensity, and the air conditioner to set a temperature corresponding to the age or hair length of the companion animal included in the companion animal profile. A signal to control the control unit, a signal to control the cooking device so that the operation unit is deactivated, a signal to control the TV to output companion animal content, a signal to control the air purifier to set a strong wind strength, the number of feedings and It may include a signal for controlling various electronic devices disposed in the groove, such as a signal for controlling a feeder for companion animals to adjust the feed amount and a signal for controlling a blind to adjust opening/closing according to the companion animal profile.

6 is a view for explaining a companion animal profile according to an embodiment of the present disclosure.

Referring to FIG. 6 , the user terminal device 100 may provide a UI for displaying a companion animal profile through an application.

The companion animal profile refers to information about companion animals, and may include information on the type, breed, name, date of birth, gender, weight, neutering, vaccination, past medical history, etc. of the companion animal.

The user can input or modify information included in the companion animal profile through the UI that displays the companion animal profile.

The input companion animal profile may be stored in the memory 120 of the user terminal device 100 or stored in the server 20 providing an application.

7 is a diagram for explaining an example of a UI provided through a user terminal device to control a plurality of electronic devices.

Referring to FIG. 7 , the user may activate or deactivate “Pet alone mode” through the UI provided through the user terminal device 100 , and may input activation/deactivation for each registered electronic device. “Pet alone mode” may mean a mode set in a situation where the companion animal is alone in the home when the user is absent, and whether the user is absent through the user's location detection through the user's location sensor 150 or directly set by the user It can be determined automatically.

When a registered electronic device is activated while “Pet alone mode” is activated, the activated electronic device may perform a pre-stored operation corresponding to the companion animal profile. For example, referring to FIG. 7 , when activating the operation of the air conditioner, the air conditioner sets a higher temperature than that of the long-haired breed based on the companion animal profile set for the short-haired breed (eg, 25 degrees for long-haired, short-haired breed) It can be operated with a temperature setting of 27 degrees).

8 is a diagram for describing an example of a UI for managing an electronic device control schedule of a user terminal device according to an embodiment of the present disclosure.

Referring to FIG. 8 , the user may input detailed settings for each of a plurality of electronic devices disposed in the home 10 through the UI of the user terminal device 100 . For example, whether to activate the pet alone mode may be input for each electronic device, and the activation time may be set to operate in the pet alone mode only at a specific time.

9 is a view illustrating an operation of estimating a sound generation position of a companion animal through a robot cleaner and an AI speaker and transmitting an image of the companion animal photographed at the sound generation position to the user terminal device according to an embodiment of the present disclosure; It is a drawing.

When the motion or sound of the companion animal is detected, the robot cleaner 210 may check the location of the companion animal based on the detection result, and may move to the location where the companion animal is located and photograph the companion animal. In this case, the robot cleaner 210 may more precisely estimate the location of the companion animal in cooperation with the AI speaker 220 disposed in the groove 10 .

Referring to FIG. 9 , when the sound of the companion animal is detected ( S910 ), the robot cleaner 210 may transmit a sound generation position detection command to the AI speaker 220 ( S920 ).

The robot cleaner 210 may detect the motion or sound of the companion animal through a configuration of a built-in camera, a LiDAR sensor, a motion sensor, a microphone, and the like.

The robot cleaner 210 may generate and store a map for the internal structure of the groove 10 . The robot cleaner 210 may store the location of the AI speaker 220 on the map. The position of the AI speaker 220 is stored according to user input through the application, or the position of the AI speaker 220 is stored through wireless communication such as BLE (Bluetooth Low Energy), UWB (Ultra-wideband) of the robot cleaner 210. can be detected and stored.

The AI speaker 220 may detect a sound in response to receiving a sound generation position detection command of the robot cleaner 210 and transmit sound generation position information to the robot cleaner 210 (S930).

The robot cleaner 210 may estimate the sound generation location based on the sensed sound generation location information and the sound generation location information received from the AI speaker 220 ( S940 ).

For example, the sound generation location information received from the AI speaker 220 may include information on the sound generation direction determined using a time difference at which sound is received through a plurality of microphones provided in the AI speaker 220. have. The robot cleaner 210 may estimate a point where the sound generation direction sensed through the built-in microphone and the sound generation direction received through the AI speaker 220 overlap with each other as the sound generation position.

The robot cleaner 210 may move to the estimated sound generating position (S950) and photograph the companion animal at the sound generating position through the camera (S960). The robot cleaner 210 may transmit the photographed companion animal image to the user terminal device 100 (S970), and the user terminal device 100 may display a UI providing the photographed companion animal image (S980).

Meanwhile, the above-described operation may be performed through the processor 140 of the user terminal device 100 .

For example, when a companion animal sound detection signal is received from the robot cleaner 210 , the processor 140 of the user terminal device 100 receives sound generation location information from the robot cleaner 210 and the AI speaker 220 . A control signal for controlling the communication interface 110, estimating the sound generating position based on the sound generating position information received from the robot cleaner 210 and the AI speaker 220, and controlling to move to the estimated sound generating position It can be transmitted to the robot cleaner 210 .

In addition, when a companion animal image photographed at a sound generating position is received from the robot cleaner 210 , the processor 140 may control the display 130 to display a UI providing the received image.

10 is a diagram for explaining an operation of providing a notification and real-time monitoring through a user terminal device when a sound of a companion animal is detected by the robot cleaner according to an embodiment of the present disclosure;

Referring to FIG. 10 , when companion animal sound detection information is received from the robot cleaner 210 , the user terminal device 100 may display a notification UI. When the user selects 'OK' of the notification UI, the user terminal device 100 may provide the companion animal monitoring UI. In this case, the companion animal monitoring UI may provide a real-time image of the companion animal captured through the robot cleaner 210 and a map displaying the positions of the companion animal and the robot cleaner 210 .

Accordingly, the user terminal device 100 may provide a function for the user to grasp the state of the companion animal in real time by providing an immediate notification when the companion animal sound is detected through the robot cleaner 210 .

11 is a diagram for explaining a UI corresponding to sound information of a companion animal and a UI for providing customized content accordingly.

Referring to FIG. 11 , the user terminal device 100 may display a UI providing information on the number of times the companion animal barks while alone, and may provide recommended content accordingly. For example, if the number of times the companion animal barks is greater than or equal to a preset number, content recommending expert consultation may be provided. Accordingly, the user may register expert consultation through the application.

12 is a diagram for explaining a UI for providing a sound generation history of a companion animal.

Referring to FIG. 12 , the sound generation history UI may visually provide sound information of various companion animals, such as the number of barking, the degree of barking, and the barking time of the companion animal by date. In addition, through the UI, when a barking of a companion animal occurs, a time period for receiving a notification may be input.

The sound generation history UI may display the date item 1210 and the total number of times the companion animal barked 1220 on the date. In addition, the sound generation history UI may display analysis information (or insight, 1230) by analyzing the barking frequency that occurred on a corresponding day.

The analysis information 1230 may be expressed in various ways. For example, referring to FIG. 2 , the analysis information 1230 may provide information on a time period in which the most barking occurs, such as “I barked a lot around 2 PM” by analyzing the number of barking times of the companion animal. Meanwhile, the analysis information 1230 combines the user's location information (or whether the user is present) and the number of barking information collected through communication with other electronic devices in the home, such as "the user barked a lot right after going out". It is possible to provide analysis information expressing the correlation between the presence of the user and the number of barking. In addition, by combining the operation state information of other electronic devices in the home (eg, the operation time of the dish washing machine, the feed provision time of the feed providing device) and the number of barking information, “there was a lot of barking during the time the dishwasher was operating (3 pm)” It is possible to provide analysis information expressing a correlation between the operation state of another electronic device and the number of barking, such as “I barked a lot before feeding (10 am)”.

The sound generation history UI may provide a graph 1240 visually showing the number of barkings over time. In the graph 1240 , the X axis may represent time, and the Y axis may represent the number of barking. When the barking number option 1241 is selected in the sound generation history UI, a graph 1240 of the number of barking over time may be displayed. On the other hand, if the “Receiving notification when barking” option 1242 is selected, a UI for setting a time period for providing a notification when a barking of a companion animal occurs may be displayed. The UI for explaining the time zone for providing the notification may be displayed in the form input by the user through the graph 1240, but is not limited thereto, and a new UI for inputting the time may be displayed on the screen.

Meanwhile, when a plurality of companion animal profiles are registered, bark information of each companion animal may be displayed separately on the sound generation history UI. For example, the number of times of barking for each companion animal may be displayed in different colors on the graph 1240 . In this case, the graph 1240 may be provided in various ways, such as a bar graph and a line graph, for distinguishing and displaying a plurality of pieces of information.

Meanwhile, the sound generation history UI may display an item indicating detailed information on barking information. For example, by selecting a time zone through the option 1250 for selecting a detailed time zone, information about barking occurring in the corresponding time zone may be specifically displayed.

13 is a view for explaining a UI for controlling a sound output through a speaker of the robot cleaner.

Referring to FIG. 13 , the user terminal device 100 may provide a UI for receiving a sound to be output through the speaker of the robot cleaner 210 disposed in the home 10 . When there are a plurality of robot cleaners in the home 10 , the user may select the robot cleaner to perform a sound output operation through the UI.

In this case, the robot cleaner may output a calming sound and white noise capable of stabilizing the companion animal to relieve barking through the speaker. On the other hand, when it is detected that the companion animal is not moving continuously, an active sound can be output.

For example, the robot cleaner 210 may detect the state of the companion animal through the camera and output a sound corresponding to the state of the companion animal through the speaker. When the camera detects that the pet is not moving continuously, it outputs an active sound, and when it detects the pet's barking through the microphone, a stable sound can be output.

In addition, if it is determined based on the map stored in the robot cleaner 210 that the companion animal is in front of the entrance, the companion animal may move to a location near the location of the companion animal and output white noise, thereby canceling the external sound to alleviate the anxiety of the companion animal. If the noise generated in the home during the user's absence is too loud, the anxiety of the companion animal may be amplified. Therefore, if the noise detected through the microphone is greater than or equal to a preset value, white noise may be output to offset the noise.

On the other hand, the robot cleaner 210 can automatically output music in response to surrounding situations, such as when it detects the barking of the companion animal, when the companion animal is standing at the entrance (when waiting for the owner), when the surrounding noise is too loud, etc. . In this case, the robot cleaner 210 may automatically stop outputting music upon receiving information that the user has entered the home through the position detection of the position sensor from the user terminal device 100 .

Here, the sound output through the speaker of the robot cleaner 210 may be music, white noise, or sound effect.

Meanwhile, when there are a plurality of robot cleaners in the home 10 , the robot cleaner closest to the current companion animal may output a sound. For example, after the companion animal moves to another room, if the companion animal is found through the camera of another robot cleaner, a sound playback command is transmitted to the robot cleaner located in the room where the companion animal is located based on the stored map information. can

On the other hand, the robot cleaner 210 becomes a medium for determining the state of the companion animal, determines the companion animal information, and outputs sound or reproduces TV channels for companion animals to other electronic devices (eg, TV, speaker) in the home 10 . A control signal can be transmitted.

Meanwhile, the user terminal device 100 may display a UI for controlling output of a calming sound, an active sound, or a white noise through a speaker of the robot cleaner.

14 is a diagram illustrating a UI for controlling the robot cleaner to observe and photograph a companion animal, and FIG. 15 is a diagram illustrating a UI for manually controlling the movement of the robot cleaner to observe and photograph a companion animal.

The companion animal may be photographed through the camera provided in the robot cleaner 210 , and the user terminal device 100 may provide a monitoring function for displaying the companion animal image received from the robot cleaner 210 . In this case, by controlling the movement of the robot cleaner 210 through manipulation using a map or manual manipulation, the companion animal can be monitored at a location desired by the user.

The user terminal device 100 may display the map generated by the robot cleaner 210, control the robot cleaner 210 to move to the corresponding location when a location or room for monitoring is input, and provide a movement completion notification. . On the other hand, when a plurality of desired locations are designated, they can be monitored while moving in the selected order.

Meanwhile, the height adjustment range of the camera of the robot cleaner 210 may be controlled according to the companion animal profile. For example, the companion animal profile includes information on the type of companion animal (dog, cat, etc.), and the robot cleaner 210 captures the angle of the camera to photograph the height range corresponding to the activity range according to the type of companion animal. Or you can adjust the shooting position.

As an example, the robot cleaner 210 may set a basic value of the camera's shooting height adjustment range to 0 cm to 40 cm when the type of companion animal is individual, and may set it to 0 cm to 140 cm in the case of a cat. The robot cleaner 210 may perform a companion animal detection operation within a set height range. Here, the companion animal detection operation is an operation of detecting whether a companion animal is present in the photographed image.

When the robot cleaner 210 includes one fixed camera, the companion animal detection operation may not be performed on a portion above the height range in the image captured by the camera.

When there are a plurality of fixed cameras in the robot cleaner 210, the companion animal detection operation may not be performed on images captured by a camera that does not fall within the corresponding height range (eg, a camera that shoots at an elevated angle if a companion animal is an individual). have.

When the robot cleaner 210 includes a mobile camera, the camera shooting angle may be changed according to the height range setting.

16 is a view for explaining an operation of automatically photographing a companion animal and providing a photographed image to a user terminal device when the robot cleaner recognizes the companion animal according to an embodiment of the present disclosure, and FIG. 17 is a view for receiving from the robot cleaner It is a diagram for explaining a UI that provides a photographed image of a companion animal.

When a movement is detected through a lidar sensor or a motion sensor or a companion animal is recognized through a camera, the robot cleaner 210 may automatically capture an image through the camera and provide it to the user terminal device 100 . Also, when a companion animal is detected, a notification may be provided through the user terminal device 100 .

The captured image may be provided through the user terminal device 100 in a real-time streaming format while shooting is in progress, and the captured image is stored in the user terminal device 100 or the server 20 and can be checked when the user wants it. have.

The robot cleaner 210 may move to a location designated by the user or move to the center of the room based on the map of the robot cleaner 210 and check whether motion is detected through the lidar sensor. When a motion is detected, the robot cleaner 210 may perform a photographing operation through a camera with respect to a position where the motion occurs.

When the photographing operation is performed through the camera, the companion animal recognition operation may be performed on the photographed image. When the companion animal is recognized in the photographed image, the robot cleaner 210 may photograph the companion animal while moving along the companion animal.

Meanwhile, the above-described operation of controlling the robot cleaner 210 may be performed through the processor 140 of the user terminal device 100 .

For example, when motion detection information of the companion animal is received from the robot cleaner 210 , the processor 140 moves along the companion animal and sends a control signal for controlling the companion animal to be photographed through the camera of the robot cleaner 210 . When transmitted to the robot cleaner 210 and a photographed image of the companion animal is received from the robot cleaner 210 , the display 130 may be controlled to display a UI providing the received photographed image.

18 is a diagram illustrating a UI for providing a notification through a user terminal device when the movement of a companion animal is not detected through a robot cleaner, and FIG. 19 is a diagram illustrating an example of a UI for managing the weight and feed information of the companion animal; 20 is a diagram illustrating an example of a UI for controlling a feeder according to the weight and feed information of a companion animal, and FIG. 21 is a diagram illustrating a UI for providing a regular feed purchase service according to the feed information.

22 and 23 are diagrams for explaining an example of a companion animal care application provided through a user terminal device according to an embodiment of the present disclosure.

22 and 23 , the companion animal care application includes a companion animal status information content and product recommendation UI, a UI for setting a companion animal care mode (Pet alone mode), a companion animal monitoring UI, and a diary that provides captured images UI, music box UI that controls sound output through the speaker of the electronic device in the home 10, companion animal weight management UI, UI that recommends expert consultation content, pet cast, pet care chatbot, pet mission, talk box, etc. of various UIs and contents can be provided.

24 is a flowchart illustrating a method of controlling a user terminal device according to an embodiment of the present disclosure.

A method of controlling a user terminal device according to an embodiment of the present disclosure includes the steps of checking the location of the user corresponding to the location of the user terminal device (S2410), and when it is determined that the checked user location is not the home, the companion animal Transmitting a control signal for controlling a plurality of electronic devices disposed in the home based on the profile (S2420) and displaying a UI providing companion animal information received from the plurality of electronic devices (S2430) can

First, the user terminal device may check the location of the user corresponding to the location of the user terminal device (S2410).

In this case, the user terminal device may further include a location sensor, and may confirm the user location based on the location of the user terminal device sensed by the location sensor. If the confirmed user location is not the home, for example, if the user location is more than a preset distance from the home, it may be determined that the user location is not the home.

In addition, when it is determined that the confirmed user location is not the home, the user terminal device may transmit a control signal for controlling the plurality of electronic devices disposed in the home based on the companion animal profile ( S2420 ).

Here, the control signal for controlling the plurality of electronic devices may be a control signal for controlling to perform a preset operation corresponding to the companion animal profile.

For example, the control signal is a signal to control the robot vacuum cleaner to clean with a low suction intensity, a signal to control the air conditioner to set a temperature corresponding to the age or fur length of the companion animal included in the companion animal profile, and a signal to deactivate the control unit A signal to control the cooking device, a signal to control the TV to output companion animal content, a signal to control the air purifier to set strong wind strength, and a feeder for companion animals to adjust the number of feedings and feeding amount according to the companion animal profile ( feeder) and a signal for controlling various electronic devices disposed in the groove, such as a signal for controlling a blind to adjust opening and closing according to the companion animal profile.

In addition, the user terminal device may display a UI providing companion animal information received from a plurality of electronic devices (S2430).

For example, when motion information or sound information of a companion animal sensed through a sensor of the robot cleaner is received, the user terminal device may display a UI providing the received motion information or sound information.

Here, the motion information of the companion animal may mean whether the movement of the companion animal has occurred, and the sound information of the companion animal may include the number of times the companion animal barks, the degree of barking, the barking time, and the like.

Meanwhile, when a companion animal sound detection signal is received from the robot cleaner, the user terminal device receives sound generation location information from the robot cleaner and the AI speaker, and a sound generation location based on the sound generation location information received from the robot cleaner and the AI speaker can be estimated. In addition, the user terminal device may transmit a control signal for controlling the movement to the estimated sound generation position to the robot cleaner. When a companion animal image photographed at a sound generating position is received from the robot cleaner, the user terminal device may display a UI providing the received image.

Meanwhile, the user terminal device may display at least one of a UI or content corresponding to motion information or sound information of a companion animal. Here, the UI or content may include a UI for controlling output of a calming sound, an active sound or white noise through the speaker of the robot cleaner, and expert consultation recommendation content.

Meanwhile, when motion detection information of the companion animal is received from the robot cleaner, the user terminal device may transmit a control signal for controlling the companion animal to be photographed through the camera of the robot cleaner while moving along the companion animal to the robot cleaner. In this case, when the photographed image of the companion animal is received from the robot cleaner, the user terminal device may display a UI providing the received photographed image.

Also, the user terminal device may transmit a control signal for controlling the height adjustment range of the camera of the robot cleaner to the robot cleaner to photograph the height range corresponding to the activity range according to the type of companion animal.

Meanwhile, the user terminal device may provide a manual operation UI for controlling the movement of the robot cleaner and transmit a control signal corresponding to a user input through the manual operation UI to the robot cleaner.

The various embodiments described above may be implemented individually, as well as a plurality of embodiments may be implemented in combination.

Meanwhile, the above-described methods according to various embodiments of the present disclosure may be implemented in the form of an application that can be installed in an existing electronic device.

In addition, the above-described methods according to various embodiments of the present disclosure may be implemented only by software upgrade or hardware upgrade of an existing electronic device.

In addition, various embodiments of the present disclosure described above may be performed through an embedded server provided in an electronic device or an external server of at least one of the electronic device.

Meanwhile, according to an embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage media readable by a machine (eg, a computer). The device is a device capable of calling a stored command from a storage medium and operating according to the called command, and may include an electronic device (eg, the electronic device A) according to the disclosed embodiments. When executed by the processor, the processor may perform a function corresponding to the instruction, either directly or by using other components under the control of the processor, The instruction may include code generated or executed by a compiler or an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium, where the 'non-transitory storage medium' is a tangible device and a signal (eg, electromagnetic waves), and this term does not distinguish between a case in which data is stored semi-permanently in a storage medium and a case in which data is temporarily stored. It may contain buffers.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a portion of the computer program product (eg, a downloadable app) is stored at least in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server. It may be temporarily stored or temporarily created.

In addition, each of the components (eg, a module or a program) according to the above-described various embodiments may be composed of a single or a plurality of entities, and some sub-components of the aforementioned sub-components may be omitted, or other sub-components may be omitted. Components may be further included in various embodiments. Alternatively or additionally, some components (eg, a module or a program) may be integrated into a single entity to perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by a module, program, or other component may be sequentially, parallel, repetitively or heuristically executed, or at least some operations may be executed in a different order, omitted, or other operations may be added. can

In the above, preferred embodiments of the present disclosure have been illustrated and described, but the present disclosure is not limited to the specific embodiments described above, and is commonly used in the technical field to which the disclosure belongs without departing from the gist of the present disclosure as claimed in the claims. Various modifications may be made by those having the knowledge of

100: user terminal device 200: electronic device
210: robot vacuum 220: AI speaker

Claims (20)

In the user terminal device,
a communication interface for communicating with a plurality of electronic devices disposed in a home;
memory in which pet profiles are stored;
display; and
The communication to confirm the location of the user corresponding to the location of the user terminal device, and to transmit a control signal for controlling the plurality of electronic devices based on the companion animal profile when it is determined that the confirmed user location is not the home A user terminal device comprising: a processor controlling an interface and controlling the display to display a UI providing companion animal information received from the plurality of electronic devices. According to claim 1,
The control signal for controlling the plurality of electronic devices is a control signal for controlling to perform a preset operation corresponding to the companion animal profile,
A signal to control the robot vacuum cleaner to clean with a low suction strength, a signal to control the air conditioner to set a temperature corresponding to the age or hair length of the companion animal included in the companion animal profile, and a signal to control the cooking device so that the operation unit is deactivated , a signal for controlling the TV to output companion animal content, a signal for controlling the air purifier to set strong wind strength, a signal for controlling the companion animal feeder to adjust the number of feedings and feeding amount according to the companion animal profile, and and at least one of a signal for controlling a blind to adjust opening and closing according to the companion animal profile. According to claim 1,
position sensor; further comprising
The processor is
The user terminal device determines the user location based on the location of the user terminal device sensed by the location sensor, and determines that the user location is not the home if the confirmed user location is greater than or equal to a preset distance from the home. According to claim 1,
The plurality of electronic devices include a robot cleaner,
The processor is
When motion information or sound information of a companion animal sensed through a sensor of the robot cleaner is received, the user terminal device controls the display to display a UI providing the received motion information or sound information. 5. The method of claim 4,
The sound information of the companion animal includes at least one of a number of barking, a degree of barking, and a barking time of the companion animal. 5. The method of claim 4,
The plurality of electronic devices include an AI speaker,
The processor is
When a companion animal sound detection signal is received from the robot cleaner, the communication interface is controlled to receive sound generation location information from the robot cleaner and the AI speaker,
estimating the sound generation position based on the sound generation position information received from the robot cleaner and the AI speaker,
Transmitting a control signal to control the movement to the estimated sound generation position to the robot cleaner,
When the companion animal image photographed at the sound generating position is received from the robot cleaner, the user terminal device controls the display to display a UI providing the received image. 5. The method of claim 4,
The processor is
controlling the display to display at least one of UI or content corresponding to motion information or sound information of the companion animal,
The UI or content includes at least one of a UI for controlling output of a calming sound, an active sound, or a white noise through a speaker of the robot cleaner, and expert consultation recommendation content, a user terminal device. 5. The method of claim 4,
The processor is
When motion detection information of the companion animal is received from the robot cleaner, it moves along the companion animal and transmits a control signal for controlling the photographing of the companion animal through the camera of the robot cleaner to the robot cleaner,
When a photographed image of a companion animal is received from the robot cleaner, the user terminal device controls the display to display a UI providing the received photographed image. 9. The method of claim 8,
The companion animal profile includes information about the type of companion animal,
The processor is
A user terminal device for transmitting a control signal for controlling a height adjustment range of a camera of the robot cleaner to photograph a height range corresponding to an activity range according to the type of companion animal to the robot cleaner. 5. The method of claim 4,
The processor is
Control the display to provide a manual operation UI for controlling the movement of the robot cleaner,
A user terminal device for transmitting a control signal corresponding to a user input through the manual operation UI to the robot cleaner. A method for controlling a user terminal device, comprising:
identifying a location of the user corresponding to the location of the user terminal device;
transmitting a control signal for controlling a plurality of electronic devices disposed in the home based on the companion animal profile when it is determined that the identified user location is not a home; and
and displaying a UI providing companion animal information received from the plurality of electronic devices. 12. The method of claim 11,
The control signal for controlling the plurality of electronic devices is a control signal for controlling to perform a preset operation corresponding to the companion animal profile,
A signal to control the robot vacuum cleaner to clean with a low suction strength, a signal to control the air conditioner to set a temperature corresponding to the age or hair length of the companion animal included in the companion animal profile, and a signal to control the cooking device so that the operation unit is deactivated , a signal for controlling the TV to output companion animal content, a signal for controlling the air purifier to set strong wind strength, a signal for controlling the companion animal feeder to adjust the number of feedings and feeding amount according to the companion animal profile, and and at least one of a signal for controlling a blind to adjust opening and closing according to the companion animal profile. 12. The method of claim 11,
The step of confirming the location of the user,
A method of confirming a user location based on the location of the user terminal device sensed by a location sensor, and determining that the user location is not the home if the checked user location is greater than or equal to a preset distance from the home. 12. The method of claim 11,
The plurality of electronic devices include a robot cleaner,
The step of displaying the UI comprises:
When motion information or sound information of a companion animal sensed through a sensor of the robot cleaner is received, a UI providing the received motion information or sound information is displayed. 15. The method of claim 14,
The control method, wherein the sound information of the companion animal includes at least one of a number of barking, a degree of barking, and a barking time of the companion animal. 15. The method of claim 14,
The plurality of electronic devices include an AI speaker,
receiving sound generation location information from the robot cleaner and the AI speaker when a companion animal sound detection signal is received from the robot cleaner;
estimating a sound generation position based on sound generation position information received from the robot cleaner and the AI speaker; and
Transmitting a control signal for controlling to move to the estimated sound generating position to the robot cleaner; further comprising,
The step of displaying the UI comprises:
When the companion animal image photographed at the sound generating position is received from the robot cleaner, a UI for providing the received image is displayed. 15. The method of claim 14,
Displaying at least one of UI or content corresponding to the motion information or sound information of the companion animal;
The UI or content includes at least one of a UI for controlling output of a calming sound, an active sound, or a white noise through a speaker of the robot cleaner and expert consultation recommendation content. 15. The method of claim 14,
When motion detection information of the companion animal is received from the robot cleaner, the robot cleaner moves along the companion animal and transmits a control signal for controlling the photographing of the companion animal to the robot cleaner through the camera of the robot cleaner;
The step of displaying the UI comprises:
When a photographed image of a companion animal is received from the robot cleaner, a UI providing the received photographed image is displayed, a control method. 19. The method of claim 18,
The companion animal profile includes information about the type of companion animal,
The transmitting step is
A control method for transmitting, to the robot cleaner, a control signal for controlling a height adjustment range of a camera of the robot cleaner to photograph a height range corresponding to the activity range according to the type of companion animal. 15. The method of claim 14,
providing a manual operation UI for controlling the movement of the robot cleaner; and
Transmitting a control signal corresponding to a user input through the manual operation UI to the robot cleaner; further comprising, a control method.

Images