KR20130103205A - Mobile device and control method for the same - Google Patents

Abstract

PURPOSE: A portable electronic device and a control method thereof are provided to compare search query languages by a natural language process and a database in respect to a user context, thereby accurately performing the operation according to voice commands. CONSTITUTION: A microphone (122) receives voice commands. A control unit (180) acquires search query languages from the voice commands based on a natural language process and the request result based on a database in respect to the search query languages and a user context. An output unit (150) outputs the request result, and the search query languages include request information, time information, spatial information, companion information, situation information, and movement information. A memory (160) includes the database, and the database includes picture information, music information, interchange information, application execution information, web search information, and payment information. [Reference numerals] (110) Wireless communication unit; (111) Broadcast receiving module; (112) Mobile communication module; (113) Short distance communication module; (114) Short distance communication module; (115) Location information module; (120) A/V input unit; (121) Camera; (122) Microphone; (130) User input unit; (140) Sensing unit; (141) Proximity sensor; (150) Output unit; (151) Display unit; (152) Audio output module; (153) Alarm unit; (154) Haptic module; (160) Memory; (170) Interface unit; (180) Control unit; (181) Multimedia module; (190) Power supply unit

Description

TECHNICAL FIELD [0001] The present invention relates to a portable electronic device,

The present invention relates to a portable electronic device having a voice recognition function and a control method thereof.

The portable electronic device may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some portable electronics include additional functionality to play games, while others are implemented as multimedia devices. Moreover, modern portable electronic devices can receive broadcast or multicast signals to watch videos or television programs.

In addition, efforts to support and increase the function of the portable electronic devices continue. The foregoing efforts include not only changes and improvements in structural components that form portable electronic devices, but also improvements in software and hardware.

Reflecting this demand, recent portable electronic devices support voice recognition.

1

1 is a diagram illustrating an example of use of a portable electronic device having a voice recognition function.

Referring to FIG. 1, a user may command a predetermined operation to the portable electronic device 10 through voice.

The portable electronic device 10 stores data on voice commands. When the portable electronic device 10 receives a pre-stored voice command from the user, the portable electronic device may perform an operation corresponding thereto.

For example, the portable electronic device may store a voice command called 'mother'. In addition, the voice command 'mother' may be a command to call the phone number of the mother item stored in the contact. Therefore, when the user inputs a voice command of 'mother' to the portable electronic device, the portable electronic device may call the mother stored in the phone book.

As such, a portable electronic device having a voice recognition function may perform a predetermined function only when a predetermined command is input.

The user naturally wants to input voice commands into the portable electronic device as if talking in everyday life. However, the accuracy of speech command analysis using conventional natural language processing is not high.

Accordingly, the present specification aims at providing measures to solve the above-mentioned problems.

Specifically, an object of the present specification is to provide a method for building a database regarding a user context.

In addition, the present specification is intended to provide a method for increasing the accuracy of the term interpretation that is not clear, in order to increase the accuracy of natural language processing.

In addition, an object of the present disclosure is to provide a method for the portable electronic device to accurately perform an operation for a voice command by comparing a database regarding a user context with a search query by natural language processing.

In addition, an object of the present specification is to provide a method for changing a method of interpreting natural language based on a language pattern of a user.

In a method of controlling a portable electronic device according to an aspect of the present invention, the method of controlling a portable electronic device having a voice recognition function includes: receiving a voice command, based on natural language processing, searching from the received voice command The method may include obtaining a query, obtaining a request result based on a database of the obtained search query and a user context, and outputting the request result.

In a method of controlling a portable electronic device according to another aspect of the present invention, the search query may include at least one of request information, time information, space information, companion information, situation information, and movement information.

According to another aspect of the present invention, a method of controlling a portable electronic device further includes setting a database, wherein the database includes photo information, music information, exchange information, application execution information, web search information, and payment. It may include at least one of the information.

The control method of the portable electronic device according to another aspect of the present disclosure may further include obtaining the request result based on the obtained search query and the response from the web server. .

According to another aspect of the present disclosure, a method of controlling a portable electronic device may include obtaining at least one of time information and spatial information.

A control method of a portable electronic device according to another aspect of the present disclosure may include the step of outputting the request result by priority, and outputting the classified request result.

According to another aspect of the present invention, there is provided a control method of a portable electronic device, including the steps of: changing the time information, outputting the obtained time information, receiving a user input for the output time information, and receiving the received time information. The method may include changing the obtained time information based on a user input.

According to another aspect of the present invention, there is provided a method of controlling a portable electronic device, the method comprising: outputting the obtained spatial information by changing the spatial information, receiving a user input for the output spatial information, and receiving the received spatial information. And changing the acquired spatial information based on a user input.

According to another aspect of the present invention, a method of controlling a portable electronic device may further include storing a change history of the visual information and the spatial information, and obtaining the search query may include a search query based on the change history. It may further comprise the step of obtaining.

The control method of the portable electronic device according to another aspect of the present disclosure may further include displaying the obtained search query.

According to an aspect of the present invention, a portable electronic device obtains a search query from the received voice command based on a microphone for receiving a voice command and natural language processing, and is based on a database of the acquired search query and a user context. And a controller for obtaining a request result and an output unit for outputting the request result.

In a portable electronic device according to another aspect of the present invention, the search query may include at least one of request information, time information, spatial information, companion information, situation information, and movement information.

According to another aspect of the present invention, a portable electronic device further includes a memory including a database, wherein the database includes at least one of photo information, music information, exchange information, application execution information, web search information, and payment information. It may include.

The portable electronic device according to another aspect of the present invention, the control unit may change at least one of time information and spatial information.

In a portable electronic device according to another aspect of the present disclosure, the memory may store a change history of the time information and the space information, and the controller may obtain a search query based on the change history.

Disclosure of the present invention solves the problems of the prior art described above.

Specifically, by the disclosure of the present specification, a method for building a database regarding a user context may be provided to a user.

In addition, according to the disclosure of the present specification, in order to increase the accuracy of natural language processing, it is possible to provide a user with a method for increasing the accuracy of unclear term interpretation.

In addition, according to the disclosure of the present specification, by comparing a database regarding a user context with a search query by natural language processing, a portable electronic device may provide a user with a method for accurately performing an operation on a voice command.

In addition, according to the disclosure of the present specification, a method for enabling a user to change a method of interpreting natural language based on a user's language pattern may be provided.

1 is a diagram illustrating an example of use of a portable electronic device having a voice recognition function.
2 is a block diagram illustrating a portable electronic device according to an exemplary embodiment disclosed herein.
3 is a flowchart illustrating a method of controlling a portable electronic device according to an embodiment of the present invention.
4 is a diagram illustrating an example of a method for setting up a database regarding a user context by a portable electronic device.
5 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.
FIG. 6 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.
7 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.
8 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.
9 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.
10 is a diagram illustrating an example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.
FIG. 11 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.
FIG. 12 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.
FIG. 13 is a diagram illustrating another example of a method in which a portable electronic device obtains a search query from a received voice command and obtains a request result based on a database of the obtained search query and a user context.
14 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on the obtained search query and a database relating to a user context.
FIG. 15 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.
16 is a diagram illustrating an example of a method of outputting a request result obtained by a portable electronic device.
17 is a diagram illustrating another example of a method of outputting a request result obtained by a portable electronic device.
18 is a diagram illustrating an example of a method of changing, by a portable electronic device, information included in a search query.

It is to be noted that the technical terms used herein are merely used to describe particular embodiments, and are not intended to limit the present invention. It is also to be understood that the technical terms used herein are to be interpreted in a sense generally understood by a person skilled in the art to which the present invention belongs, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when the technical terms used herein are incorrect technical terms that do not accurately express the spirit of the present invention, they should be replaced with technical terms that can be understood correctly by those skilled in the art. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Also, the singular forms "as used herein include plural referents unless the context clearly dictates otherwise. In the present application, the term "comprising" or "comprising" or the like should not be construed as necessarily including the various elements or steps described in the specification, Or may be further comprised of additional components or steps.

Also, suffixes "module", "unit" and "part" for the components used in the present specification are given or mixed in consideration of ease of specification, and each component having its own distinct meaning or role no.

Furthermore, terms including ordinals such as first, second, etc. used in this specification can be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

The portable electronic device described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, and the like, except when applicable only to portable electronic devices.

2

2 is a block diagram illustrating a portable electronic device according to an exemplary embodiment disclosed herein.

The portable electronic device 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 2 are not essential, and a portable electronic device having components having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the portable electronic device 100 and the wireless communication system or between the portable electronic device 100 and the network in which the portable electronic device 100 is located . For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The mobile communication module 112 is configured to implement a video communication mode and a voice communication mode. The video call mode refers to a state of talking while viewing a video of the other party, and the voice call mode refers to a state in which a call is made without viewing the other party's video. In order to implement the video communication mode and the voice communication mode, the mobile communication module 112 is configured to transmit and receive at least one of voice and image.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or enclosed in the portable electronic device 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for acquiring the position of the portable electronic device, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 2, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal. In addition, the microphone 122 may receive a voice command from a user.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the position of the portable electronic device 100 such as the open / closed state of the portable electronic device 100, the position of the portable electronic device 100, the presence or absence of user contact, the orientation of the portable electronic device, And generates a sensing signal for controlling the operation of the portable electronic device 100. For example, when the portable electronic device 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154, for example, for generating output related to visual, auditory, have.

The display unit 151 displays (outputs) information to be processed by the portable electronic device 100. For example, when the portable electronic device is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with the call is displayed. When the portable electronic device 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed. The display unit may display a server connectable to the portable electronic device. The display may display the search result when receiving a search result for content from the server. The display unit may display various guide windows related to a search reservation, including a search reservation guide window.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the portable electronic device 100. [ For example, in the portable electronic device 100, a plurality of display portions may be spaced apart from one another or integrally disposed, or may be disposed on different surfaces, respectively.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is directed to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

Referring to FIG. 2, a proximity sensor 141 may be disposed in an inner region of the portable electronic device wrapped by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception tones, message reception tones, etc.) performed in the portable electronic device 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the portable electronic device 100. Examples of events that occur in portable electronic devices include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet port, grazing to the skin surface, contact of an electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable electronic device 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen. In addition, the memory 160 may store a database relating to a user context. In addition, the memory 160 may store matters related to change details such as time information and spatial information.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of disk, optical disk. The portable electronic device 100 may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a pathway to all the external devices connected to the portable electronic device 100. The interface unit 170 receives data from an external device or supplies power to each component in the portable electronic device 100 or allows data in the portable electronic device 100 to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the portable electronic device 100 and includes a user identification module (UIM), a subscriber identity module (SIM) a universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the portable electronic device 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the portable electronic device 100 or input from the cradle by a user Various command signals can be transmitted to the portable electronic device. The various command signals input from the cradle or the power source may be operated as a signal for recognizing that the portable electronic device is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the portable electronic device. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

 In addition, the control unit 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

In addition, the controller 180 may obtain a search query from a voice command based on natural language processing. In addition, the controller 180 may control a predetermined operation to be performed based on the obtained search query and a basis of a user context.

3

3 is a flowchart illustrating a method of controlling a portable electronic device according to an embodiment of the present invention.

Referring to FIG. 3, the portable electronic device may set a database regarding a user context (S310).

Here, information on when and what operation the portable electronic device 100 has performed by the user, what data the portable electronic device 100 includes, etc. will be collectively referred to as a user context.

That is, when the portable electronic device 100 performs a predetermined function, the portable electronic device 100 may store the content regarding the execution content. The database regarding the user context may include a photo database, a music database, an exchange database, an application execution database, a web search database, a payment database, and the like.

The photo database refers to information stored when the portable electronic device performs a photographing operation or the like.

The music database refers to information stored when the portable electronic device performs a music playback function.

The AC database refers to information stored when the portable electronic device performs a telephone call reception, a message transmission, a schedule recording function, and the like.

The application execution database refers to information stored when the portable electronic device executes any application.

The web search database refers to information stored when the portable electronic device searches for a keyword through a web browser.

The payment database refers to information stored when the portable electronic device is used for a payment function.

4

4 is a diagram illustrating an example of a method for setting up a database regarding a user context by a portable electronic device.

Referring to FIG. 4A, the portable electronic device 100 may perform a photographing function. In this case, the portable electronic device 100 may set the photo database 300-1.

Referring to FIG. 4B, the photo database 300-1 may include information about a photo file, time information, space information, schedule information, companion information, situation information, movement information, and other information. have.

Information included in the photo database 300-1 may be automatically set by a function included in the portable electronic device 100. Or, it may be set based on the additional information spoken or input by the user.

The information 310 for the photo file may include a file name (eg, 001.JPG) for the image 210 captured by the portable electronic device 100.

The time information 321 may include information about the time when the portable electronic device 100 took the picture. The time information 321 may be set using time information included in the portable electronic device 100.

The spatial information 322 may include information about a location where the portable electronic device 100 takes a picture. The spatial information 322 may be set by the location information module 115 included in the portable electronic device.

The schedule information 323 may include information about a schedule that is in progress while the portable electronic device 100 takes a picture. The schedule information 323 may be set by recording data such as a schedule management program included in the portable electronic device.

The companion information 324 may include information about a person included in an image captured by the portable electronic device 100. The companion information 324 may be set by recording data such as a schedule management program included in the portable electronic device. Alternatively, the companion information 324 may be set based on tag information added to the file when the picture file is stored.

The situation information 325 may include information about a situation occurring at the time when the portable electronic device 100 was taking a picture. The context information 325 may be set based on tag information added to the photo file when the photo file is stored.

The movement information 326 may include information on whether the mobile electronic device 100 is moving when the portable electronic device 100 is taking a picture. The movement information may be set based on a position change value by the position information module 115 included in the portable electronic device 100.

The other information 326 may include additional information when necessary separately.

For example, referring to FIG. 4, the time information 321 may include a date, time, and the like on which a picture was taken based on a time function included in the portable electronic device 100. The spatial information 322 may include information about a point where a picture is taken based on the location information module 115 included in the portable electronic device. In addition, the controller 180 may extract a specific photographing place from tag information additionally input by a user. For example, when a user adds a tag 'in a golden fish sushi restaurant' to a photo file, the controller 180 may include information called 'golden fish sushi restaurant' in the spatial information 322. The schedule information 323 may include information, “Busan travel,” when the schedule management program of the portable electronic device 100 includes information “Busan travel period.” The companion information 324 may set the companion information to 'withdrawal' when the schedule management program of the portable electronic device 100 includes information such as 'withdrawal and travel to Busan'. Alternatively, the controller 180 may identify a companion by performing face recognition on the person included in the picture. The situation information 325 may include information “in meal” when the user inputs a tag “in meal” at the time of photographing. The movement information 326 may include information indicating that the movement information 326 is not moving when the position change by the GPS is not detected. The other information 327 may include information which is not used previously among the photo tag information input by the user.

5

5 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.

Referring to FIG. 5A, the portable electronic device 100 may perform a music playback function. At this time, the portable electronic device 100 may set the music database 300-2.

Referring to FIG. 5B, the music database 300-2 may include information 311 about a music file, information 312 about a music genre, time information 321, space information 322, and a schedule. Information 323, companion information 324, situation information 325, movement information 326, and other information 327 may be included.

Information included in the music database 300-2 may be automatically set by a function included in the portable electronic device 100. Or, it may be set based on the additional information spoken or input by the user.

The information 311 about the music file may include a title (eg, Good Bye) for the music file reproduced by the portable electronic device 100.

The genre information 312 may include a genre (eg, ballad) for the music file reproduced by the portable electronic device 100.

The time information 321 may include information about the time when the portable electronic device 100 played music.

The spatial information 322 may include information about a location where the portable electronic device 100 plays music.

The schedule information 323 may include information about a schedule that is in progress while the portable electronic device 100 plays music.

The companion information 324 may include information about a person who is present when the portable electronic device 100 plays music.

The situation information 325 may include information about a situation occurring at the time when the portable electronic device 100 is playing music.

The movement information 326 may include information on whether the mobile electronic device 100 is moving when the portable electronic device 100 is playing music.

The other information 327 may include additional information when necessary separately.

For example, referring to FIG. 5, the portable electronic device 100 plays a music file 220. In addition, a title (Good bye) and a genre (ballad) of the reproduced music file 220 may be included in a tag of the music file.

Accordingly, the music file information 311 may include title information of the music file being played based on the tag information of the music file. The genre information 312 may include genre information of a music file being reproduced based on tag information of the music file.

On the other hand, by the above-described method, each item of the music database can be set.

6

FIG. 6 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.

Referring to FIG. 6A, the portable electronic device 100 may perform a call function. In this case, the portable electronic device 100 may set the AC database 300-3.

Referring to FIG. 6 (b), the exchange database 300-2 may include information 313 on an exchanger, information 314 on a contact method, time information 321, space information 322, and a situation. Information 325, movement information 326, other information 327, and the like.

Information included in the AC database 300-3 may be automatically set by a function included in the portable electronic device 100. Or, it may be set based on the additional information spoken or input by the user.

The information about the alternator 313 may include information about a person who is contacted through the portable electronic device 100. Referring to FIG. 6, since the user made a phone call with the mother at 06:12 pm, the exchanger information 313 may include information indicating that the user has been in contact with the mother.

The information on the contact method may include information on a method of contacting through the portable electronic device 100. Methods of communicating with others using the portable electronic device 100 include phone calls, message transmission and the like. For example, referring to FIG. 6, since the user made a phone call with the mother at 06:12 pm, the information 313 on the contact method may include information indicating that the user made a 'phone call'.

Alternatively, in the case of the subject that the user meets directly, the exchange database may set a record that the subject has met the subject directly based on the schedule data of the schedule management program.

The setting method of the time information 321, the space information 322, the situation information 325, the movement information 326, and other information 327 for the AC database may be similarly applied to the above-described method. Therefore, detailed description thereof will be omitted.

7

7 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.

Referring to FIG. 7A, the portable electronic device 100 may execute an arbitrary application 240. In this case, the portable electronic device 100 may set an application execution database 300-4.

Referring to FIG. 7B, the application execution database 300-4 may include information about the execution application 315, information on the genre of the application 316, time information 321, space information 322, and the like. The schedule information 323, companion information 324, situation information 325, movement information 326, and other information 327 may be included.

Information included in the application execution database 300-4 may be automatically set by a function included in the portable electronic device 100.

The information 315 on the running app may include information on an application title executed by the portable electronic device 100. Referring to FIG. 7, since the portable electronic device 100 executes a game app (tetris) at 06:12 pm, the execution app information 315 may include a title of the executed app. .

The genre information may include information about an application genre executed by the portable electronic device 100. For example, referring to FIG. 7, since the portable electronic device 100 executes a game app (tetris) at 06:12 pm, the information 316 on the app genre includes information called 'game app'. can do.

Setting method of time information 321, space information 322, schedule information 323, companion information 324, situation information 325, movement information 326, and other information 327 for the application execution database Is similarly applicable to the method described above. Therefore, detailed description thereof will be omitted.

8

8 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.

Referring to FIG. 8A, the portable electronic device 100 may perform a web search function. In this case, the portable electronic device 100 may set up a web search database 300-5.

Referring to FIG. 8 (b), the web search database 300-5 may include information about search keywords 317, time information 321, space information 322, schedule information 323, and companion information ( 324, contextual information 325, movement information 326, other information 327, and the like.

Information included in the web search database 300-5 may be automatically set by a function included in the portable electronic device 100.

The information 317 on the search keyword may include information on a keyword used when a web search is performed through the portable electronic device 100. Referring to FIG. 8, since the search is performed by the search word 'one piece' through the search site at 06:12 pm, the search keyword information 317 may store the search keyword 'one piece'.

Setting method of time information 321, space information 322, schedule information 323, companion information 324, situation information 325, movement information 326, and other information 327 for the web search database. Is similarly applicable to the method described above. Therefore, detailed description thereof will be omitted.

9

9 is a diagram illustrating another example of a method for setting up a database regarding a user context by a portable electronic device.

Referring to FIG. 9A, the portable electronic device 100 may perform a payment function. In this case, the portable electronic device 100 may set up the payment database 300-6.

Referring to FIG. 9 (b), the payment database 300-6 may include information about payment object 318, information on payment method 319, time information 321, space information 322, and schedule. Information 323, companion information 324, situation information 325, movement information 326, and other information 327 may be included.

Information included in the payment database 300-6 may be automatically set by a function included in the portable electronic device 100. Or, it may be set based on additional information spoken or input by the user while executing another program. For example, the portable electronic device 100 may check the payment details of the user through data recorded through an account book program.

The information 318 on the payment target may include information on a product, etc., which has been paid through the portable electronic device 100. Alternatively, the information 318 on the payment target may include information on the payment product input to the portable electronic device 100. Referring to FIG. 9, since the user paid for the Chinese travel product by using the mobile payment function at 06:12 pm, the payment target information 318 may include information that the user paid for the Chinese travel product.

The information on the payment method may include information on the payment method for the product that the user has made a payment. Information about the payment method may be confirmed using a message, an account book program. Referring to FIG. 9, since the user paid for a travel product in China using a mobile payment function at 06:12 pm, the information 319 on the payment method may include information that the user used mobile payment. .

Alternatively, when a user records a payment object and a method in the portable electronic device 100 through an account book program, the payment database may set a payment object and method based on the account book program.

The setting method of the time information 321, the space information 322, the situation information 325, the movement information 326, and other information 327 for the payment database may be applied similarly to the above-described method. Therefore, detailed description thereof will be omitted.

On the other hand, according to an embodiment of the present invention, the portable electronic device may receive a voice command from the user (S320).

According to an embodiment of the present invention, since the portable electronic device 100 has a voice recognition function, the portable electronic device 100 may receive a voice command. In addition, the portable electronic device 100 may extract an operation requested by the user from the voice command based on natural language processing.

Meanwhile, according to an embodiment of the present invention, the portable electronic device may obtain a search query from the received voice command based on natural language processing (S330). The search query is information used by the portable electronic device 100 to search for predetermined data from a database regarding a user context. The search query may be information used by the portable electronic apparatus 100 to search for a predetermined data from a web server.

The search query may include request information, time information, space information, companion information, situation information, movement information, and the like.

The request information may include information for determining which of the databases about the user context is required to be searched. For example, when the request information includes information related to a photo file, the controller 180 can search the photo database. In addition, when the request information includes information related to application execution, the controller 180 can search the application execution database.

Meanwhile, according to an embodiment of the present invention, the portable electronic device may obtain a request result based on the obtained search query and a database of a user context (S340).

10

10 is a diagram illustrating an example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.

Referring to FIG. 10, the portable electronic device 100 may receive a voice command 400-1 of the type shown in FIG. 10.

The voice command 400-1 is a command for displaying a photo file meeting a predetermined condition from the photo file stored in the portable electronic device 100.

The portable electronic device 100 may extract the meaning of the command from the voice command 400-1 based on natural language processing.

In addition, the portable electronic device 100 may obtain search queries 421-1, 422-1, 424-1, and 427-1 that are required to perform the voice command 400-1 from the voice command. . The search query is information used by the portable electronic device 100 to search for predetermined data from a database regarding a user context.

The portable electronic device 100 may display a photo file meeting a predetermined condition from the photo file stored in the portable electronic device 100. In this case, the predetermined condition may be determined by a search query acquired by the portable electronic device 100.

Referring to FIG. 10, the portable electronic device 100 may include time information 421-1, spatial information 422-1, companion information 424-1, and other information from the voice command 400-1. 427-1) to obtain a search query. The search query acquisition process may be performed based on natural language processing.

For example, the time information 421-1 may be determined by the phrase “before” included in the voice command.

On the other hand, the word 'before' means the past, but it is not clear at what point it is. Therefore, it is necessary to clarify the time point of the meaning of the unclear word based on the user's context. A method of clarifying the meaning of an unclear word will be described later.

When the word 'before' is preset to be interpreted as meaning 'one year ago', the time information 421-1 may include information 'one year ago'.

In addition, the companion information 424-1 may be determined based on the phrase “withdrawal” included in the voice command. That is, the companion information 424-1 may include information called 'withdrawal'.

In addition, the spatial information 422-1 may be determined by the phrase 'from there' included in the voice command.

On the other hand, the word "in there" means a certain point, but it is unclear which point it means. Therefore, the point of the meaning of the unclear word needs to be clear based on the user's context. A method of clarifying the meaning of an unclear word will be described later.

When the word 'from there' is preset to be interpreted as meaning 'area outside the predetermined area from the current location', the spatial information 422-1 is 'area outside the predetermined area from the current location'. Called May contain information.

In addition, the other information 427-1 may be determined by the phrase “birthday” included in the voice command. That is, the other information 424-1 may include information called 'birthday'.

The portable electronic device 100 may obtain a search result that satisfies the condition from a photo database using the search queries 421-1, 422-1, 424-1, and 427-1. Alternatively, the portable electronic device 100 may obtain a search result that is similar to or partially matches the condition from a photo database by using the search queries 421-1, 422-1, 424-1, and 427-1. Can be. For example, in the photo database, time information is set to one year earlier, space information is set to an area outside the predetermined area from the current position, companion information is set to withdrawal, and other information is set to birthday. Information on the set photo file can be obtained.

The controller 180 may display a photo file corresponding to the information on the display unit 151 based on the obtained information.

Meanwhile, the portable electronic device 100 may obtain a search result that meets the condition from the memory 160 by using the search queries 421-1, 422-1, 424-1, and 427-1. .

11

FIG. 11 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.

Referring to FIG. 11, the portable electronic device 100 may receive a voice command 400-2 of the form shown in FIG. 11.

The voice command 400-2 is a command for reproducing a music file meeting a predetermined condition from the music file reproduced by the portable electronic device 100.

The portable electronic device 100 may extract the meaning of the command from the voice command 400-2 based on natural language processing.

In addition, the portable electronic device 100 may obtain search queries 421-2, 422-2, and 412-2 required to perform the voice command 400-2 from the voice command.

The portable electronic device 100 may play a music file satisfying a predetermined condition from the music file played by the portable electronic device 100.

Referring to FIG. 11, the portable electronic device 100 includes a search including time information 421-2, spatial information 422-2, and genre information 412-2 from the voice command 400-2. You can get a query.

The time information 421-2 may be determined based on the phrase “before” included in the voice command.

On the other hand, the word 'before' means the past, but it is unclear at what point it is. Therefore, it is necessary to clarify the time point of the meaning of the unclear word based on the user's context. A method of clarifying the meaning of an unclear word will be described later.

When the word 'previously' is set to be interpreted as meaning 'three hours ago', the time information 421-2 may include information 'three hours ago'.

In addition, the spatial information 422-2 may be determined by the phrase 'here' included in the voice command. That is, the spatial information 422-2 may include information called 'current location'. Here, the current location may be determined by the location information module 115 of the portable electronic device 100.

In addition, the genre information 412-2 may be determined by the phrase 'ballad music' included in the voice command. That is, the genre information 412-2 may include information called 'ballad'.

The portable electronic device 100 may obtain a search result corresponding to the condition from a photo database using the search queries 421-2, 422-2, and 412-2. For example, in the music database, information about a music file in which time information is set to '3 hours ago', space information is set to 'current position', and genre information is set to 'ballad' can be obtained. Can be. Alternatively, the portable electronic device 100 may obtain information on a music file similar or partially matching the condition from a music database using the search queries 421-2, 422-2, and 412-2. have.

The controller 180 may output a music file corresponding to the information through the sound output module 152 based on the obtained information.

12

FIG. 12 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.

Referring to FIG. 12, the portable electronic device 100 may receive a voice command 400-3 of the form shown in FIG. 12.

The voice command 400-3 is a command to search for a person who meets a predetermined condition among persons who have been contacted through the portable electronic device 100.

The portable electronic device 100 may extract the meaning of the command from the voice command 400-3 based on natural language processing.

In addition, the portable electronic device 100 may obtain search queries 421-3 and 414-3 required to perform the voice command 400-3 from the voice command.

In addition, the portable electronic device 100 may search for a person who meets a predetermined condition from the person who has been in contact with the portable electronic device 100.

Referring to FIG. 12, the portable electronic device 100 may obtain a search query including time information 421-3 and a contact method 414-3 from the voice command 400-3.

The time information 421-3 may be determined by the phrase “first night of last year” included in the voice command.

In addition, the contact method 414-3 may be determined by the phrase 'telephone' included in the voice command.

The portable electronic device 100 may obtain a search result corresponding to the condition from the AC database by using the search queries 421-3 and 414-3.

The controller 180 may output person information corresponding to the search result based on the obtained search result.

On the other hand, in order to specify the time of 'the first snowy night last year', the portable electronic device 100 may retrieve the date of the first snowy snowfall last year from the web server. Alternatively, the portable electronic device may search for a tag called “first snow” among data stored last year from a photo database. As such, the portable electronic device 100 may search for a predetermined condition using a plurality of databases, a web server, or the like.

13

FIG. 13 is a diagram illustrating another example of a method in which a portable electronic device obtains a search query from a received voice command and obtains a request result based on a database of the obtained search query and a user context.

Referring to FIG. 13, the portable electronic device 100 may receive a voice command 400-4 of the form shown in FIG. 13.

The voice command 400-4 is a command to search for an application that meets a predetermined condition among applications that the portable electronic device 100 has executed.

The portable electronic device 100 may extract the meaning of the command from the voice command 400-4 based on natural language processing.

In addition, the portable electronic device 100 may obtain search queries 421-4, 426-4, and 416-4 required to perform the voice command 400-4 from the voice command.

The portable electronic device 100 may search for an application that meets a predetermined condition among applications that the portable electronic device 100 has executed.

Referring to FIG. 13, the portable electronic device 100 includes a search including time information 421-4, movement information 426-4, and genre information 416-4 from the voice command 400-4. You can get a query.

The time information 421-2 may be determined by the phrase “last week” included in the voice command.

In addition, the movement information 426-4 may be determined by the phrase 'going to Chuncheon' included in the voice command. In this case, since the user tries to search for an application that was executed in the 'going to Chuncheon,' the movement information may be set to 'YES'.

In addition, the genre information 416-4 may be determined by the phrase 'game' included in the voice command. That is, the genre information 412-2 may include information called 'game'.

The portable electronic device 100 may obtain a search result corresponding to the condition from an application execution database by using the search queries 421-4, 426-4, and 416-4. For example, in the application execution database, time information is set to 'last week from the present time (for example, February 1, 2012)', movement information is set to 'YES', and genre information is set to 'game'. App execution information that is set to can be obtained.

The controller 180 may output application information corresponding to the information based on the obtained information.

14

14 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on the obtained search query and a database relating to a user context.

Referring to FIG. 14, the portable electronic device 100 may receive a voice command 400-5 of the type shown in FIG. 14.

The voice command 400-5 is a command to display a search result that meets a predetermined condition among web search results through the portable electronic device 100.

The portable electronic device 100 may extract the meaning of the command from the voice command 400-5 based on natural language processing.

In addition, the portable electronic device 100 may obtain search queries 421-5 and 417-5 required to perform the voice command 400-5 from the voice command.

In addition, the portable electronic device 100 may display a search result that meets a predetermined condition among web search results through the portable electronic device 100.

Referring to FIG. 14, the portable electronic device 100 may obtain a search query including time information 421-5 and search keyword information 417-5 from the voice command 400-5.

The time information 421-5 may be determined by the phrase 'no' included in the voice command.

On the other hand, the word 'before' means the past, but it is unclear at what point it is. Therefore, it is necessary to clarify the time point of the meaning of the unclear word based on the user's context. A method of clarifying the meaning of an unclear word will be described later.

When the word 'previously' is set to be interpreted as meaning 'three hours ago', the time information 421-2 may include information 'three hours ago'.

In addition, the search keyword information 417-5 may be determined by the phrase “one piece” included in the voice command. That is, the search keyword information 422-2 may include information called 'one piece'.

The portable electronic device 100 may obtain a web search result that meets the condition from the web search database using the search queries 421-5 and 417-5. For example, the portable electronic device 100 may obtain a search result in which time information is set to '3 hours ago' and search keyword information is set to 'one piece' in the web search database.

The controller 180 may display information on the search result on the display unit 151 based on the obtained search result.

15

FIG. 15 is a diagram illustrating another example of a method of obtaining a search query from a voice command received by a portable electronic device and obtaining a request result based on a database of the obtained search query and a user context.

Referring to FIG. 15, the portable electronic device 100 may receive a voice command 400-6 of the form shown in FIG. 15.

The voice command 400-6 is a command for displaying payment information meeting a predetermined condition from a payment database included in the portable electronic device 100.

The portable electronic device 100 may extract the meaning of the command from the voice command 400-6 based on natural language processing.

In addition, the portable electronic device 100 may obtain a search query 424-6 required to perform the voice command 400-6 from the voice command.

The portable electronic device 100 may search for payment information corresponding to a predetermined condition from a payment database included in the portable electronic device 100.

Referring to FIG. 15, the portable electronic device 100 may obtain a search query including companion information 424-6 from the voice command 400-6.

The companion information 424-6 may be determined by the phrase “withdrawal” included in the voice command.

In addition, the portable electronic device 100 may obtain a search result meeting the condition from a payment database using the search query 424-6. For example, payment information in which companion information is set to 'withdrawal' may be obtained from the payment database.

The controller 180 may display the obtained payment information on the display unit 151.

In this case, the portable electronic device 100 may display payment information in which the companion information is set to 'withdrawal' in chronological order.

On the other hand, according to an embodiment of the present invention, the portable electronic device 100 may include the step of outputting the request result (S350).

16

16 is a diagram illustrating an example of a method of outputting a request result obtained by a portable electronic device.

In the example described in FIG. 16A, it is assumed that a music database is set up as described in FIG. 5, and a voice command as described in FIG. 11 is received. In addition, it is assumed that the user's position has not changed.

When receiving the voice command 400-2 described in FIG. 11, the search query 421-2 matches the time information 321, the other search query 422-2 matches the spatial information, and Another search query 412-2 may match the genre information 312.

Therefore, the portable electronic device may obtain information on the music file (Good Bye.mp3) played at 06:12 pm in response to the voice command 400-2 from the music database. The portable electronic device may play the music file (Good Bye.mp3) in response to the voice command 400-2.

In the example illustrated in FIG. 16B, it is assumed that a photo database is set up as described in FIG. 4, and a voice command as described in FIG. 10 is received.

When receiving the voice command 400-1 described in FIG. 10, the search queries 421-1, 424-1, 422-1, and 427-1 by the voice command and the photo database 300-1 are received. Is matched.

Accordingly, the portable electronic device may obtain information on the photo file 001. JPG photographed on September 24, 2010 from the photo database in response to the voice command 400-1. The portable electronic device may display the photo file 001.jpg in response to the voice command 400-1.

17

17 is a diagram illustrating another example of a method of outputting a request result obtained by a portable electronic device.

Referring to FIG. 17A, according to an embodiment of the present disclosure, the portable electronic device 100 may display a plurality of music files that match a predetermined search query 421, 422, and 412. have.

In addition, the portable electronic device 100 may display the search query 421, 422, 412 used to display the output result on the display unit.

In this case, the number of search queries may be adjusted based on user input. For example, if a user wants more search results, the results of two search queries 421 and 422 may be displayed. Alternatively, a search result by one search query 421 may be displayed. That is, the user may adjust the number of search queries used for the search by an input through the user input unit.

Alternatively, before the portable electronic device 100 displays the output result, the search query may be preferentially displayed on the display unit. In this case, the user may input inaccurate items, items to be corrected, and contents of the displayed search query into the portable electronic device 100. In addition, the portable electronic device 100 may improve the accuracy and efficiency of performing the operation by performing a user's request using the changed search query.

In addition, the portable electronic device 100 may display the plurality of output results on the display unit according to a predetermined condition. For example, among the output results that match the voice command, the output results that are more likely to meet the user's intention can be displayed above (see Fig. 17 (a)). For example, the priority may be set higher when all items of the search query and the database match each other, in case the items of the search query and the database are partially different.

In addition, the portable electronic device 100 may sequentially display the output result based on a predetermined criterion (for example, a music file reproduced close to the current time point) (see FIG. 17 (b)).

Meanwhile, according to one embodiment of the present invention, the portable electronic device 100 may change a search query.

Figure 18

18 is a diagram illustrating an example of a method of changing, by a portable electronic device, information included in a search query.

When the portable electronic device 100 obtains a search query based on a voice command, the search query may include unclear information.

For example, when the phrase corresponding to the time information is expressed as 'before', 'before', 'a bit before', or the like, it may be a question of how to specifically interpret the phrase. In other words, the term 'before' may mean 'one hour ago' or 'three hours ago' depending on a person, and thus the interpretation may not be clear. In addition, the term 'before' may mean '1 hour ago' or '3 hours ago' depending on circumstances, and the interpretation thereof may not be clear.

Similarly, when the syntax corresponding to the spatial information is expressed as 'here', 'there', 'there', or the like, it may be a question how to interpret the syntax in detail.

This is because individual differences are severe with regard to the scope of space and time.

Therefore, it is necessary to introduce a method capable of accurately interpreting the unclear words as described above.

According to an embodiment of the present invention, after the portable electronic device 100 outputs the request result, the portable electronic device 100 may receive a correction command through a user input unit (S810).

In the example described in FIG. 18, a music database is set up as described in FIG. 5, a voice command as described in FIG. 11 is received, and the portable electronic device plays back three hours ago as described in FIG. 16. Let's assume that you play a music file.

When the music file is played by the above process, when the user inputs a correction command (eg, 'listen to the music heard before'), the portable electronic device 100 has a time point earlier than the time point (3 hours ago) For example, a music file played back 5 hours ago can be played back.

On the other hand, when receiving the correction command, the portable electronic device can change the search query (S820).

The portable electronic device 100 may be used to interpret an unclear word based on a change history of the search query. For example, when a lot of situations in which the user interprets the word “before” as being 5 hours ago are accumulated, the portable electronic device 100 may interpret the word “before” as “5 hours ago” from the beginning. .

As the situation data continues to accumulate, the portable electronic device 100 may infer a word indicating an unclear point of time or space with high accuracy.

Alternatively, when the portable electronic device 100 receives the voice command 400-2, the portable electronic device 100 may display the ballad music that has been heard three hours prior to the first order (that is, 'three hours'). The ranking based on the point of time before). In addition, the portable electronic device 100 may simultaneously display music files that have been played back before and after the viewpoint. At this time, if the user selected the music 1 hour ago, the criterion of the 'before' to the user may be interpreted as closer to '1 hour ago' than '3 hours ago'. This selection is cumulative (when the user uses the word 'before', when the case is interpreted as 'one hour ago' is accumulated, the portable electronic device 100 has a time corresponding to the vocabulary 'before'. Can be modified to '1 hour ago'.

This method is applicable to both ambiguities that represent time and space.

The above-described method according to the embodiment of the present invention can be used individually or in combination. Further, the steps constituting each embodiment can be used individually or in combination with the steps constituting the other embodiments.

In addition, the above-described method can be implemented in a recording medium readable by a computer or the like using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the methods described so far can be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions.

According to a software implementation, the procedures and functions described herein may be implemented in separate software modules. The software modules may be implemented in software code written in a suitable programming language. The software code may be stored in a storage unit and executed by a processor.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It falls within the scope of the invention.

100: portable electronic device 110: wireless communication unit
120: A / V input unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface unit
180: control unit 190: power supply unit

Claims (15)

In the control method of a portable electronic device having a speech recognition function,
Receiving a voice command;
Obtaining a search query from the received voice command based on natural language processing;
Obtaining a request result based on the obtained search query and a database of user contexts; And
And outputting the request result. The method of claim 1, wherein the search query,
And at least one of request information, time information, spatial information, companion information, situation information, and movement information. The method of claim 1,
Further comprising setting up the database,
The database may include at least one of photo information, music information, exchange information, application execution information, web search information, and payment information. The method of claim 1, wherein the obtaining of the request result comprises:
And obtaining a request result based on the obtained search query and the response from the web server. The method of claim 2, wherein obtaining the search query comprises:
And changing at least one of time information and spatial information. The method of claim 1, wherein the outputting the request result comprises:
Classifying the request result by priority; And
And outputting the classified request results. The method of claim 5, wherein the changing of the time information comprises:
Outputting the obtained time information;
Receiving a user input for the output time information; And
And changing the obtained time information based on the received user input. The method of claim 5, wherein the changing of the spatial information comprises:
Outputting the obtained spatial information;
Receiving a user input for the output spatial information; And
And changing the obtained spatial information based on the received user input. The method of claim 5, wherein
Storing a change history of the visual information and the spatial information;
Acquiring the search query,
And acquiring a search query based on the change history. The method of claim 1,
And displaying the obtained search query. A microphone for receiving a voice command;
A control unit obtaining a search query from the received voice command based on natural language processing, and obtaining a request result based on a database of the obtained search query and a user context;
And an output unit for outputting the request result. The method of claim 11, wherein the search query,
A portable electronic device comprising at least one of request information, time information, spatial information, companion information, situation information, and movement information. The method of claim 11,
Include more memory including the database,
The database may include at least one of photo information, music information, exchange information, application execution information, web search information, and payment information. 13. The apparatus according to claim 12,
And at least one of time information and spatial information. 15. The method of claim 14,
The memory stores the change history of the time information and spatial information,
The control unit,
And a search query based on the change history.

Images