KR101582266B1 - Method for controlling information display at mobile device interworking with wearable device - Google Patents

Abstract

The present invention relates to a method of controlling information display in a mobile device linked to a wearable device, and a method of controlling information display in a mobile device interlocked with a wearable device according to an embodiment of the present invention, Monitoring a predetermined notification event generated in response to a message received from the external network, checking whether the activated application software exists on the screen of the mobile device when the notification event is detected, As a result, if the activated application software exists, transmitting the notification message corresponding to the received message to the wearable device via the short-range communication connection. Accordingly, the present invention has an advantage of minimizing the inconvenience of a user using a mobile device interlocked with a wearable device.

Description

TECHNICAL FIELD [0001] The present invention relates to a method for controlling information display on a mobile device interlocked with a wearable device,

The present invention relates to a method of controlling information display in a mobile device, and more particularly, to a method of controlling information displayed on a screen in a mobile device interlocked with a wearable device.

With the development of information and communication technologies, currently available mobile devices are configured to perform various functions as well as a simple call function. Examples of such various functions include web browsing, chatting, watching TV, navigating, playing games, shooting pictures or videos through cameras, audio storage, playing music files through a speaker system, and displaying images or video have.

To this end, mobile device manufacturers are working hard to develop hardware and software to provide more complex and diverse functions.

In addition, recently introduced smart phones are equipped with a variety of complex application software such as mobile banking, mobile coupons, transportation cards, games, and security.

In addition, currently available smart phones are equipped with a high-performance processor and a high-resolution touch screen screen, thereby enabling use of various multimedia functions and applications.

Particularly, in recent years, interest in wearable devices that can be worn on the body has been increasing, and the demands of users have been diversified accordingly.

The wearable device may be a portable information device that provides a variety of computing technologies and sensing technologies while providing comfort and activity in terms of ergonomics as a computing device wearable on the wearer's body.

For example, in recent years, Samsung Electronics introduced a wristwatch-type Galaxy Gear, which provides not only a clock function but also a communication function like a mobile communication terminal.

In addition, some wearable devices may be interfaced with a smartphone via a local communication connection.

However, conventionally, when a mobile device receives a message from an external network, there is a problem that all the information received from the external network to the wearable device and the smartphone is displayed.

In particular, when a user receives an incoming call, a text / multimedia message, a cacao chat message, or the like from an external network while the user is listening to music or a moving picture through the mobile device, There is a problem that the user is inconvenienced.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method of controlling information display in a mobile device interlocked with a wearable device.

It is another object of the present invention to provide an information display control method in a mobile device capable of adaptively displaying an externally received message according to an operation state of the mobile device.

It is still another object of the present invention to provide a method of controlling information display in a mobile device capable of minimizing a user's inconvenience.

It is still another object of the present invention to provide an apparatus supporting the information display control method.

 It is still another object of the present invention to provide a computer-executable recording medium on which a program supporting the information display control method is recorded.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a method of controlling information display in a mobile device interlocked with a wearable device, and an apparatus therefor.

A method of controlling information display in a mobile device interlocked with a wearable device according to an embodiment of the present invention includes: establishing a short-range communication connection with the wearable device; monitoring a predetermined notification event generated corresponding to a message received from the external network; Checking whether there is active application software on the screen of the mobile device when the notification event is detected; and if it is determined that the active application software is present on the screen of the mobile device, And transmitting a notification message corresponding to the received message.

Here, the external network may include at least one of a wireless Internet network and a mobile communication network.

The received message may be an incoming call message, a text message, a multimedia message, or a social network service (SNS) message.

The short-range communication connection may be any one of a Bluetooth communication connection, an IrDA (infrared data association) communication connection, an UWB (UltraWideband) communication connection, a ZigBee communication connection, and an NFC have.

Also, if the activated application software exists, a notification screen corresponding to the received message may not be displayed on the screen of the mobile device.

In addition, if the activated application software exists, only a predetermined icon corresponding to the received message may be displayed in a notification bar disposed on one side of the screen of the mobile device.

The method may further include receiving a predetermined body wearing status message indicating whether or not the wearable device is worn on the user's body through the short-range communication connection, wherein when the wearable device is worn on the user's body, May be transmitted to the wearable device.

At this time, whether the body is worn can be determined based on the sensing information collected by the wearable device.

Here, the sensing information may include at least one of biometric information of the user of the wearable device and motion information of the wearable device.

In addition, the body wear status message may be transmitted when the body wear status of the wearable device is changed.

Also, the notification event may be generated by a predetermined notification agent operating in the background on the mobile device.

A mobile device according to another embodiment of the present invention includes means for establishing a short-range communication connection with a wearable device, means for monitoring a predetermined notification event generated corresponding to a message received from an external network, Means for confirming whether or not the activated application software exists on the screen of the mobile device, and if the activated application software exists, transmitting a notification message corresponding to the received message to the wearable device via the short- And the like.

At this time, if the activated application software exists, the notification screen corresponding to the received message may not be displayed.

In addition, when the activated application software exists, only a predetermined notification icon corresponding to the received message may be displayed on one side of the notification bar that is always displayed on the screen.

The wearable device may further include means for receiving a predetermined body wearing status message indicating whether or not the wearable device is worn on the wearer's body through the short-range communication connection, wherein when the wearable device is worn on the wearer's body, May be transmitted to the wearable device.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, And can be understood and understood.

Effects of the method and apparatus according to the present invention will be described as follows.

First, the present invention provides an information display control method in a mobile device that adaptively controls information display according to the operation state of the mobile device.

Second, the present invention provides an information display control method in a mobile device capable of minimizing a user's inconvenience.

Third, the present invention has an advantage of providing an information display control method for maximizing utilization of a mobile device interlocked with a wearable device.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. It is to be understood, however, that the technical features of the present invention are not limited to the specific drawings, and the features disclosed in the drawings may be combined with each other to constitute a new embodiment.
FIG. 1 is an internal configuration diagram of a mobile device according to an embodiment of the present invention.
2 is a system configuration diagram for explaining a method of controlling information display in a mobile device interlocked with a wearable device according to an embodiment of the present invention.
3 is an internal configuration diagram of a wearable device according to an embodiment of the present invention.
4 is a flowchart illustrating a method of controlling information display in a mobile device according to an embodiment of the present invention.
5 is a flowchart illustrating an information display control procedure in a system according to an embodiment of the present invention.
6 is a flowchart illustrating an information display control procedure in a system according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an apparatus and various methods to which embodiments of the present invention are applied will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The wareable device described in this specification can be worn on a human body such as a wrist band, a ring shape, a spectacle type, and may be equipped with at least one sensor by collecting biometric information. Here, the biometric information may include pulse wave information, body temperature information, pupil change information, tear detection information, and the like. The biometric information according to the present invention is information for confirming whether or not a wearable device is worn by a user Can be used. In addition, the biometric information may be used as information for determining the current psychological state, that is, the emotion index. For example, a wearable device in the form of a wristband may include a PPG (PhotoPlethysmoGraph) sensor and collects pulse wave diversity information, heart rate information, blood flow index information, sympathetic activity information, parasympathetic activity information, can do.

The mobile device described in this specification can be used for a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) . It should be noted, however, that the configuration according to the embodiments described herein can be applied to fixed terminals, such as desktop computers, except when applicable only to mobile terminals. In particular, the mobile device according to the present invention may be interworked with a wearable device through a predetermined short range wireless communication means, for example, Bluetooth communication.

Detailed configurations and functions of the wearable device and the mobile device according to the present invention will become more apparent from the following description of the drawings.

Generally, application software installed in a digital information device such as a wearable device or a mobile device is referred to as an " app ". Hereinafter, for convenience of explanation, it is assumed that application software and application are used in combination with " app " or "application ".

1 is a configuration diagram of a mobile device according to an embodiment of the present invention.

1, the mobile device 100 includes a wireless communication unit 110, a sensing unit 120, an output unit 130, an A / V input unit 140, a memory unit 150, A key module 160, an external interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 1 are not essential, and a mobile device having more or fewer components may be implemented.

Hereinafter, the components will be described in detail.

The wireless communication unit 110 can perform wireless communication between the mobile device 100 and the mobile communication system or between the mobile device 100 and the wireless network in which the mobile device 100 is located or between the wearable device that is interlocked with the mobile device 100 One or more modules. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS (Global Positioning System) receiving module 115 . ≪ / RTI >

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated in advance and transmitting the broadcast signals and / or broadcast- related information to the mobile device 100. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, or a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. And can also be provided through a mobile communication network. At this time, the broadcast signal and the broadcast related information can be received by the mobile communication module 113.

Broadcast-related information can exist in various forms. For example, EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H)

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 may be configured to be suitable for the above-described digital broadcasting system as well as other broadcasting systems for providing a broadcasting signal.

The broadcast signal and / or the broadcast-related information received through the broadcast receiving module 111 may be stored in the memory unit 150.

The mobile communication module 113 performs a function of transmitting / receiving a radio signal with a base station, a repeater, a repeater, a femtocell, and the like through a wireless interface of a mobile communication network. Here, the wireless signal may include a voice call, a video call signal, various types of data signals according to transmission / reception of a character / multimedia message, and the like.

The wireless Internet module 115 refers to a transmission / reception module for wireless Internet access, and the wireless Internet module 115 may be embedded in the mobile device 100 or may be externally connected through a predetermined interface terminal. WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (World Interoperability for Microwave Access) and the like can be used as wireless Internet technologies. The mobile device 100 according to the present invention can access the Internet network by accessing the wireless Internet router through the wireless Internet module 115. [

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), UltraWideband (UWB), ZigBee, Near Field Communication (NFC), and the like can be used as the short distance communication technology. The mobile device 100 according to the present invention can establish short-range wireless communication with the wearable device according to a user's selection, and can transmit / receive predetermined control signals and data to / from the wearable device through a predetermined short-range wireless communication connection.

For example, when the mobile device 100 receives an incoming call message, a short message service (SMS) message, a social network service (SNS) message, and the like via the connected mobile communication network, Connection to the wearable device, or a predetermined control signal indicating the reception of the corresponding message to the wearable device.

Particularly, when there is an application activated by the user, the mobile device 100 according to the present invention can control not to display a message reception notification on the display screen of the mobile device 100 but to display it on the screen of the wearable device have.

For example, if a kakao chat message is received while the user is watching a movie through the mobile device 100, the message reception notification is not displayed on the mobile device 100 and displayed on the interlocked wearable device screen .

For example, when a text message is received while the user is surfing the web through the mobile device 100, a notification notification of the corresponding text message is displayed on the screen of the mobile device 100, , And a part or all of the contents of the received text message may be displayed on the screen on the wearable device screen.

The GPS receiving module 119 is a module for confirming or acquiring positional information of the mobile device 100 using a signal received through a positioning satellite.

For example, the mobile device 100 acquires or extracts traffic information, tourist information, weather information, map information, schedule information, and the like of the corresponding area in real time using the location information obtained by the GPS receiving module 119, The acquired or extracted information can be displayed on one side of the screen.

The sensing unit 120 may sense a change in state inside or outside the mobile device 100 according to a control signal of the controller 180 and generate sensing information according to the change. The sensed information collected by the sensing unit 120 may include information on the open / close state of the mobile device 100, location information of the mobile device 100, presence or absence of user contact information, bearing and altitude information of the mobile device 100, Speed / acceleration / deceleration information of the mobile device 100, temperature / humidity / brightness information outside the mobile device 100, peripheral device connection detection information such as earphone connection and removal, , Ambient sound information, connection information with an external communication device, and the like, to detect the current state of the inside / outside of the mobile device 100 and to control the operation.

In addition, the sensing unit 120 according to the present invention may include a voice recognition unit that recognizes a user voice input through a microphone and transmits the user voice to the control unit 180. [

The output unit 130 may include a display module 131, an audio output module 133, an alarm unit 135, a haptic module 137, and the like, for generating output related to visual, auditory,

The display module 131 displays and outputs information processed by the mobile device 100. For example, when the mobile device 100 is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. Further, when the mobile device 100 is in the video communication mode or the photographing mode, the captured or / and received image, UI, or GUI is displayed.

The display module 131 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display module 131 may also be of a light transmission type. With this structure, the user can see objects located in the back of the body of the mobile device 100 through the area occupied by the display module 131. [

There may be two or more display modules 131 depending on the implementation of the mobile device 100. For example, in the mobile device 100, the plurality of display modules 131 may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

In a case where the display module 131 and the sensor for sensing the touch operation (hereinafter, referred to as 'touch sensor') have a mutual layer structure (hereinafter, referred to as a 'touch screen' It can also be used as an input device.

The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display module 131 or a capacitance generated in a specific portion of the display module 131 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display module 131 is touched or the like.

In particular, the proximity sensing module 121 may be disposed within an interior region of the mobile device 100 or a touch screen, which is enclosed by the touch screen. The proximity sensing module 121 means a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity thereof without mechanical contact by using electromagnetic force or infrared rays. The proximity sensing module 121 has a longer service life than the contact sensing module 122 and its utilization is also higher.

Examples of the proximity sensing module 121 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the pointer with a change of the electric field along the proximity of the pointer if the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as the proximity sensing module 121.

The audio output module 133 may output audio data received from the wireless communication unit 110 or stored in the memory unit 150 in a call signal reception mode, a communication mode or a recording mode, a voice recognition mode, a broadcast reception mode, have.

The sound output module 133 may include a receiver, a speaker, a buzzer, and the like. In addition, the sound output module 133 can output sound through the earphone jack provided at one side of the mobile device 100. [

The alarm module 135 outputs a signal for notifying the occurrence of an event of the mobile device 100. Here, examples of events generated in the mobile device 100 include call signal reception, message reception, key signal input, touch input, and the like. In addition, the alarm module 135 may output a signal notifying the occurrence of an event using a form other than a video signal or an audio signal, for example, a vibrating element or a light emitting element. The video signal or the audio signal can also be output through the display module 131 or the sound output module 133.

The haptic module 137 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 137 is vibration. The intensity and pattern of the vibration generated by the hit module 137 can be set through a predetermined user interface. For example, the haptic module 137 may combine and output different vibrations or sequentially output the vibrations.

In addition to the vibration, the haptic module 137 has a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or exothermic element can be generated.

The haptic module 137 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. The haptic module 137 may include a plurality of haptic modules having various functions according to the configuration of the mobile device 100 and may operate in conjunction with each other according to a control signal of the controller 180. [

Referring to FIG. 1, an A / V (Audio / Video) input unit 140 is for inputting an audio signal or a video signal, and may include a camera 141 and a microphone 143.

The camera 141 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display module 131. [

The image frame processed by the camera 141 may be stored in the memory unit 150 or may be transmitted to the outside through the wireless communication unit 110. [ The camera 141 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 143 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and converts it into electrical voice data. The converted voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. On the other hand, in the case of the voice recognition mode, the received voice signal can be transmitted to the sensing unit 120. The sensing unit 120 recognizes the voice signal received through the built-in voice recognition unit, To the control unit 180. At this time, the control unit 180 may control the operation of the mobile device 100 according to the voice recognition result.

The microphone 143 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The memory unit 150 may store a program for the operation of the controller 180 and may store input / output data (e.g., address book, received text message, schedule information, alarm setting information, Image capture information received from the smart imaging device, application program, etc.). Here, when an external application receives a message, the application program monitors whether there is an application currently running on the mobile device 100, and informs the control unit 180 of a result of a predetermined agent ) Apps.

The memory unit 150 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory unit 150 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk.

The input key module 160 generates input data for controlling the operation of the mobile device 100 by a user. The input key module 160 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The external interface unit 170 provides an interface with all external devices connected to the mobile device 100. The external interface unit 170 receives data from an external device or receives power from the external device, transfers the data to each component in the mobile device 100, or transmits data in the mobile device 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the mobile device 100.

Here, the identification module is a chip that stores various information for authenticating the usage right of the mobile device 100, and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format.

Accordingly, the identification device can be connected to the mobile device 100 through a predetermined port.

The control unit 180 typically controls the overall operation of the mobile device 100.

For example, the control unit 180 can control the installation and operation of application programs and widgets as well as communication functions including voice call, data communication, video call, wireless Internet connection, and short-range communication connection.

Herein, the short-range communication connection includes at least one of a Bluetooth communication connection, an IrDA (infrared data association) communication connection, a UWB (UltraWideband) communication connection, a ZigBee communication connection and an NFC .

In particular, when an incoming call, a text / multimedia message, an SNS message, or the like is received through the external network, the controller 180 determines whether there is application software activated on the mobile device 100, May be displayed on the screen of the mobile device 100. Here, the external network may include a mobile communication network, a wireless Internet network, and the like.

If there is application software activated on the mobile device 100, that is, operating in the foreground, the control unit 180 does not display a message received from the external network as a pop-up on the screen of the mobile device 100 , And can transmit a message received to the wearable device via a predetermined short-range communication connection. At this time, the wearable device can generate and display a screen corresponding to the received message.

On the contrary, when a message is received from the external network in a state where there is no application software activated on the mobile device 100, the control unit 180 generates and displays a screen corresponding to the received message, To the wearable device. For example, if the received message is a text message, a popup notification window containing the received text message may be displayed on the screen. In another example, if the received message is an incoming call, a predetermined call receiving screen may be displayed.

In the above description, the mobile device 100 transmits a message received from the external network to the wearable device through a predetermined local communication connection. However, this is an example only, The wearable device can directly communicate with the mobile communication network without passing through the mobile device 100 by mounting the mobile communication module therein.

For example, the wearable device and the mobile device 100 may be assigned the same telephone number, and each of the wearable device and the mobile device 100 may receive the incoming call from the mobile communication network through the mobile communication module installed in the wearable device and the mobile device 100, respectively. At this time, if the application software is activated on the mobile device 100 (for example, the media player for music and movie playback is running), it is indicated on the screen of the mobile device 100 that an incoming call has been received And it can be displayed that the incoming call is received only in the wearable device.

Accordingly, the user can continuously use the mobile device 100 without any interference with the reception of the incoming call, and can respond to the incoming call using the wearable device.

In addition, the control unit 180 can perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

In addition, the control unit 180 may control the input and the output according to various control signals received from the lower module, and configure and provide a user interface screen accordingly. Here, the lower module includes the wireless communication unit 110, the sensing unit 120, the output unit 130, the A / V input unit 140, the memory unit 150, the input key module 160, 170 and a power supply 190.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory unit 150 and executed by the control unit 180. [

2 is a system configuration diagram for explaining a method of controlling information display in a mobile device interlocked with a wearable device according to an embodiment of the present invention.

2, the system according to the present invention may include a wearable device 200, a wireless Internet router 50, an Internet network 60, a mobile communication network 70, a mobile device 100, and the like .

The wearable device 200 can access the Internet network 60 through the wireless Internet router 50. [ The wearable device 200 may also communicate with the mobile device 100 via a local area connection, e.g., a Bluetooth communication connection.

Also, the wearable device 200 may access the mobile communication network 70 through the mobile device 100 to perform wireless communication. That is, the wearable device 200 may not be provided with the mobile communication module 113 required for direct communication with the mobile communication network 70. For example, direct communication to the mobile communication network 70 may be performed by the mobile device 100, and the mobile device 100 may transmit information received from the mobile communication network 70 to the wearable device 200 Or transmit the information received from the wearable device 200 to the connected mobile communication network 70 through the short-range communication connection.

In addition, the wearable device 200 may access the wireless Internet router 50 through the mobile device 100. [ That is, the wearable device 200 may not be equipped with a wireless Internet communication module required for wireless Internet access. For example, the wearable device 200 requests a wireless Internet connection to the mobile device 100 through a predetermined control procedure, and the mobile device 100 accesses the Internet network 60 through the wireless Internet router 50, Can be obtained. Then, the mobile device 100 can transmit the obtained information to the wearable device 200 through the near field wireless communication.

It should be noted that the wearable device 200 according to another embodiment of the present invention may be directly connected to the mobile communication network 70 by mounting the mobile communication module. It should be noted that the wearable device 200 may be directly connected to the Internet network 60 through the wireless Internet router 50 with the wireless Internet communication module installed therein.

3 is an internal configuration diagram of a wearable device according to an embodiment of the present invention.

3, a wearable device 200 according to an exemplary embodiment of the present invention includes a controller 300, a wireless communication unit 310, a sensing unit 320, a sensing unit 340, a storage module 350, Unit 360, an external interface unit 370, a power supply unit 380, and the like.

The components of the wearable device 200 may not be all necessary components for the embodiment of the present invention and the wearable device 200 may be configured with more or fewer components depending on the type and purpose .

 The wireless communication unit 310 may include one or more modules that enable wireless communication between the wearable device 200 and the mobile device 100 or between the wearable device 200 and an external wireless network. For example, the wireless communication unit 310 may include a mobile communication module, a wireless Internet communication module, a short-range communication module, and a GPS (Global Positioning System) receiving module.

The mobile communication module performs a function of transmitting / receiving a radio signal with a base station, a repeater, a repeater, a femtocell, and the like through a wireless interface of the mobile communication network 70. Here, the wireless signal may include various types of data signals in response to voice and video call signals or text / multimedia message transmission / reception.

The wireless Internet module refers to a transmission / reception module for connection to a wireless Internet network. The wireless Internet module can be embedded in the wearable device 200 or can be enclosed through a predetermined interface terminal. WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (World Interoperability for Microwave Access) and the like can be used as wireless Internet technologies.

The short-range communication module is a module for short-range wireless communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), UltraWideband (UWB), ZigBee, and the like can be used as a short distance communication technology. The wearable device 200 according to the present invention may be connected to the mobile device 100 through a predetermined user menu setting or a predetermined control procedure with the mobile device 100 and may be connected to the mobile device 100 through a connected short- And control signals and information can be exchanged.

For example, when a message is received through the external wireless network, the mobile device 100 may transmit a message received through the local communication connection to the wearable device 200. [

The GPS receiving module is a module for confirming or acquiring positional information of the wearable device 200 using a signal received through a positioning satellite.

The wearable device 200 according to an embodiment of the present invention transmits traffic information, tourism information, weather information, map information, schedule information, and the like of a corresponding area to the mobile communication network 70 ) Or a wireless Internet network, and displays the acquired or extracted information on one side of the screen.

The sensing unit 320 may detect a change in the state of the wearable device 200 according to a control signal of the controller 300 and generate sensing information according to the change.

The sensed information collected by the sensing unit 320 includes biometric information of the user of the wearable device 200, positional information of the wearable device 200, user presence / absence information, bearing and altitude information of the wearable device 200, Speed / acceleration / deceleration information of the wearable device 200, temperature / humidity / brightness information outside the wearable device 200, peripheral device connection detection information such as earphone connection and removal, , Ambient sound information, connection information with an external communication device, and the like to detect the current state of the wearable device 200 and to control the operation thereof.

For example, the sensing unit 320 may include a pulse wave sensing module. When the wearable device 200 is of a wrist band type, the pulse wave sensing module is disposed at a position where it is easy to measure a user's pulse wave when wearing the wearable device 200, for example, when wearing a wearable device in the form of a wristband, It may be the point where the movement of the artery is detected.

The sensing unit 320 according to an exemplary embodiment of the present invention can deliver the wearable device 200 to the controller 300 when the user wears the wearable device 200. Thereafter, the control unit 300 may transmit a predetermined control signal indicating that the wearable device 200 is worn to the wearer's body to the mobile device 100 through a short-range communication connection. Here, when a message is received from the external network, the mobile device 100 may determine whether to transmit the received message to the wearable device 200 according to whether or not the wearable device 200 is interlocked with the wearable body. For example, when the wearable device 200 is worn on the wearer's body, the mobile device 100 can deliver the message received from the external network to the wearable device 200. On the other hand, if the wearable device 200 is not worn on the wearer's body, the mobile device 100 may not transmit a message received from the external network to the wearable device 200. [

A control signal indicating whether or not the wearable device 200 wears the wearer's body can be generated periodically or event-triggered and transmitted to the mobile device 100. Here, the periodic method is a method of transmitting the control signal at a predefined period, and when the event triggered method is changed from a wear state to a non-worn state or from a non-worn state to a worn state, And transmitted to the mobile device 100.

In particular, when the wearable device 200 is not worn by the wearer's body, the mobile device 100 according to an exemplary embodiment of the present invention may display a message received from the external network, Or the like. At this time, the mobile device 100 may not transmit the received message to the wearable device 200.

Here, whether or not the wearable device 200 is worn on the body can be judged based on the sensing information collected by the sensing unit 320. Here, the sensing information may include pulse wave information of a user, motion information of a wearable device, and the like.

In addition, the sensing unit 320 according to the present invention may include voice recognition means for recognizing a user's voice input through a microphone and transmitting the user's voice to the control unit 300.

The sensing unit 340 is for inputting an audio signal or a video signal, and may include a camera and a microphone.

The camera processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display module of the output unit 360.

The image frame processed by the camera may be stored in the storage module 350 or transmitted to an external device such as the mobile device 100 via the wireless communication unit 310. [ Two or more cameras may be provided according to the configuration of the wearable device 200.

The microphone receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and converts it into electrical voice data. The converted voice data can be converted into a form that can be transmitted to the mobile device 100 via the proximity communication module and output when the voice data is in the call mode. On the other hand, in the case of the voice recognition mode, the received voice signal may be transmitted to the sensing unit 320, and the sensing unit 320 may recognize the voice signal received through the voice recognition means, To the control unit 300. At this time, the control unit 300 can control the operation of the wearable device 200 according to the speech recognition result.

A variety of noise canceling algorithms may be implemented in the microphone to remove noise generated in receiving an external acoustic signal.

The storage module 350 may store a program for the operation of the controller 300 and may store data input / output (e.g., address book, received text message, schedule information, alarm setting information, Biometric information measured by the sensor, various application programs, etc.) may be temporarily stored.

The storage module 350 may store data on vibrations and sounds of various patterns that are output upon touch input on the touch screen of the wearable device 200. [

The storage module 350 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk.

The storage module 350 may be configured with at least one of different types. For example, the wearable device of the wristwatch type may have a first storage module mounted on one side of the main body, and a second storage module on one side of the wristband connected to the main body. Here, the type of the first storage module may be RAM, and the type of the second storage module may be a card type memory.

The output unit 360 is for generating an output related to visual, auditory, tactile, etc., and may include a display module, an audio output module, an alarm unit, and a haptic module.

The display module displays and outputs information processed in the wearable device 200. For example, when the wearable device 200 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with the call is displayed. Further, when the wearable device 200 is in the video communication mode or the shooting mode, the captured or / and received video or UI and GUI are displayed.

The display module may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, As shown in FIG.

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display module may also be of a light transmission type. With this structure, the user can view objects located behind the wearable device 200 through the area occupied by the display module.

There may be two or more display modules depending on the implementation of the wearable device 200. [ For example, in the wearable device 200, a plurality of display modules may be spaced apart from one another or integrally disposed, and may be disposed on different surfaces, respectively.

In a case where a display module (hereinafter, referred to as a touch sensor) (hereinafter, referred to as 'touch sensor') has a mutual layer structure (hereinafter referred to as a 'touch screen'), the display module may be used as an input device Can be used.

The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific part of the display module or a capacitance generated in a specific part of the display module 131 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 300. Thus, the controller 300 can know which area of the display module is touched or the like.

In particular, the proximity sensing module may be disposed in the interior area of the wearable device 200 or in proximity to the touch screen, which is covered by the touch screen. The proximity sensing module means a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity thereof without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensing module has a longer lifetime and higher utilization than the contact sensing module.

Examples of proximity sensing modules include transmission type photoelectric sensors, direct reflection type photoelectric sensors, mirror reflection type photoelectric sensors, high frequency oscillation proximity sensors, capacitive proximity sensors, magnetic proximity sensors, and infrared proximity sensors.

And to detect the proximity of the pointer with a change of the electric field along the proximity of the pointer if the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensing module.

The sound output module provided in the wearable device 200 may receive audio data received from the wireless communication unit 310 or stored in the storage module 350 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, Data can also be output.

Such an audio output module may include a receiver, a speaker, a buzzer, and the like. Also, the sound output module can output sound through the earphone jack provided at one side of the wearable device 200. [

The alarm module outputs a signal for notifying the occurrence of an event of the wearable device (200). Here, examples of events generated in the wearable device 200 include call signal reception, message reception, key signal input, touch input, and the like. In addition, the alarm module may output a signal informing occurrence of an event by using a form other than a video signal or an audio signal, for example, a vibrating element or a light emitting element. The video signal or the audio signal can also be output through a display module or an audio output module.

The haptic module generates various tactile effects that the user can feel. A typical example of a haptic effect generated by a haptic module is vibration. The intensity and pattern of the vibration generated by the tactile module can be set through a predetermined user interface. For example, the haptic module may synthesize and output different vibrations or sequentially output them.

In addition to the vibration, the haptic module has effects of stimulation by the pin arrangement vertically moving to the contact skin surface, effect of air stimulation through the injection or suction force of the air through the injection port or the suction port, It is possible to generate various tactile effects such as the effect of stimulation through the contact of the electrode (eletrode), the effect of stimulation by the electrostatic force, and the effect of reproducing the cold sensation using the endothermic or exothermic device.

The haptic module can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. The haptic module may include a plurality of haptic modules having various functions according to the configuration of the wearable device 200, or may operate in conjunction with each other according to a control signal of the controller 300. [

The external interface unit 370 provides an interface with all external devices connected to the wearable device 200. The external interface unit 370 receives data from an external device or receives power from the external interface unit 370, transfers the data to each component in the wearable device 200, or transmits data in the wearable device 200 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video I / O (input / output) port, an earphone port, and the like may be included in the wearable device 200.

Here, the identification module is a chip for storing various information for authenticating the usage right of the wearable device 200, and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format.

Accordingly, the identification device can be connected to the wearable device 200 through a predetermined port.

The power supply unit 380 receives external power and internal power under the control of the controller 300 and supplies power necessary for operation of the respective components.

The control unit 300 typically controls the overall operation of the wearable device 200.

For example, the control unit 300 can control the installation and operation of application programs and widgets as well as communication functions including voice communication, data communication, video call, wireless Internet connection, and short-range communication connection.

In particular, the controller 300 determines whether or not the user wears the wearable device 200 by using the user's biometric information collected by the sensing unit 320 and the motion information of the wearable device 200, Signal to the mobile device 100 over a short-range communication connection.

In addition, the control unit 300 can perform pattern recognition processing for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

In addition, the control unit 300 can control input and output according to various control signals received from the lower module, and provide a user interface screen corresponding thereto. The lower module includes the wireless communication unit 310, the sensing unit 320, the sensing unit 340, the storage module 350, the output unit 360, the external interface unit 370, and the power supply unit 380 .

Various embodiments of the wearable device 200 described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, embodiments of the wearable device 200 described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs) may be implemented using at least one of field programmable gate arrays, processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. Such embodiments may be implemented by the control unit 300 in some cases.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the storage module 350 and executed by the control unit 300. [

4 is a flowchart illustrating a method of controlling information display in a mobile device according to an exemplary embodiment of the present invention.

Referring to FIG. 4, the mobile device 100 monitors a notification corresponding to a message received from the external network (S401). Here, when receiving a message received from the external network, the mobile device 100 may operate a Notification Agent program for generating a predetermined notification event in the background. At this time, the control unit 180 of the mobile device 100 can transmit the detected notification event to the corresponding application software when the corresponding notification event is detected.

For example, if the received message is a KakaoTalk message, the control unit 180 may notify the presence of a message received by the KakaoTalk application software. In the case of a message, the control unit 180 may notify the presence of an incoming call in the call application software.

When the notification event is detected, the mobile device 100 can identify the application software running on the mobile device 100 (S403 to S405).

Subsequently, the mobile device 100 confirms whether any of the identified application software is active (i.e., operating in Foreground) (S407).

If the activated application exists, the mobile device 100 may transmit a predetermined notification message to the wearable device 200 via the predetermined short-range communication connection to inform the wearable device 200 that the message has been received from the external network (S411). At this time, the mobile device 100 may not display any notification on the screen in response to the message reception in order to prevent the user from using the application. Also, the mobile device 100 can control not to output specific sounds, vibrations, and the like to be notified that a new message has been received. In another example, if there is an activated application, the mobile device 100 may display only a predetermined notification icon corresponding to the received message on one side of the notification bar that is always displayed on the screen.

If it is determined in step 407 that the activated application does not exist, the mobile device 100 displays a notification screen corresponding to the received message on the screen, for example, if the received message is a text message , The notification screen may be a "notification popup window ", and if the received message is an incoming call message, the notification screen may indicate" incoming call notification screen "(S409) A predetermined notification message indicating that a message has been received from the network may be transmitted (S411).

When the wearable device 200 receives the notification message, the wearable device 200 can display a screen corresponding to the notification message on the screen.

For example, when the notification message is a message for notifying reception of a text message, the wearable device 200 may display a part or all of the received text message in a text form on one side of the screen, or may display the received text message in the form of a pop- As shown in FIG.

In another example, when the notification message is a message for notifying reception of an incoming call, the wearable device 200 may configure a call reception screen and display it on the screen.

5 is a flowchart illustrating an information display control procedure in a system according to an embodiment of the present invention.

Referring to FIG. 5, the mobile device 100 and the wearable device 200 can establish a Bluetooth communication connection through a predetermined control procedure (S501).

In operation S503, the mobile device 100 may activate a Notification Agent in the background to notify that there is a message received from the external network. Here, the notification agent may be software that is always executed when the mobile device 100 is started.

When a text message is received from the mobile communication network 70, the notification agent of the mobile device 100 may generate an internal notification event indicating that the text message has been received (S505).

When the control unit 180 of the mobile device 100 detects a notification event, it determines whether there is an active application, that is, a foreground application (S507).

As a result of the determination, if there is an active application, the mobile device 100 may transmit a predetermined notification message to the wearable device 200 through the Bluetooth communication connection, informing that the text message has been received (S511).

If it is determined in step 507 that the activated application does not exist, the mobile device 100 displays a popup notification message corresponding to the received text message on the screen (S509), and transmits the popup notification message to the wearable device 200 (Step S511). In step S511, a predetermined notification message including a text message may be transmitted.

When the wearable device 200 receives the notification message, the wearable device 200 can display the text message included in the notification message on the screen (S513).

6 is a flowchart illustrating an information display control procedure in a system according to another embodiment of the present invention.

Referring to FIG. 6, the mobile device 100 and the wearable device 200 can establish a Bluetooth communication connection through a predetermined control procedure (S601).

In operation S603, the mobile device 100 may activate a Notification Agent in the background to notify that there is a message received from the external network. Here, the notification agent may be software that is always executed when the mobile device 100 is started.

The wearable device 200 determines whether or not the wearable device 200 is worn on the user's body based on the sensing information collected by the mounted sensing unit 320, To the mobile device 100 (S605). Here, the body wear status message may be transmitted every predetermined period or every time the body wear status is changed.

The notification agent of the mobile device 100 may generate an internal notification event notifying that the incoming call is requested when the incoming call message is received from the mobile communication network 70 (S607).

The controller 180 of the mobile device 100 may determine whether the wearable device 200 is worn on the wearer's body based on the received body wear status message in operation S609, .

As a result of the determination, if the wearable device 200 is worn on the wearer's body, the mobile device 100 may transmit a predetermined notification message indicating that the incoming call has been received to the wearable device 200 through the established Bluetooth communication connection (S611) .

When the wearable device 200 receives the notification message, the wearable device 200 may generate a predetermined call connection standby screen and display it on the screen (S613).

If it is determined in step 609 that the wearable device 200 is not worn on the user's body, the mobile device 100 may generate and display a predetermined incoming call connection standby screen in step S615.

In steps 613 and 615, the wearable device 200 and the mobile device 100 may notify the user that an incoming call has been received by using vibration, sound, or the like, according to user settings.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Mobile devices: 100 Controls: 180
Wearable device: 200 Mobile communication network: 70
Sensing section: 320

Claims (16)

A method of controlling display of information in a mobile device in association with a wearable device,
Establishing a short-range communication connection with the wearable device;
Receiving a body wearing state message indicating whether or not the wearable device is worn on the body of the user through the short-range communication connection and confirming whether the wearable device is worn by the body;
Monitoring a notification event occurring corresponding to a message received from the external network;
Checking whether the activated application software exists on the screen of the mobile device when the notification event is detected; And
Transmitting a notification message corresponding to the received message to the wearable device via the short-range communication connection if the body wear of the wearable device is confirmed and the activated application software is present
The information display control method comprising: The method according to claim 1,
Wherein the external network includes at least one of a wireless Internet network and a mobile communication network. The method according to claim 1,
Wherein the received message is one of an incoming call message, a text message, a multimedia message, and a social network service (SNS) message. The method according to claim 1,
The short-range communication connection may include at least one of an information display control such as a Bluetooth communication connection, an IrDA (infrared data association) communication connection, an UWB (UltraWideband) communication connection, a ZigBee communication connection, Way. The method according to claim 1,
And if the activated application software exists, a notification screen corresponding to the received message is not displayed on the screen of the mobile device. The method according to claim 1,
Wherein when the activated application software is present, only a predetermined icon corresponding to the received message is displayed on a notification bar disposed on one side of the screen of the mobile device. delete The method according to claim 1,
Wherein whether the wearable device is worn on the user's body is determined based on sensing information collected by the wearable device. 9. The method of claim 8,
Wherein the sensing information includes at least one of biometric information of the user of the wearable device and motion information of the wearable device. The method according to claim 1,
Wherein the body wear status message is transmitted when the body wear status of the wearable device is changed. The method according to claim 1,
Wherein the notification event is generated by a predetermined notification agent operating in the background on the mobile device. A computer-readable recording medium storing a program for executing the method according to any one of claims 1 to 6 and 8 to 11. Means for establishing a short-range communication connection with the wearable device;
Means for receiving a body wearing status message indicating whether or not the wearable device is worn on the body of the user through the short-range communication connection to confirm whether the wearable device is worn by the body;
Means for monitoring a predetermined notification event occurring corresponding to a message received from an external network;
Means for confirming whether the activated application software exists on the screen of the mobile device when the notification event is detected; And
Means for transmitting a notification message corresponding to the received message to the wearable device via the short-range communication connection if the body wear of the wearable device is confirmed and the activated application software exists;
Lt; / RTI > 14. The method of claim 13,
And if the activated application software exists, a notification screen corresponding to the received message is not displayed. 14. The method of claim 13,
Wherein when the activated application software exists, only a predetermined notification icon corresponding to the received message is displayed on one side of the notification bar that is always displayed on the screen. delete

Images