KR101909031B1 - Mobile terminal anc controlling method thereof - Google Patents

Abstract

The present invention relates to a wireless communication device for communicating with an external terminal, A touch screen for receiving a first touch input of a first desired locus; And controls the first handwritten object drawn along the first desired trajectory to be simultaneously displayed through the touch screen and the external terminal when the first touch input is inputted in the first handwriting input mode, And a controller for controlling the first handwritten object to be displayed only on the touch screen when the first touch input is inputted in the input mode.

Description

[0001] MOBILE TERMINAL ANC CONTROLLING METHOD THEREOF [0002]

The present invention relates to a mobile terminal set to share a handwritten object outputted through a mobile terminal with an external terminal and a control method thereof.

A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In addition, the role of the terminal extends to scheduler functions such as simple memo input and storage, schedule management, and the like. In recent years, the terminal has been designed so that a user can input a handwriting without operating another application for the purpose of enhancing the scheduler function.

However, a method of sharing handwriting input with an external terminal while a user is inputting handwriting input has not been developed yet. In order to share the results of the handwriting input performed by the conventional user with other users, it is necessary to terminate the handwriting action, apply a capture command, drive an application (a text message application, an instant message application, etc.) And so on. Accordingly, there arises a problem that user's operation is inconvenient to share the handwriting input result of the touch screen with the external terminal.

The present invention is intended to provide a mobile terminal that improves user's operational convenience.

Specifically, the present invention provides a mobile terminal that can easily share a handwritten object drawn on a touch screen with an external terminal.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

A mobile terminal according to an embodiment of the present invention includes a wireless communication unit for communicating with an external terminal; A touch screen for receiving a first touch input of a first desired locus; And controls the first handwritten object drawn along the first desired trajectory to be simultaneously displayed through the touch screen and the external terminal when the first touch input is inputted in the first handwriting input mode, And a controller for controlling the first handwritten object to be displayed only on the touch screen when the first touch input is inputted in the input mode.

The technical solutions obtained by the present invention are not limited to the above-mentioned solutions, and other solutions not mentioned are clearly described to those skilled in the art from the following description. It can be understood.

The mobile terminal according to the present invention can be expected to improve user's operating convenience.

Specifically, the present invention can provide a mobile terminal that can easily share a handwriting object drawn on a touch screen with an external terminal.

Furthermore, the present invention can provide a mobile terminal capable of simultaneous handwriting input and voice recording.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2A and 2B are a perspective view and a rear view, respectively, of a mobile terminal or a mobile terminal according to the present invention.
3 is an illustration of an example in which a plurality of function tools are displayed through a touch screen;
FIG. 4 is an exemplary view for explaining the operation of the mobile terminal using the eyedropper pen shown in FIG. 3;
5 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as an application eyedropper;
6 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as a functional eyedropper.
7 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as a text eyedropper;
8 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as a color eyedropper;
9 is an exemplary diagram for explaining how a handwriting input is drawn by applying an attribute assigned to a function tool;
10 is an exemplary diagram for explaining that attributes assigned to a functional tool are manually changed based on a user operation;
11 is an exemplary diagram for explaining simultaneous handwriting input and voice recording using a function tool;
FIG. 12 is an exemplary view for explaining whether or not a handwriting object drawn using a drawing pen and a private pen is displayed on an external terminal; FIG.
13 is an exemplary diagram for explaining capturing a real-time output image of a touch screen using a capture pen;
14 is an exemplary view for explaining the operation of the mobile terminal using the shared pen;
Figure 15 is an illustration of an example of transferring a capture image to an account designated by the sharing pen without waiting for user input.
Figure 16 is an exemplary illustration of adding a new functional tool to a touch screen using an additional pen;
17 is another example for adding a new functional tool.
18 is an exemplary diagram for explaining a change to a high-lighter pen with a private high-lighter pen;
19 is a flowchart of a handwriting input sharing method of a mobile terminal according to an embodiment of the present invention.
20 is an example of a screen for setting whether handwriting input permission of an external terminal set to share handwriting input is set;
21 is an exemplary output of a touch screen for setting an editing right of a handwriting object displayed on a touch screen;
22 is an exemplary view for explaining the progress of voice recording after a handwriting object is drawn on the touch screen;
23 is an exemplary view for explaining an overlap display of a first handwritten object and a second handwritten object;
24 is an exemplary view for explaining that the first handwritten object and the second handwritten object are displayed in different areas of the touch screen;

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix " module " and " part " for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as " proximity touch " The act of actually contacting the pointer on the touch screen may be referred to as " contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the sound / voice output module 152 may be a kind of the alarm unit 153. The display unit 151 and the sound / . ≪ / RTI >

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 The touch recognition mode can be activated or deactivated.

2B is a rear perspective view of the mobile terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to that of the camera 121 (see FIG. 2A), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for communication, a broadcast signal receiving antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output the time information on both sides (i.e., in the directions of both the front and back sides of the mobile terminal), the time information can be recognized through the touch pad 135 do. The information output on both sides may be all controlled by the touch pad 135. [

Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal 100 constructed as above will be described with reference to the accompanying drawings.

For convenience of description, it is assumed that the mobile terminal 100 mentioned below includes at least one of the components shown in FIG. The mobile terminal 100 may include a wireless communication unit 110, a display unit 151, a memory 160, and a controller 180 among the components shown in FIG. In some cases, the mobile terminal 100 according to the present invention may further include a microphone 122 among the components shown in FIG. The mobile terminal 100 according to the present invention can be more easily implemented when the display unit 151 is implemented as the touch screen 151. Therefore, it is assumed that the display unit 151 is the touch screen 151, Will be described.

The mobile terminal 100 according to the present invention is for sharing handwriting input with an external terminal device and is characterized in that the sharing of handwriting input can be controlled by using a function tool displayed on the touch screen 151. [ Before describing the handwriting input sharing between the mobile terminal 100 and the external terminal device according to the present invention, the mobile terminal 100 using the display process and the functional tool displayed on the touch screen 151, Will be described in detail. After the description of the functional tool is completed, a handwriting input sharing method using the mobile terminal 100 according to the present invention will be described in detail.

FIG. 3 is an exemplary view showing a plurality of function tools displayed on a touch screen. FIG. 3a-1, when a suitable user input 301 is applied to the touch screen 151 (e.g., one corner of the touch screen 151 is long pressed (contact hold of the pointer for a predetermined time) , The controller 180 may control the display of the pen-shaped function tool 311-323 as shown in FIG. 3A-2. In Fig. 3A-2, the functional tool is illustrated as having a layout in the form of being plugged into a pallet 331 of a 1/4 circle shape.

The display position and the layout of the function tool displayed on the touch screen 151 do not necessarily depend on the example of Fig. 3A, the function tool 311-323 is displayed at one corner of the touch screen 151, and the function tool is laid in a pallet 331 of a 1/4 circle shape. However, The functional tool can be displayed in any other location or in a different layout.

The control unit 180 may control the display position and the layout of the function tool to be adjusted according to a user input made to call the function tool. 3A-1, a touch input is applied to one corner of the touch screen 151 in order to call the function tool. However, in order to call the function tool, 303 may be applied, it may be controlled so that the functional tool is displayed in a different position and / or in a different layout than in Fig. 3A-2.

For example, as shown in FIG. 3B-1, when the user flickes the pointer upward (303) with the two pointers touching the touch screen 151 to display the function tool, , The controller 180 can control the display of the functional tool having the layouts 311-323 and 333 arranged vertically long on the right side of the touch screen 151, as shown in FIG. 3B-2. At this time, when displaying the function tool, the control unit 180 may control the animation in which the pallet 333 in the form of a rolled-up roll is unfolded while the function tool 311-323 is plugged. In other words, the control unit 180 can control so that the number of display times of the functional tool gradually increases over time, thereby completing the output of Fig. 3B-2.

As another example, if the user flickes the pointer to the right (305) with the two pointers touching the touch screen 151 to display the function tool, as shown in Figure 3C-1, 180 may control to display a functional tool having layouts 311 - 323, 335 arranged in a horizontally elongated shape at the upper end of the touch screen 151, as shown in FIG. 3C-2. At this time, it is needless to say that the animation described in FIG. 3B-2 can be applied in displaying the function tool.

3A to 3C illustrate examples of applying a touch input to one corner of a touch screen 151 as a user input for displaying a function tool 301 and flicking two pointers in a predetermined direction 303 and 305 However, this is merely for convenience of description, and is not intended to limit user input. In addition to the non-touch input, a function tool may be displayed based on user input such as voice command, external key operation, and the like.

However, if there are a plurality of user inputs for displaying the function tool, as in the example shown in Fig. 3, the display position and / or layout of the function tool may be adjusted depending on what user input is input. In other words, if the display command of the functional tool is input as the first user input, the functional tool is displayed in the first position and the first layout form on the touch screen 151. If the display command of the functional tool is input as the second user input The second location on the touch screen 151, and the second layout.

3, the lock-shaped buttons 340 are illustrated as being displayed on the pallets 331, 333, and 335, to which the function tool is inserted, in FIGS. 3A to 3, 3B-2, and 3C-2. Here, the lock-shaped button 340 may be displayed on the touch screen 151 to control whether the function tool is continuously displayed or not. For example, if the lock button 340 is set to the locked state, the control unit 180 determines whether the lock button 340 is in the unlocked state, 151).

Conversely, if the lock-shaped button 340 is set to the unlocked state as illustrated in Figs. 3A-2, 3B-2 and 3C-2, the control unit 180 displays the indication of the function tool Can be controlled to be interrupted. For example, if a user input (e.g., a touch input to the touch screen 151 or a user input via an external key operation) is not detected for a predetermined time after the display of the function tool is started, When a condition such as when any one of a plurality of functioning tools being displayed on the display screen is selected and when a predetermined time has elapsed after any one of the plurality of functioning tools has been selected, The display can be controlled to be stopped.

In order to select any one of the plurality of function tools displayed on the touch screen 151, the user inputs a touch input appropriate to the function tool (e.g., a touch input to the function tool to be activated, A touch input such as flicking in a predetermined direction) is performed to select a function tool. When the user selects one of the plurality of function tools, the controller 180 can identify and display the function tool selected by the user on the touch screen 151. [ 3A-2, 3B-2 and 3C-2, which will be described in more detail. It is assumed that the function tool selected by the user in Figs. 3A-2, 3B-2 and 3C-2 is the capture pen 313.

For example, as shown in FIG. 3A-2, the control unit 180 controls the touch screen 151 so that a plurality of function tools are displayed on the touch screen 151 (in the right lower corner of the touch screen 151 in FIG. The function tool 313 selected by the user can be further displayed on an area that does not overlap with the touch screen 151 (the upper left corner of the touch screen 151 in FIG. 3A-2). In the example of FIG. 3A-2, the user can confirm which function tool is selected through the display of the selected function tool 313 displayed on the upper left corner of the touch screen 151. [

3A-2, a plurality of function tools are displayed on the lower right side of the touch screen 151, and the function tool 313 selected by the user is further displayed on the upper left side of the touch screen 151. [ However, if one of the function tools is selected with the lock button 340 set to unlocked, as described above with the lock button 340, a plurality of function tools 311-323 displayed on the lower right side The display may be interrupted. In this case, the user can recognize the currently active function tool only by displaying the selected function tool 313 on the upper left of the touch screen 151. [

In the example shown in FIG. 3A-2, the function tool 313 selected by the user is displayed in a predetermined area to identify the function tool 313 selected by the user. However, a method other than the method of FIG. 3A-2 may be applied . For example, as shown in FIGS. 3B-2 and 3C-2, the controller 180 may control the user to select a function tool selected by the user by giving a visual effect to the function tool selected by the user.

3B-2, the control unit 180 controls the function tool 313 selected by the user so that a predetermined pattern (or color) is applied and displayed so that the function tool 313 selected by the user ) Can be identified. Although not shown, the control unit 180 may display the outline of the function tool 313 selected by the user differently from other function tools, thereby controlling the function tool selected by the user to be identified.

As another example, the control unit 180 controls the function tool 313 selected by the user to be displayed so as to be more protruded than the other function tools 311 and 315-323, as in the example shown in FIG. 3C-2, So that the function tool 313 can be identified. The control unit 180 controls the function tool 313 selected by the user to be displayed more depressed than the other function tools 311 and 315-323 so that the function tool 313 selected by the user is identified You can do it.

3A-3, FIG. 3B-2 and FIG. 3C-2 illustrate the identification method of the function tool 313 selected by the user. However, the identification of the function tool 313 selected by the user shown in Figs. 3A-2, 3B-2 and 3C-2 does not necessarily correlate with the layout of the corresponding function tool. For example, as shown in FIG. 3A-2, even if the 1/4 original pallet has a layout in which six function tools are plugged, the functions described with reference to FIGS. 3B-2 and 3C- Lt; RTI ID = 0.0 > 313 < / RTI >

Furthermore, two or more of the identification methods of the functional tools shown in Figs. 3A-2, 3B-2 and 3C-2 may be combined to identify the functional tool selected by the user. For example, a predetermined pattern or color is applied to the function tool 313 selected by the user (see FIG. 3B-2) while the function tool 313 selected by the user is displayed in a predetermined area (Refer to FIG. 3C-2) so that the function tool selected by the user can be displayed protruding from the other function tool.

3B-2, and 3C-2, the functional tool displayed on the touch screen 151 includes a sickle pen 311, a capture pen 313, A private pen 317, a highlighter pen 319, a draw pen 321, and an additional pen 323 are illustrated. The private pen 317, the highlighter pen 319, and the drawing pen 321 are connected to the entry of the handwriting input mode, . Further, the capture pen 313 and the shared pen 315 can be understood to be associated with a predetermined operation after entering the handwriting input mode and ending the handwriting input mode.

Hereinafter, functions performed by the respective functional tools shown in Figs. 3A-2, 3B-2, and 3C-2 will be described in detail.

4 is an exemplary view for explaining the operation of the mobile terminal using the eyedropper pen shown in FIG. When the user selects the eyedropper pen 311 displayed on the touch screen 151, the controller 180 displays the detailed operation setting menu 410 of the eyedropper 311 shown in FIG. 4 on the touch screen 151 . Through the detailed operation setting screen shown in FIG. 4, the user can select an item to be extracted using the eyedropper 311. FIG. In the menu screen of Fig. 4, the eyedropper 311 is connected to the application (app) eyedropper 311-1, the fun eyedropper 311-2, the text eyedropper 311-3 and the color eyedropper 311 -4). ≪ / RTI >

The application eyedrop pen 311-1 is for extracting an application driving instruction, and the function eyed pen 311-2 may be for extracting an instruction other than an application driving instruction. Further, the text eyedropper 311-3 can extract a character string displayed on the touch screen 151, and the color sadoprene pen can extract a color value output through a predetermined point of the touch screen 151 ≪ / RTI >

The operation according to the detailed setting of the eyedropper pen 311 will be described in more detail with reference to the drawings to be described later.

5, when the eyedropper 311 is set as the application eyedropper 311-1, the operation of the mobile terminal 100 will be described.

5 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as the application eyedropper.

5A, when the touch input 503 is applied to the application driving icon icon displayed on the touch screen 151 while the application eyedropper 311-1 is selected, the control unit 180 selects It is possible to extract an application driving instruction which is an instruction provided by the application driving icon 505 and to control the application driving instruction extracted in the application eyedrop pen 311-1 to be associated with each other.

In FIG. 5A, since the touch input is applied to the driving icon 505 of the e-mail application, the control unit 180 may associate the e-mail application driving command with the application eyed pen 311-1. At the same time, the control unit 180 can control so that the application drive icon 505 (or the name of the application that is the target of the application drive instruction) to which the touch input is applied is displayed on the application dropper pen 311-1 5b shows an example in which the drive icon 505 of the e-mail application is displayed on the application eyedrop pen 311-1).

If the application input command is not associated with the application eyedropper 311-1 and the touch input is applied at a point other than the point where the application drive icon is displayed, An alarm message 507 indicating that the application driving command can not be extracted is outputted from the point where the input is applied.

After the application driving instruction is associated with the application eyedrop pen 311-1, a touch input is applied to the application eyedrop pen 311-1, or the application eyedrop pen 311-1 is selected, When a touch input is applied to an arbitrary point, the control unit 180 processes an application driving instruction associated with the application eyedrop pen 311-1 to control the driving screen of the application to be displayed on the touch screen 151. [ In Fig. 5A, since the driving instruction of the e-mail application is linked to the application eyedrop pen 311-1, the control unit 180 can control the e-mail application to be driven.

If the point at which the touch input is applied is another application driving icon, the control unit 180 does not process the application driving instruction associated with the application eyedrop pen 311-1, The command can be extracted. Thereafter, the control unit 180 may control the new application driving instruction to be linked with the application driving instruction associated with the old application eyedrop pen 311-1.

The control unit 180 controls the application eyedropper 311-1 so that even in an environment where the drive icon of the desired application is not displayed, It is possible to have an advantage of being able to drive a desired application through the network.

Next, the operation of the mobile terminal 100 will be described with reference to FIG. 6, where the eyedropper 311 is set as the functional eyedropper 311-2.

6 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as a functional eyedropper.

The function eyedropper 311-2 is for extracting a command other than an application driving instruction word. For convenience of explanation, it is assumed that the e-mail application is executed in Fig. As shown in FIG. 6A, when the e-mail application is executed, a function icon for providing a simple operation of the e-mail application can be displayed. For example, in FIG. 6A, the first function icon 603 may be a command for performing a new email creation function, and the second function icon 605 may be a command for performing a search function of a send / receive email item .

When a touch input 607 is applied to a function icon displayed on the touch screen 151 in a state where the function eyedropper 311-2 is selected (in FIG. 6A, a touch input is applied to the first function icon 603) The control unit 180 can extract the command provided by the selected function icon 603 and associate the extracted command with the function eyedrop pen 311-2. 6, a touch input is applied to the first function icon 603 for performing a new e-mail creation function, so that the control unit 180 can extract a new e-mail creation command and link it with the function eyedropper 311-2 .

At the same time, the control unit 180 can control the display of the instruction to be inputted to the function eyedropper 311-2 (601) or the instruction word assigned to the function eyedropper 311-2 ( In FIG. 6B, 'Create an E-mail' is displayed (607) as an explanatory note of a command assigned to the function eyedropper 311-2).

After a predetermined command is associated with the function eyedropper 311-2, a touch input is applied to the function eyedropper 311-2, or when the function eyedropper 311-2 is selected, When the touch input is applied to the point, the control unit 180 can process the command associated with the function eyedropper 311-2. In the example of Fig. 6A, since the function eyedropper 311-2 is associated with a new e-mail creation command, the control unit 180 can process the new e-mail creation command and control the new e-mail creation screen to be displayed.

If the point at which the touch input is applied is another function icon, the control unit 180 may extract a new command provided by the newly selected function icon instead of processing the command associated with the function eyedropper 311-2 . Thereafter, the control unit 180 controls the new instruction to be associated with the function eyedropper 311-2 by replacing the command associated with the former function eyedropper 311-2.

However, when a command related to a specific application is assigned to the function eyedropper 311-2, it may happen that a specific application must be necessarily executed in order to process a command associated with the function eyedropper 311-2. For example, if the email application is not running, it will not be able to process the new email creation command in FIG. 6A. In order to process the instruction assigned to the function eyedropper 311-2, the control unit 180 instructs the function eyedropper 311-2 to execute an instruction (for example, And further controls so that a predetermined instruction word can be processed after processing the instruction to be preceded.

As another example, the control unit 180 may copy, paste, delete, new, save, etc. a command that can be associated with the function eyedropper 311-2 It can be limited to commands that are common to most applications. If a command other than the above listed commands is to be assigned to the function eyedropper 311-2, the controller 180 can not assign the selected command to the eyedropper 311 as shown in the example shown in Fig. 6C An alarm message 610 may be output.

By controlling the function eyedropper 311-2 so that an instruction other than the application driving instruction is assigned, the control unit 180 processes the same instruction as the instruction assigned to the function eyedropper 311-2, as in the above example Even if the function icon is not displayed, the desired command may have an advantage that it can be processed.

Next, the operation of the mobile terminal 100 will be described with reference to Fig. 7, where the eyedropper pen 311 is set as the text eyedropper 311-3.

7 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as a text eyedropper.

When a user input 703 is applied to a predetermined character string displayed on the touch screen 151 in a state where the text mouth pen 311-3 is selected (in FIG. 7A, "Typhoon No. 7" is displayed on the touch screen 151) The control unit 180 can extract the character string indicated by the user input 703 and associate it with the text eyedrop pen 311-3. When the character string is extracted, the control unit 180 can control to display the extracted character string 707 in the text eyedropper 311-3 as shown in FIG. 7B.

7B, when the user input 705 is applied to the portion to which the character string is to be pasted in a state in which the text eyedropper 311-3 is selected (in FIG. 7B, The control unit 180 can paste a character string associated with the text eyedropper 311-3 at a point indicated by the user input.

That is, the user can control the copying and pasting function of the character string displayed on the touch screen 151 to be performed by using the eyedropper 311 of FIG. It is meaningful that the mobile terminal 100 that does not use the binary input system of a mouse and a keyboard, such as a computer, can provide an easy copying and pasting function.

Next, the operation of the mobile terminal 100 will be described with reference to FIG. 8 when the eyedropper pen 311 is set as the color eyedropper 311-4.

8 is an exemplary view for explaining the operation of the mobile terminal when the eyedropper pen is set as a color eyedropper. For convenience of explanation, the touch screen 151 exemplifies that the handwriting object 805 is displayed.

When a touch input 803 is applied to an arbitrary point on the touch screen 151 in a state that the color eyedropper 311-4 is selected, the controller 180 controls the color displayed on the portion to which the touch input is applied, And can be linked to the pen 311-4. At the same time, the control unit 180 controls to display the color temporarily stored in the clone image (or the color eyedrop pen 311-4) of the color eyedrop pen 311-4, (The color associated with the color eyedropper 311-4 is illustrated as being a character string 807 in FIG. 8B in FIG. 8B).

8B, when the touch input 809 is applied to the object 805 displayed on the touch screen 151 in the state that the color eyedropper 311-4 is selected, The color of the object can be adjusted to the temporarily saved color.

4, a setting screen for setting the detailed operation of the eyedropper pen 311 is displayed and the detailed operation of the eyedropper pen 311 is determined by waiting for a user input. However, the eyepiece pen 311 ) Need not be determined.

For example, the control unit 180 may control the detailed operation of the eyedropper 311 to be determined according to the object selected by the touch input after the eyedropper 311 is selected. Specifically, if the object selected by the touch input is the application-driven icon, the control unit 180 controls the eyedropper 311 to operate as the application eyedropper 311-1. If the object selected by the touch input is a function icon , It is possible to control the eyedropper 311 to function as the function eyedropper 311-2. Further, if the object selected by the touch input is a character string, the control unit 180 may control the eyedropper 311 to operate as the text eyedropper 311-3. If there is no object selected by the touch input or an object other than the object (application icon, function icon and string) is selected, the control unit 180 controls the eyedropper 311 to operate with the color eyedropper 311-4 . ≪ / RTI >

Next to the eyedropper 311, a functional tool related to the entry of the handwriting input mode among the functional tools shown in Figs. 3A-2, 3B-2 and 3C-2 will be described.

As described above, the high-lighter pen 319, the drawing pen 321, the private pen 317, the capture pen 313, and the display unit 313 among the functional tools shown in Figs. 3A-2, 3B-2 and 3C- If the sharing pen 315 is selected, the control unit 180 can be set to enter the handwriting input mode. When entering the handwriting input mode, the controller 180 can control the handwriting object to be drawn on the touch screen 151 by following the user's touch input. At this time, the handwriting objects drawn on the touch screen 151 may be applied with the attributes assigned to the selected function tool.

The attributes assigned to the selected function tool are applied to the handwriting object will be described in detail with reference to the operations of the drawing pen 321 and the highlighter pen 319 in Fig.

9 is an exemplary diagram for explaining how a handwriting input is drawn by applying an attribute assigned to a function tool. The attribute assigned to the highlighter pen 319 is exemplified by a first color and a first thickness in a semitransparent state such as a highlighter, and an attribute assigned to the drawing pen 321 is a second color in a semitransparent state And the second thickness.

9A, when the user's touch input is applied in a state in which the high-lighter pen 319 is activated, the controller 180 displays the handwriting object 903 in the first color and the first thickness in the semi-transparent state Can be drawn. Otherwise, as in the example shown in FIG. 9B, when the user's touch input is applied in a state in which the drawing pen 321 is activated, the control unit 180 sets the second color of the opaque state and the second color of the handwriting object (905) is drawn.

That is, as in the example shown in Fig. 9, the control unit 180 can control the attribute of the selected function tool to be applied to the handwriting object to draw the handwriting object.

The attributes such as color and thickness assigned to the function tool are not invariant but can be changed by user operation. This will be described in detail with reference to FIG.

Fig. 10 is an exemplary diagram for explaining that attributes assigned to the function tool are manually changed based on a user operation. Fig. For convenience of explanation, FIG. 10 exemplifies changing the attribute of the drawing pen 321. FIG. 10 may be applied to the highlighter pen 319, the private pen 317, the capture pen 313, and the shared pen 315 as they are.

10A, the control unit 180 controls the touch pen 101 to move the touch pen 101 to a position where the appropriate touch input 1001 is applied to the pen 321 shown in the touch screen 151 (e.g., long press the pen 321) As shown in FIG. 10B, a setting menu 1010 capable of adjusting an attribute assigned to the drawing pen 321 is displayed. In FIG. 10B, it is illustrated that the color and thickness of the drawing pen 321 can be adjusted. The user may adjust the attributes (color and thickness) of the drawing pen 321 through the setting menu 1010 of FIG. 10B. If the attribute of the drawing pen 321 is changed, then the changed attribute may be applied to the writing object drawn based on the drawing pen 321. [

In the setting menu of FIG. 10B, not only the adjustment of the attributes (color and thickness) assigned to the drawing pen 321 but also the activation of the recording function using the drawing pen 321 can be controlled. If the recording function is set to the On state, the controller 180 can create an environment in which the voice recording can be performed at the same time (or separately) the handwriting object is drawn on the touch screen 151. [ This will be described with reference to FIG.

11 is an exemplary diagram for explaining simultaneous handwriting input and voice recording using a function tool. For convenience of explanation, FIG. 11 exemplifies that handwriting input and voice recording can be performed simultaneously using the drawing pen 321. FIG. 11 may be applied to the highlighter pen 319, the private pen 317, the capture pen 313, and the shared pen 315 as they are.

When the user selects the drawing pen 321 for handwriting input, the control unit 180 enters the handwriting input mode, and at the same time, performs a recording operation to enable or disable the activation of the microphone 122, as shown in FIG. So that the button 1110 is displayed. While keeping the handwriting input mode, the controller 180 follows the trajectory of all the touch inputs except the touch input for selecting the record button 1110 (including the stop button 1120 and the play button 1130 to be described later) It is possible to control so that the object 1101 is drawn.

On the contrary, when the user applies a touch input to the record button 1110 displayed on the touch screen 151, the control unit 180 controls the record button 1110 as the stop button 1120, as in the example shown in FIG. And activates the microphone 122 to control voice recording to proceed. Since the handwriting input mode is continuously maintained during the voice recording, the control unit 180 can control the handwriting object 1101 to be drawn by following the trajectory of the touch input applied to the touch screen 151. [ That is, the user can control the voice input to be inputted to the touch screen 151 while the voice recording is proceeding. The control unit 180 may control the voice recording progress time 1160 to be further displayed through the touch screen 151 during the voice recording process .

Thereafter, when a touch input is applied to the stop button 1120, the control unit 180 may deactivate the microphone 122 to control the voice recording to be terminated. At the same time, the control unit 180 can stop the display of the stop button and control the playback button 1130 to display the recorded audio file. The control unit 180 displays the play button 1130 at the end point of the handwriting object 1101 (i.e., at the end of the handwriting object 1101) as shown in Fig. 11C, Can be controlled.

If there is no handwriting object drawn on the touch screen 151, the control unit 180 displays the stop button 1120 at the position where the stop button 1120 was displayed (the upper end of the touch screen 151 in FIG. 11B) The playback button 1130 may be displayed alternately.

Furthermore, when the voice recording is completed, the controller 180 may control the recording button 1112 to further display a new voice recording, as in the example shown in FIG. 11C. Further, the control unit 180 may control the number of audio files 1170 recorded so far to be further displayed (illustrated as being displayed on the left side of the recording button 1112 in FIG. 11C).

11, the recording button 1110 and the stop button 1120 for controlling the activation / deactivation of the microphone 122 are illustrated as being displayed. However, the activation / deactivation of the microphone 122 must be controlled by using the button It is not.

As another example, the control unit 180 controls the microphone 122 to be activated so that voice recording proceeds while the pointer remains in contact with the touch screen 151 (i.e., while the touch input is being applied) When the touch screen 151 is disconnected (i.e., when the touch input is terminated), the microphone 122 may be inactivated to control voice recording to be terminated. In this case, the user can draw the desired trajectory while continuously maintaining the contact of the pointer, and can simultaneously perform voice recording and drawing of the handwriting object.

As another example, the control unit 180 may control the voice recording to be terminated when the drawing pen 321 is selected and voice recording is started and the drawing pen 321 is reselected (or deselected).

10 and 11 can be applied not only to the drawing pen 321 but also to the high-lighter pen 319, the private pen 317, the capture pen 313 and the shared pen 315 as described above . Hereinafter, differences between the drawing pen 321, the private mode pen, the capture pen 313 and the shared pen 315 will be described.

First, the difference between the drawing pen 321 and the private pen 317 will be described. When the mobile terminal 100 is set to share a screen with an external terminal, the handwritten object drawn using the drawing pen 321, The handwritten object drawn using the private pen 317 may not be provided to the external terminal. This will be described in detail with reference to FIG.

12 is an exemplary diagram for explaining whether or not a handwritten object drawn using a drawing pen and a private pen is displayed on an external terminal. In the example of Fig. 12, it is assumed that the mobile terminal 100 and the external terminal are set to share each other's handwriting objects.

12A, when the first handwritten object 1201 is drawn using the drawing pen 321, the control unit 180 not only controls the touch screen 151 but also the first handwritten object 1201 through the external terminal 1200, The handwritten object 1201 can be controlled to be displayed. More specifically, the controller 180 transmits the first handwritten layer indicating the first handwritten object 1201 to the external terminal 1200 so that the first handwritten object 1201 can be displayed also in the external terminal 1200 Can be controlled.

12B, when the second handwritten object 1211 is drawn using the private pen 317, the control unit 180 determines that the second handwritten object 1211 is displayed only on the touch screen 151 And the external terminal 1200 controls to prevent the second handwritten object 1211 from being displayed.

The control unit 180 controls the first handwritten object 1201 to distinguish the second handwritten object 1211 drawn using the first handwritten object 1201 drawn by using the drawing pen 321 and the private pen 317. [ And the second handwritten object 1211 can be displayed on the second handwritten layer different from the first handwritten layer. The control unit 180 transmits only the first handwritten layer among the first handwritten layer and the second handwritten layer to the external terminal 1200 so that the second handwritten object 1211 drawn using the private pen 317 is transmitted to the external terminal 1200 ). ≪ / RTI >

3A-2, 3B-2 and 3C-2 illustrate the relationship between the drawing pen 321 and the private pen 317, the highlighter pen 319, the capture pen 313, It is needless to say that the unsharable attribute such as the private pen 317 may be applied to the unauthorized person 315 as well. When the handwriting object using the highlighter pen 319, the capture pen 313 and the sharing pen 315 is set not to be shared with an external terminal such as the private pen 317, the handwriting object can be shared with a private highlighter pen, Quot; shared pen ".

Next, the difference between the drawing pen 321 and the capture pen 313 will be described. In order to draw the handwriting object on the touch screen 151 in the handwriting input mode, the drawing pen 321 and the capture pen 313 But the capture pen 313 is capable of capturing the real-time output image of the touch screen 151 after the handwriting input mode is ended. The function of the capture pen 313 will be described in more detail with reference to FIG.

13 is an exemplary diagram for explaining capturing a real-time output image of a touch screen using a capture pen. When the user selects the capture pen 313, the control unit 180 enters the handwriting input mode and controls the user to draw the handwriting object, like the drawing pen 321. [ 13A, the control unit 180 can control whether to display the completion button 1303 for ending the handwriting input mode and the handwriting object 1310 drawn on the touch screen 151 It is possible to control the display control button 1301 to be further displayed. If the recording function using the capture pen 313 is also activated, the recording button (see FIG. 11) may be further displayed together with the completion button.

When the user applies a touch input to the touch screen 151 while the handwriting input mode is maintained, the control unit 180 can control the handwriting object 1310 to be drawn by following the trajectory of the touch input. When the user completes the handwriting action and then presses the completion button 1303, the control unit 180 ends the handwriting input mode and can capture the real time output image of the touch screen 151. [ When capturing the real-time output image of the touch screen 151, if the display control button 1301 is activated, the control unit 180 may control the generation of the captured image including the handwriting object. On the contrary, if the handwriting input mode is terminated while the display control button 1301 is inactivated, the control unit 180 may control the capture image to be generated while excluding the handwriting object 1310.

The capture image may be generated in a file format such as jpg, png, tif, gif, bmp, etc. When the capture image is generated, the control unit 180 notifies the completion of the image capturing Message 1320 to be displayed.

That is, as in the example shown in FIG. 13, the capture pen 313 can be understood to further perform the function of capturing the real-time output image of the touch screen 151 including the handwriting object once the handwriting input mode is completed have.

Next, the shared pen 315 shown in Figs. 3A-2, 3B-2 and 3C-2 will be described in detail. The shared pen 315 is the same as the drawing pen 321 in that the handwriting object is drawn on the touch screen 151 after entering the handwriting input mode, Is different from the drawing pen 321 in that it can capture the real-time output image and transmit the generated captured image to a predetermined account. The function of the sharing pen 315 will be described in more detail with reference to FIG.

14 is an exemplary diagram for explaining the operation of the mobile terminal using the shared pen. When the user selects the sharing pen 315, the control unit 180 can control to display a menu screen 1410 in which an account to select an account to share a captured image to be generated at a later time, as in the example shown in Fig. 14A have. In the example of FIG. 14A, the items classified as 'SNS' include an account of a set social network service (SNS of Facebook, Twitter, etc. as an example) or an IM (Instant Message) service (What's apps in FIG. IM service is an example), and items classified as 'Contacts' are for selecting a telephone number of an external terminal. In setting a telephone number of an external terminal as a transmission account, it is possible to use a call history, a favorite phone book, and a phone book list.

For example, in the example of FIG. 14A, when a phone book list button is selected (1401), the controller 180 controls the phone book list stored in the memory 160 to be displayed as shown in FIG. 14B . The user can select the account (telephone number) of the other party to which the captured image is to be transmitted by referring to the phone book list displayed on the touch screen 151 (e.g., 'Maija' is selected in FIG. 14B, 1403).

When the account of the other party to transmit the captured image is selected, the control unit 180 enters the handwriting input mode and can control the user to draw the handwriting object 1425. 14A, the control unit 180 includes a completion button 1423 for ending the handwriting input mode and a display control button 1420 for controlling whether the object drawn on the touch screen 151 is displayed or not (1421) can be further displayed. At the same time, the control unit 180 can control the display of the account of the other party (Maija in the example of FIG. 14C) which is to share the captured image to be generated later with the shared pen 315. In the example of FIG. 14A, if the recording function using the shared pen 315 is activated, the recording button (see FIG. 11) may be further displayed.

When the user inputs a touch input to the touch screen 151 while the handwriting input mode is maintained, the controller 180 can control the handwriting object 1425 to be drawn by following the trajectory of the touch input. When the user completes the handwriting action and presses the completion button 1423, the control unit 180 ends the handwriting input mode and can capture the real time output image of the touch screen 151. [ When a captured image captured by capturing the real-time output image of the touch screen 151 is generated, the control unit 180 may exclude the wireless communication unit 110 from transmitting the captured image to the account of the selected counterpart.

If the handwriting input mode is terminated while the display control button 1421 is activated, the handwriting object 1425 may be included in the captured image transmitted to the account of the other party. Conversely, if the handwriting input mode is terminated while the display control button 1421 is inactivated, the handwriting object 1425 may not be included in the captured image transmitted to the account of the other party.

Further, if the voice recording is also performed using the sharing pen 315, the control unit 180 can control the recording file to be transmitted to the account of the other party along with the captured image.

14D, when the transmission of the captured image (and the recorded file) to the account of the other party is completed, the control unit 180 transmits a notification message 1430 indicating that the transmission of the captured image (and the recorded file) Can be displayed.

14, it is illustrated that the user can select an account to which a capture image is to be transmitted after the sharing pen 315 is selected. However, the control unit 180 does not wait for the user's operation, (I.e., a series of processes described in Figs. 14A and 14B may be omitted). For example, when the account to which the captured image is to be transmitted selects the pre-assigned shared pen 315, the control unit 180 does not wait for the user to select, and the captured image is transmitted to the account assigned to the shared pen 315 The wireless communication unit 110 can be controlled. This will be described in more detail with reference to FIG.

Figure 15 is an illustration of transferring a capture image to an account designated by a shared pen, without waiting for user input. In the example of FIG. 15A, it is assumed that the share pen 1501 marked 'Share to Jane' is assigned the telephone number of the other party having the name Jane on the telephone directory list. When the sharing pen 1501 marked as Share to Jane is selected, the control unit 180 can control the handwriting input mode to enter the handwriting input mode without selecting a counterpart account to share the captured image to be generated later. Thereafter, when the handwriting mode is terminated (e.g., touching the Done button 1505), the control unit 180 may control the capture image to be sent to Jane's account (specifically Jane's phone number) (See notification message 1520 of FIG. 14, if the display control button 1503 is in the activated state, the control unit 180 will generate a captured image including the handwriting object 1510, and when the display control button 1503 is in a deactivated state The control unit 180 will generate a captured image except for the handwriting object 1510. [

3A, 3B-2, and 3C-2, the eyedropper 311, the highlighter pen 319, the drawing pen 321, the private pen 317, the capture pen 313, Etc. may be displayed, but fewer functioning tools may be displayed, or more functioning tools may be displayed. For example, when there are more function tools that are not displayed on the touch screen 151, the controller 180 displays a scroll arrow 309 (FIG. 3A) for displaying a function tool not displayed on the screen, Can be displayed. To display a function tool that is not displayed on the touch screen 151, the user can select the scroll arrow 309.

Further, the user can control the addition of a new function tool in addition to the function tool described above by using the additional pen 323. This will be described in more detail with reference to FIG.

Figure 16 is an exemplary diagram illustrating the addition of a new functional tool to the touch screen using an additional pen. In the example of FIG. 3A-2, when the user selects the additional pen 323 indicated by '+', the control unit 180 displays a setting menu 1610 Can be displayed. In the example of FIG. 16A, the 'shared list setting' item 1611 is for determining whether to add the shared pen 315, and the attribute setting 1613 is for specifying an attribute of a new function tool to be added . Further, the toggle key displayed in the sharing setting 1615 may be for generating the private pen 319. [

The 'None' item in the 'shared list setting' is used to set the function tool to a function tool having only drawing functions such as the drawing pen 321, the highlighter pen 319, and the private pen 317 instead of the private pen 319 Lt; / RTI > Further, the SNS and Contact may be for creating a shared pen 315 associated with a particular party's account, such as the shared pen 315 described in FIG. For example, when the 'Contacts' button is selected in the example of FIG. 16A, the controller 180 may control the phone book list stored in the memory 160 to be displayed, as shown in FIG. 16B. When the user selects a specific party (1621) from the phone book list shown in FIG. 16C, the controller 180 determines whether a new share (a phone number) is assigned to the account of the selected party (for example, 'Maija' It is possible to control the pen 1623 to be generated.

In Fig. 16, the user has added a new function tool by selecting the additional pen 323. However, a new function tool may be added in a different way. This will be described with reference to the example of Fig.

Figure 17 is another example for adding a new functional tool. 17A, when at least one of the function tools shown on the touch screen 151 is dragged to the additional pen 323, the controller 180 adds a function tool performing the same function as the dragged function tool . However, at this time, the newly added function tool can be adjusted to have a different attribute from the existing function tool.

17A, when the drawing pen 321 is dragged to the additional pen 323 (1701), the control unit 180 performs the same function as the drawing pen 321, as shown in FIG. 17B A new drawing pen (e.g., Draw 1 in FIG. 15B, 1703) is additionally displayed. At this time, in order to prevent the original function tool and the new function tool from having the same attribute (or the same set value), the controller 180 adjusts the attribute (or set value) of the new function tool Lt; RTI ID = 0.0 > 1710 < / RTI >

Alternatively, the control unit 180 may control the new function tool to automatically assign an arbitrary attribute (or set value) different from the attribute (or set value) of the original function tool, Setting values) can be prevented from overlapping. For example, the control unit 180 controls the color assigned to the newly added drawing pen 1703 to have a darker tone than that of the original drawing pen 321, following the color of a similar sequence to the original drawing pen 321, It is possible to prevent the property overlap between the pen 1703 and the original drawing pen 321 from overlapping.

In the above description, the handwriting objects drawn using the drawing pen 321, the highlighter pen 319, the capture pen 313, and the sharing pen 315 are different from the handwriting objects drawn using the private pen 317 And may be set to be shared with an external terminal. However, the handwritten object drawn using the conventional drawing pen 321, the highlighter pen 319, the capture pen 313, and the shared pen 315 may be set to be prevented from sharing with the external terminal. This will be described in detail with reference to FIG. For convenience of description, it is assumed in Fig. 18 that the handwriting object drawn by the highlighter pen 319 is set not to be shared with the external terminal.

18 is an exemplary diagram for explaining the change of the high-lighter pen to the private high-lighter pen. 18A, when the private pen 317 is dragged to the high-lighter pen 319, the control unit 180 causes the high-lighter pen 319 to move to the private high-lighter pen 1803 ). The handwritten object drawn using the private highlighter pen 1803 can be set not to be shared with the external terminal as in the case of the private pen 317 previously.

18, the capture pen 313 and the shared pen 315 are also used for the private capture 315. However, if the private pen 317 is dragged to the capture pen 313 and the shared pen 315, A pen and a private shared pen. Hereinafter, for convenience of description, a handwriting input mode for drawing a handwriting object that can be shared with an external terminal is referred to as a first handwriting input mode, and a handwriting input mode for drawing a handwriting object that can not be shared with an external terminal is referred to as a second handwriting input mode Input mode. That is, the handwriting input mode in which the drawing pen 321, the highlighter pen 319, the capture pen 313, the sharing pen 315, and the like are selected and entered is the first handwriting input mode in which the private pen 317, It is assumed that the handwriting input mode in which the highlighter pen, the private capture pen, and the private sharing pen are selected and entered is the second handwriting input mode.

3 to 18, a functional tool that can be used for controlling the operation of the mobile terminal 100 according to the present invention has been described before describing the operation of the mobile terminal 100 according to the present invention. Hereinafter, a handwriting input sharing method of the mobile terminal 100 according to the present invention using the functional tool will be described in detail.

19 is a flowchart of a handwriting input sharing method of a mobile terminal according to an embodiment of the present invention. 12, a handwritten object drawn in the first handwriting input mode is defined as a first handwritten object and an object drawn in the second handwriting input mode is defined as a second handwritten object. In FIG. 19, the touch screen 151 of the mobile terminal 100, A handwritten object drawn through the external terminal is defined as a first handwritten object, and a handwritten object drawn through an external terminal is defined as a second handwritten object.

First, upon receiving a handwriting input sharing request from an external terminal (S1901), the mobile terminal 100 may determine whether to share the handwriting input with the external terminal based on the user input (S1902). If it is set to share the handwriting input with the external terminal, the control unit 180 of the mobile terminal 100 set as the host can set the handwriting input authority of the external terminal (S1903). Whether or not the handwriting input authority is to set whether or not handwriting input from an external terminal set to share the handwriting input with the mobile terminal 100 is shared. The setting of the handwriting input permission will be described in detail with reference to the example of FIG.

20 is an exemplary diagram of a screen for setting whether handwriting input permission of an external terminal set to share a handwriting input is established. In the example of FIG. 20, an external terminal configured to share a handwriting input with the mobile terminal 100 is exemplified as a terminal of 'Jane' and a terminal of 'Knoster'. When an external terminal to share the handwriting input is selected with the mobile terminal 100, the controller 180 may control the display of a screen for setting the handwriting input permission of each external terminal as shown in FIG. 20A. In the example of FIG. 20A, the viewing only button 2001 is set to not grant a handwriting input authority to an external terminal, and the editing button 2003 is set to grant a handwriting input authority to an external terminal.

The mobile terminal 100 can simultaneously display the handwritten object drawn on the touch screen 151 and the handwritten object drawn at the external terminal (the terminal of Jane in the example of FIG. 20B) to which handwriting input authority is given on the touch screen 151 . On the contrary, the handwritten object drawn at the external terminal to which the handwriting input authority is not given (in the example of FIG. 20B in the example of FIG. 20B) is displayed only through the external terminal to which the handwriting input authority is not given, .

20, the control unit 180 receives a handwriting object from Jane's terminal and controls the handwriting object received and the handwritten object drawn in the mobile terminal 100 to be simultaneously displayed on the touch screen 151 .

When the handwriting input authority is given to the external terminal, the controller 180 can set the handwriting object color from the external terminal to be displayed on the touch screen 151 based on the user input. For example, as shown in the example of FIG. 20B, when a handwriting input authority is given to an external terminal, the control unit 180 may include a pen setting button for setting a handwriting object color from an external terminal to which handwriting input authority is given (2010) can be controlled to be activated. When the pen setting button is selected in the example of FIG. 20B, the controller 180 can control to display a pen setting menu screen that can set the handwriting object color from the external terminal as shown in FIG. 20C.

In the example of FIG. 20C, the 'Number of pens' item 2020 may indicate the number of colors that can be assigned to the external terminal. In Fig. 20C, seven color pens of different colors are illustrated as being located in the number of pens. When the user selects one of the seven color pens shown in the number of pens, the controller 180 can control the selected color to be assigned to the external terminal. Thereafter, the control unit 180 may control the handwriting object received from the external terminal having the handwriting input authority to be displayed in the color assigned thereto.

For example, in the example of FIG. 20C, if yellow is allocated to the terminal of Jane, the controller 180 may control the handwriting object received from the terminal of Jane to be displayed in yellow.

Further, in the example of FIG. 20C, the control unit 180 may control to prevent the same color from being superimposed on the external terminal. For example, if a first color is assigned to a first external terminal, a first color can not be assigned to a second external terminal, and a color different from the first color must be assigned. In FIG. 20C, it is exemplified that seven colors can be assigned to an external terminal, and it is illustrated that seven colors can be assigned to seven terminals.

However, the number of pens shown in FIG. 20C does not mean the maximum number of external terminals to which the handwriting input authority can be given. Even if the number of the external terminals to which the handwriting input authority is given is larger than the number of assignable colors (seven in Fig. 20C), more colors are assigned to the external terminals through the additional button 2022 shown in Fig. 20C .

If the number of the external terminals to which the handwriting input authority is granted is larger than the number of colors that can be assigned, the control unit 180 can receive the handwriting object only from the external terminal pre-coloring. The control unit 180 may control the handwriting object input to the external terminal not assigned the color to be displayed through the mobile terminal 100 until the color returned by the external terminal is allocated.

Here, the return of the color assigned to the external terminal may be automatically performed according to the occurrence of the predetermined event in the external terminal. For example, when an external terminal stops handwriting input sharing with the mobile terminal 100 and a call signal is received at an external terminal during handwriting input sharing, an application independent of handwriting input sharing is executed to an external terminal during handwriting input sharing The control unit 180 can control the color assigned to the external terminal to be returned. In addition, when the user of the mobile terminal 100 requests to stop the handwriting input sharing with a specific external terminal, the color assigned to the external terminal may be returned.

In the example of FIG. 20C, the 'particular settings' item 2030 is for displaying the color assigned to the external terminal to which the handwriting input authority is given, and the 'my setting' To display the color of the handwriting object drawn on the screen. If there is no function tool selected by the user of the mobile terminal 100 at the time of setting the handwriting input authority in the external terminal, the My Settings item 2040 may be blank, as shown in FIG. 20C.

The pen icon 2032 in the detail setting item 2030 can be used to indicate a color assigned to an external terminal. For example, in the example of FIG. 20D, if yellow is assigned to Jane's terminal, the control unit 180 can control the pen icon 2032 to be yellow. Further, the eraser icon 2034 in the detail setting item 2030 can be used to determine whether to grant the non-drawing right to the external terminal. If the eraser icon 2034 is displayed in the detailed setting item 2030, as in the example shown in FIGS. 23C and 23D, it can be understood that the erasing right is given to the external terminal as well as the drawing right. That is, it can be understood that Jane's terminal has authority to not only create the second handwritten object but also to erase the second handwritten object.

When a handwriting input authority is given to a plurality of external terminals, in order to prevent the colors of the pen assigned to the external terminals from overlapping each other, the controller 180 controls the colors The place where the pen is placed can be controlled to be displayed as an empty space. If the external terminal to which the handwriting input authority has been granted has finished sharing the handwriting input with the mobile terminal 100, the color pen assigned to the external terminal will be returned to the original position.

In the example of FIG. 20D, since yellow is allocated to the terminal of Jane to which the handwriting input authority is given, the handwriting object received from the terminal of Jane will be displayed yellow in the mobile terminal 100. [ Thereafter, when the user selects the completion button, the controller 180 can complete the color setting to the external terminal to which the handwriting input authority is given.

Referring again to FIG. 19, when the setting of the handwriting input authority of the external terminal is completed, the controller 180 controls the function tool shown in FIG. 3 to be displayed based on the user input (S1904). After that, when the user selects a function tool for handwriting input among the function tools shown in FIG. 3 (S1905), the controller 180 can enter the handwriting input mode. 3, a handwriting object such as a highlighter pen 319, a drawing pen 321, a capture pen 313 and a shared pen 315 can be shared with an external terminal, A second function tool that can not share a handwriting object with an external terminal, such as a first handwriting input mode, a private highlighter pen, a private pen 321, a private capture pen, and a private sharing pen The handwriting input mode entered by selection will be referred to as a second handwriting input mode.

That is, when the first function tool among the function tools displayed on the touch screen 151 is selected, the controller 180 sets the first handwriting input mode to the first handwriting input mode (S1906) (S1907).

Thereafter, when the user inputs a touch input to the touch screen 151 along the first desired trajectory (S1908, S1909), the control unit 180 displays a first handwritten object drawn along the first desired trajectory on the touch screen 151 (S1910, S1911). At this time, if the first handwritten object is drawn under the first handwriting input mode, the control unit 180 can further control the first handwritten object to be displayed not only on the touch screen 151 but also on an external terminal configured to share the handwriting input (S1910). That is, unlike the case where the first handwritten object is drawn under the second handwriting input mode when the first handwritten object is drawn under the first handwriting input mode, the control unit 180 controls the first handwriting object 151, Can be displayed.

When a touch input is input to an external terminal other than the mobile terminal 100 along a second desired locus (S1912), the controller 180 displays the handwritten object drawn along the second desired locus based on the handwriting input authority of the external terminal Can be controlled. Specifically, when the touch input is drawn along the second desired trajectory to the external terminal having the handwriting input authority (S1913), the control unit 180 controls the handwriting object drawn along the second desired trajectory to be displayed on the touch screen 151 (S1914). Otherwise, when the touch input is drawn along the second desired trajectory to the external terminal to which the handwriting input authority has not been granted (S1913), the control unit 180 determines that the handwritten object drawn on the external terminal It can be controlled not to be displayed on the screen 151 (S1915).

However, the handwriting object generated through the external terminal having the handwriting input authority is not necessarily displayed on the touch screen of the mobile terminal 100 at all times. As described above, in step S1905 to step S1910, the external terminal may also be set to the first handwriting input mode or the second handwriting input mode. In this case, the control unit 180 can control the handwriting object to be displayed on the touch screen 151 only when the external terminal is set in the first handwriting input mode.

In FIG. 19, when the mobile terminal 100 and the external terminal are set to share the handwriting input, the controller 180 can set the handwriting input authority to the external terminal. In addition, when the handwriting object set to be shared with the external terminal is drawn on the touch screen 151 (i.e., the handwriting object generated in the first handwriting input mode), the mobile terminal 100 according to the present invention can share the handwriting input It is possible to set the editing authority for the written handwriting object to the set external terminal. The editing authority may be for adjusting the display form of the handwriting object, such as changing the size of the drawn handwriting object, changing the color, or changing the display position. This will be described in detail with reference to FIG. 21, which will be described later.

21 is a diagram illustrating an output of a touch screen for setting an editing right of a handwriting object displayed on a touch screen. For convenience of explanation, it is assumed that a handwriting object is drawn along the locus of the touch input of the user on the touch screen 151 of the mobile terminal 100. When the user applies appropriate user input to the handwriting object drawn on the touch screen 151 (e.g., long-pressing the handwriting object displayed on the touch screen 151) It is possible to control the display of a pop-up menu 2110 for setting the editing authority of the object. In the example of FIG. 21A, when the 'authority' item is selected, the control unit 180 displays an external terminal list set to share handwritten input as in the example shown in FIG. 21B (in the example of FIG. (For example, the terminal of the Knoster is an external terminal configured to share the handwriting input) can be controlled to display a setting screen 2120 that can control whether or not editing authority is given to the handwriting object selected for each shared terminal. In the example of FIG. 21B, it is illustrated that Jane's terminal is given editing authority and Knoster's terminal is not given editing authority. Jane's terminal can remotely control the color, display position, display size, and the like of the handwriting object displayed on the touch screen 151 of the mobile terminal 100 using editing authority, The display position, the display size, and the like of the handwriting object displayed on the touch screen 151 of the user.

The control unit 180 can control the display form of the handwriting object displayed on the touch screen 151 by receiving the control signal from the external terminal to which the editing right is granted.

Although not shown in FIG. 19, during operation of the mobile terminal 100 according to FIG. 19, the controller 180 may perform an operation corresponding to the function tool of FIG. 3 at any time. That is, a capture image may be generated using the capture pen 313 while the handwriting input is shared with an external terminal, or the capture image may be transmitted to the third external terminal using the shared pen 315. Furthermore, as described above with reference to Fig. 11, voice recording can be performed together with handwriting input. When voice recording is performed, the control unit 180 may further transmit the recording data along with the handwriting object to the external terminal to which the handwriting input is to be shared. Recording data provided to the external terminal may also be limited to those generated under the first handwriting input mode, as in FIG.

11, when the drawing pen 321 is selected, a recording button is displayed on the touch screen 151, and voice recording can be performed on the touch screen 151 at the same time of inputting a handwriting object. However, , And a recording button for proceeding to voice recording after the handwriting object is drawn may be displayed. This will be described in detail with reference to FIG.

22 is an exemplary diagram for explaining the progress of voice recording after a handwriting object is drawn on the touch screen. In the pop-up menu 2110 of the example shown in FIG. 21A, when the user selects the 'voice' item, the control unit 180 controls the voice recording to be performed at one end of the handwriting object, as in the example shown in FIG. It is possible to control so that the record button 2201 is displayed. When the recording button 2201 is selected, the control unit 180 can switch the recording button to the stop button 2203 and activate the microphone 122 to control the voice recording to proceed as in the example shown in FIG. 22B have. The progress bar 2205 in FIG. 22B may be one in which the microphone 122 is activated to indicate the elapsed time of voice recording. When the voice recording is completed, the control unit 180 can replace the stop button 2203 with the play button. When the voice recording is completed, the controller 180 can transmit the voice file to the external terminal so that the external terminal can reproduce the voice file.

Referring to FIGS. 11 and 22, when voice recording progresses under the first handwriting input mode, the controller 180 may control the display button 2201 to be displayed on an external terminal as well as the touch screen 151. If the recording button 2201 is selected in the external terminal, the controller 180 activates the microphone 122 of the external terminal, not the microphone 122 of the mobile terminal 100, have. When the voice recording is completed, the control unit 180 can receive the recorded data from the external terminal.

The mobile terminal 100 described in FIG. 19 can display both the first handwritten object generated by itself and the second handwritten object generated through the external terminal in some cases. 23, the control unit 180 controls the first handwritten object 2301 and the second handwritten object 2303 to overlap and display the first handwritten object 2301 and the second handwritten object 2303, can do.

24A, the controller 180 displays the first handwritten object 2412 in the first area 2410 of the touch screen 151, and overlaps the first handwritten object 2412 with the first area 2410. In this case, The second handwritten object 2422 can be controlled to be displayed in the second area 2420 (or at least partly overlapped). As the first handwritten object 2412 and the second handwritten object 2422 are displayed through different areas, the visibility of the handwriting object can be increased.

Further, the controller 180 may copy the first handwritten object 2412 located in the first area 2410 to the second area 2420 based on the user input, or copy the first handwritten object 2412 to the second area 2420, The handwritten object 2422 may be copied to the first area 2410. [ For example, when a predetermined user input of the second handwritten object 2422 located in the second area 2420 is applied in FIG. 24A, the control unit 180 displays the popup menu illustrated in FIG. 21A (2430) is displayed. When the touch input is applied to the desired point in the first area 2410 after the 'copy' item in the pop-up menu 2430 of the touch screen 151 is selected, A pop-up menu 2430 for pasting the second handwritten object 2422 can be displayed. Thereafter, when a paste item is selected by the user input, the control unit 180 can control the second handwritten object 2422 to be copied at the desired point (see FIG. 24D).

In FIG. 19, after the first handwritten object is generated from the mobile terminal 100, the second handwritten object is generated in the external terminal. However, the second handwritten object should not be generated after the first handwritten object is created . Conversely, a first handwritten object may be created after the second handwritten object is created, and the first handwritten object and the second handwritten object may be generated at the same time.

That is, steps S1912 through S1915 may be performed simultaneously at any time during steps S1904 through S1911 of FIG. 19, and steps S1912 through S1915 may proceed even before step S1904.

According to one embodiment of the present invention, the above-described method (operation flow diagram) can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described mobile terminal 100 is not limited in the configuration and method of the above-described embodiments, but the embodiments may be modified such that all or some of the embodiments are selectively combined .

100: mobile terminal
110:
122: microphone
151: Touch screen
160: Memory
180:

Claims (18)

A wireless communication unit for communicating with an external terminal;
A touch screen for receiving a first touch input of a first desired locus; And
Controlling the first handwritten object drawn along the first desired trajectory to be simultaneously displayed through the touch screen and the external terminal when the first touch input is inputted in the first handwriting input mode,
Controlling the first handwritten object to be displayed only on the touch screen when the first touch input is inputted in the second handwriting input mode,
A screen for determining handwriting input authority of the external terminal is displayed,
When receiving an input for selecting a first button from a user,
When receiving an input for selecting the second button from the user,
. The method according to claim 1,
When the second touch input of the second desired locus is input from the external terminal,
Wherein the controller controls whether or not to display a second handwritten object drawn along the second desired trajectory according to the handwriting input permission of the external terminal. 3. The method of claim 2,
If the external terminal does not have a handwriting input authority,
Wherein the control unit controls to prevent the second handwritten object from being displayed on the touch screen. 3. The method of claim 2,
If the external terminal has a handwriting input authority,
Wherein the controller controls the second handwritten object to be displayed on the touch screen. 3. The method of claim 2,
Wherein the control unit controls the first handwritten object and the second handwritten object to be displayed in different areas of the touch screen. 6. The method of claim 5,
Wherein the first handwritten object is displayed in a first area of the touch screen and the second handwritten object is displayed in a second area of the touch screen. The method according to claim 1,
Further comprising a microphone for voice recording,
Wherein the control unit activates the microphone so that voice recording can proceed in the first handwriting input mode or the second handwriting input mode. 8. The method of claim 7,
Wherein the control unit controls the voice recording data to be provided to the external terminal when the voice recording data is generated under the first handwriting input mode,
And controls to prevent the voice recording data from being provided to the external terminal when the voice recording data is generated under the second handwriting input mode. The method according to claim 1,
Wherein the control unit controls the generation of a captured image by capturing an output image of the touch screen. 10. The method of claim 9,
Wherein the control unit determines whether or not to include the first handwritten object in the captured image based on a user command. 10. The method of claim 9,
Wherein the control unit controls the capture image to be transmitted to the third terminal. The method according to claim 1,
Wherein the control unit controls the plurality of function tools for entering the first handwriting input mode and the second handwriting input mode to be displayed based on a user command. 13. The method of claim 12,
Wherein the first function tool among the plurality of function tools is for setting the mobile terminal to the first handwriting input mode,
Wherein the second function tool among the plurality of function tools is for setting the mobile terminal to the second handwriting input mode. 14. The method of claim 13,
Wherein the control unit controls the attribute assigned to the first function tool or the second function tool to be applied to the first handwritten object. 15. The method of claim 14,
Wherein the attribute includes at least one of a color of the first handwritten object and a stroke thickness of the first handwritten object. delete Establishing a communication channel with an external terminal;
Entering into either the first handwriting input mode or the second handwriting input mode based on user input; And
When the first touch input of the first desired locus is input in the first handwriting input mode, the first handwriting object following the first desired locus is simultaneously displayed on the touch screen and the external terminal,
Displaying the first handwritten object only on the touch screen when the first touch input is input in the second handwriting input mode,
And transmitting the control information to the mobile terminal. A command for establishing a communication channel with an external terminal;
Instructions for entering either the first handwriting input mode or the second handwriting input mode; And
When the first touch input of the first desired locus is input in the first handwriting input mode, the first handwriting object following the first desired locus is simultaneously displayed on the touch screen and the external terminal,
A command for displaying the first handwriting object only on the touch screen when the first touch input is inputted in the second handwriting input mode,
And a control unit for controlling the operation of the mobile terminal.

Images